Package akka.javasdk.agent.evaluator

Class HallucinationEvaluator

Object
akka.javasdk.agent.Agent
akka.javasdk.agent.evaluator.HallucinationEvaluator
@Component(id="hallucination-evaluator", name="Hallucination Evaluator Agent", description="An agent that acts as an LLM judge to evaluate whether an output contains information\nnot available in the reference text given an input question.\n") public class HallucinationEvaluator extends Agent
An agent that acts as an LLM judge to evaluate whether an output contains information not available in the reference text given an input question.

Model provider is defined in configuration akka.javasdk.agent.evaluators.hallucination-evaluator.model-provider, which by default is the same as the default model provider.

The system and user message prompts are loaded from PromptTemplate with id hallucination-evaluator.system and hallucination-evaluator.user respectively. Default prompts are used if these are not defined. The prompts can be initialized or updated with the PromptTemplate entity.