Package akka.javasdk.agent.evaluator

Class SummarizationEvaluator

Object

akka.javasdk.agent.Agent

akka.javasdk.agent.evaluator.SummarizationEvaluator

@Component(id="summarization-evaluator",
           name="Summarization Evaluator Agent",
           description="An agent that acts as an LLM judge to evaluate a summarization task.\n")
public class SummarizationEvaluator
extends Agent

An agent that acts as an LLM judge to evaluate a summarization task.

Model provider is defined in configuration akka.javasdk.agent.evaluators.summarization-evaluator.model-provider, which by default is the same as the default model provider.

The system and user message prompts are loaded from PromptTemplate with id summarization-evaluator.system and summarization-evaluator.user respectively. Default prompts are used if these are not defined. The prompts can be initialized or updated with the PromptTemplate entity.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final record	SummarizationEvaluator.EvaluationRequest
static final record	SummarizationEvaluator.Result

Nested classes/interfaces inherited from class akka.javasdk.agent.Agent

Agent.Effect<T>, Agent.StreamEffect

Field Summary

Fields

Modifier and Type	Field	Description
protected final ComponentClient	componentClient
protected final String	componentId
protected final com.typesafe.config.Config	config

Constructor Summary

Constructors

Constructor	Description
SummarizationEvaluator(ComponentClient componentClient, com.typesafe.config.Config config)

Method Summary

Modifier and Type	Method	Description
Agent.Effect<SummarizationEvaluator.Result>	evaluate(SummarizationEvaluator.EvaluationRequest req)
protected ModelProvider	modelProvider()
protected String	prompt(String promptId, String defaultPrompt)

Methods inherited from class akka.javasdk.agent.Agent

context, effects, streamEffects

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

componentId

protected final String componentId

componentClient

protected final ComponentClient componentClient

config

protected final com.typesafe.config.Config config

Constructor Details

SummarizationEvaluator

public SummarizationEvaluator(ComponentClient componentClient,
 com.typesafe.config.Config config)

Method Details

evaluate

public Agent.Effect<SummarizationEvaluator.Result> evaluate(SummarizationEvaluator.EvaluationRequest req)

modelProvider

protected ModelProvider modelProvider()

prompt

protected String prompt(String promptId,
 String defaultPrompt)