Embabel Agent Documentation/com.embabel.agent.spi.decision/LlmDecisionServiceFactory

LlmDecisionServiceFactory

@ApiStatus.Experimental

class LlmDecisionServiceFactory @ApiStatus.Internal constructor(llmOperations: LlmOperations, modelProvider: ModelProvider, retry: RetryProperties, observationRegistry: <Error class: unknown class> = ObservationRegistry.NOOP)

Builds decision and classification services that ask a chat model.

Each service records one embabel.ai.decision or embabel.ai.classification observation per call. A model named here is looked up once, when the service is built. To use a model the caller already holds, such as one built for a user's own API key, pass the LlmService instead.

Applications inject the LlmDecisionServiceFactory bean from the Spring context.

Constructors

LlmDecisionServiceFactory

@ApiStatus.Internal

constructor(llmOperations: LlmOperations, modelProvider: ModelProvider, retry: RetryProperties, observationRegistry: <Error class: unknown class> = ObservationRegistry.NOOP)

Functions

classificationService

fun classificationService(llm: LlmService<*>): ClassificationService

Builds a classification service for a model the caller already holds.

fun classificationService(llmName: String): ClassificationService

Builds a classification service for the model with this name.

decisionService

fun decisionService(llm: LlmService<*>): DecisionService

Builds a decision service for a model the caller already holds.

fun decisionService(llmName: String): DecisionService

Builds a decision service for the model with this name.