LlmDecisionServicesAutoConfiguration

Supplies the LlmDecisionServiceFactory bean, with retry settings bound from embabel.agent.platform.decisions.llm. The factory is a decision model provider for every chat model, so a decision default or role can name a chat model and the registry builds its prompted service on first use.


embabel:
  agent:
    platform:
      decisions:
        llm:
          max-attempts: 5
  models:
    decision:
      roles:
        triage: small-chat-model

Constructors

Link copied to clipboard
constructor()

Functions

Link copied to clipboard
open fun llmDecisionServiceFactory(llmOperations: LlmOperations, modelProvider: ModelProvider, observationRegistry: ObjectProvider<ObservationRegistry>, retry: LlmDecisionRetryProperties): LlmDecisionServiceFactory
An application factory bean replaces this one, including as the chat model provider.