Embabel Agent Documentation/com.embabel.common.ai.model

Package-level declarations

Types

class ConfigurableModelProvider constructor(llms: List<LlmService<*>>, embeddingServices: List<<Error class: unknown class>>, properties: ConfigurableModelProviderProperties, roleResolvers: List<RoleResolver> = emptyList(), credentialLlmServiceFactories: List<CredentialLlmServiceFactory> = emptyList()) : ModelProvider

Take LLM definitions from configuration

ConfigurableModelProviderProperties

data class ConfigurableModelProviderProperties(var llms: Map<String, String> = emptyMap(), var embeddingServices: Map<String, String> = emptyMap(), var defaultLlm: String = "gpt-4.1-mini", var defaultEmbeddingModel: String? = null, var roles: Map<String, Map<String, <Error class: unknown class>>> = emptyMap(), var credentialServiceCacheSize: Int = 500)

Configuration properties for the model provider

ConfigurableRoleResolver

class ConfigurableRoleResolver(properties: ConfigurableModelProviderProperties, defaultProviderName: () -> String?) : RoleResolver

The platform's own RoleResolver, consulted after any the application registers.

CredentialEndpoint

sealed interface CredentialEndpoint

Where a user's key should be sent, and what the service built from it should say about itself.

CredentialEndpointResolver

fun interface CredentialEndpointResolver

Says where a user's key should be sent, for the providers this application knows about.

CredentialLlmServiceFactory

fun interface CredentialLlmServiceFactory

Builds an LlmService from a user-supplied key, for a wire protocol the framework has no client for.

ModelProvider

interface ModelProvider

Provide AI models for requested roles, and expose data about available models.

ModelSelectionContext

data class ModelSelectionContext(val userId: String? = null, val credential: ProviderCredential? = null)

What a RoleResolver gets to decide with, beyond the role name itself.

ModelSelectionContextHolder

object ModelSelectionContextHolder

Makes the ModelSelectionContext for the current call available to model resolution without threading it through every LLM API. Applications set it at their request boundary - a servlet filter, an interceptor, or around the code that starts an agent process.

ProviderCredential

data class ProviderCredential(val provider: String, val apiKey: String)

An API key for a named provider, supplied by a user rather than by deployment configuration.

RoleResolution

sealed interface RoleResolution

What a role resolved to.

RoleResolver

fun interface RoleResolver

Decides what a role means for a given call.