ModelProvider

Provide AI models for requested roles, and expose data about available models.

Types

Well-known roles for models Useful but not exhaustive: users are free to define their own roles

open fun configuredOptionsForRole(role: String): <Error class: unknown class>?

What configuration says role means for this deployment, or null if it says nothing.

abstract fun getEmbeddingService(criteria: <Error class: unknown class>): <Error class: unknown class>

abstract fun getLlm(criteria: <Error class: unknown class>): LlmService<*>

abstract fun listModelNames(modelClass: Class<*>): List<String>

abstract fun listModels(): List<<Error class: unknown class>>

abstract fun listRoles(modelClass: Class<*>): List<String>

List the roles available for this class of model

open fun resolveLlmOptions(llmOptions: <Error class: unknown class>): <Error class: unknown class>

Resolve any role in these options to a concrete model, applying whatever hyperparameters are configured against that role.