ConfigurableModelProviderProperties

Upper bound on LLM services built from user-supplied keys and held for reuse.

Default embedding model name. Must be an embedding model name. Need not be set, in which case it defaults to null.

The deployment default: either an LLM name, or a role from llms or roles. It's good practice to override this in configuration.

Map of role to provider to embedding model name, for deployments whose provider is not fixed

Map of role to embedding service name. May not include the default embedding service.

Map of role to LLM name. Each entry will require an LLM to be registered with the same name. May not include the default LLM.

Map of role to provider to options, for deployments whose provider is not fixed - a bring-your-own-key application, or one configured for failover across providers.

The embedding counterpart of allWellKnownLlmNames, case for case: the flat map, the per-provider map, and default-embedding-model unless it names a role. Shorter only because an embeddingRoles entry is a model NAME where a roles entry is a whole LlmOptions.

Every LLM name this configuration mentions, across all three places one can appear: the flat llms role map, the nested roles map (one model per provider), and default-llm.

Whether defaultEmbeddingModel names a role from embeddingServices or embeddingRoles rather than a model.

Whether defaultLlm names a role from llms or roles rather than a model.

Whether CONFIGURATION declares name as an embedding role.