ModelProvider

Provide AI models for requested roles, and expose data about available models.

Types

Well-known roles for models Useful but not exhaustive: users are free to define their own roles

What configuration says role means for this deployment, or null if it says nothing.

abstract fun listModelNames(modelClass: Class<*>): List<String>

abstract fun listRoles(modelClass: Class<*>): List<String>

List the roles available for this class of model

Resolve any role in these options to a concrete model, applying whatever hyperparameters are configured against that role.