Embabel Agent Documentation/com.embabel.common.ai.model.local/LocalModelCatalog

LocalModelCatalog

class LocalModelCatalog(source: LocalModelSource, discovery: LocalModelDiscoveryProperties, ticker: () -> Long = System::nanoTime) : LateArrivingModels

What a LocalModelSource is serving, cached for long enough that asking is not an HTTP round trip per embedding.

Shared by LocalModelRoleResolver and LocalModelEmbeddingRoleResolver rather than held by each, because the two answer from ONE runner and a runner asked twice per call is the cost this class exists to avoid. They are separate classes only because RoleResolver.resolve and EmbeddingRoleResolver.resolve take the same arguments and return different types, so one class cannot implement both.

Elapsed time here is System.nanoTime, not a clock: this measures how long ago the runner was asked, which must survive an NTP step mid-interval. ticker is a parameter so a test can drive the interval rather than sit through it.

Parameters

source

the runner to ask

discovery

how stale an answer may be

ticker

monotonic nanosecond source; override only in tests

Constructors

LocalModelCatalog

constructor(source: LocalModelSource, discovery: LocalModelDiscoveryProperties, ticker: () -> Long = System::nanoTime)

Properties

lateArrivingProvider

open override val lateArrivingProvider: String?

Declared HERE rather than on the resolvers, because this is the object that knows whether a model can arrive late at all.

val provider: String

Provider name of the runner behind this catalog.

Functions

fun embeddingNamed(model: String): EmbeddingService?

An embedding service for model if the runner is serving it AS an embedding model.

embeddingService

fun embeddingService(model: String): EmbeddingService?

An embedding service for model, built once and then reused, on the same terms.

fun llmNamed(model: String): LlmService<*>?

A chat service for model if the runner is serving it AS a chat model, or null.

fun llmService(model: String): LlmService<*>?

A chat service for model, built once and then reused.

fun servedNames(kind: LocalModelKind): Set<String>

Everything the runner is serving of this kind, for the platform's model listings.

fun serves(model: String): Boolean

Whether the runner is serving model as far as this catalog can currently tell.