Embabel Agent Documentation/com.embabel.common.ai.model.local/LocalModelDiscoveryProperties

LocalModelDiscoveryProperties

data class LocalModelDiscoveryProperties(var enabled: Boolean = true, var refreshInterval: Duration = Duration.ofSeconds(10), var missRefreshInterval: Duration = Duration.ofSeconds(1))

How often a local runner is re-asked what it serves.

One knob for every runner rather than one per runner: the question "how stale may this answer be" is about the operator's patience after a pull, not about which runner did the serving, and three copies of it would drift.

Constructors

constructor(enabled: Boolean = true, refreshInterval: Duration = Duration.ofSeconds(10), missRefreshInterval: Duration = Duration.ofSeconds(1))

Types

Companion

object Companion

Properties

enabled

var enabled: Boolean

Whether a locally served model may satisfy a role without having been discovered at startup.

missRefreshInterval

var missRefreshInterval: Duration

The shortest interval at which a model NOT in the cached list can force a fresh look.

refreshInterval

var refreshInterval: Duration

How long a list of served models is reused before the runner is asked again.