Embabel Agent Documentation/com.embabel.agent.core.internal.streaming/StreamingLlmOperationsFactory

StreamingLlmOperationsFactory

@ApiStatus.Internal
interface StreamingLlmOperationsFactory

Factory interface for creating StreamingLlmOperations instances.

This interface is separate from com.embabel.agent.core.internal.LlmOperations to maintain interface segregation. Implementations can choose to implement both interfaces or just one, depending on their capabilities.

See also

Inheritors

Functions

Link copied to clipboard
abstract fun createStreamingOperations(options: LlmOptions): StreamingLlmOperations

Create a StreamingLlmOperations instance configured with the given options.

Link copied to clipboard
abstract fun supportsStreaming(options: LlmOptions): Boolean

Check if streaming is supported for the given LLM options.