StreamingLlmOperationsFactory

@ApiStatus.Internal
interface StreamingLlmOperationsFactory

Factory interface for creating StreamingLlmOperations instances.

This interface is separate from com.embabel.agent.core.internal.LlmOperations to maintain interface segregation. Implementations can choose to implement both interfaces or just one, depending on their capabilities.

See also

Inheritors

Functions

Link copied to clipboard
abstract fun createStreamingOperations(options: <Error class: unknown class>): StreamingLlmOperations

Create a StreamingLlmOperations instance configured with the given options.

Link copied to clipboard
abstract fun supportsStreaming(options: <Error class: unknown class>): Boolean

Check if streaming is supported for the given LLM options.