stream

abstract fun stream(messages: List<Message>, tools: List<Tool>, toolCallInspectors: List<ToolCallInspector>): <Error class: unknown class><String>

Stream raw content chunks from the LLM.

The returned Flux emits content as it arrives from the LLM. Tool calls are handled internally by the underlying framework.

Return

Flux of raw content chunks

Parameters

messages

The conversation history

tools

Available tools for the LLM to invoke during streaming

toolCallInspectors

Inspectors to observe tool call events