generate
open fun generateStream(prompt: String, interaction: LlmInteraction, agentProcess: AgentProcess, action: Action?): <Error class: unknown class><String>
Generate streaming text in the context of an AgentProcess. Returns a Flux that emits text chunks as they arrive from the LLM.
Return
Flux of text chunks as they arrive from the LLM
Parameters
prompt
Prompt to generate text from
interaction
Llm options and tool callbacks to use, plus unique identifier
agent
Agent process we are running within
action
Action we are running within if we are running within an action
abstract fun generateStream(messages: List<Message>, interaction: LlmInteraction, agentProcess: AgentProcess, action: Action?): <Error class: unknown class><String>
Generate streaming text from messages in the context of an AgentProcess. Returns a Flux that emits text chunks as they arrive from the LLM.
Return
Flux of text chunks as they arrive from the LLM
Parameters
messages
messages in the conversation so far
interaction
Llm options and tool callbacks to use, plus unique identifier
agent
Agent process we are running within
action
Action we are running within if we are running within an action