Rag Options
data class RagOptions constructor(val similarityThreshold: <Error class: unknown class> = 0.7, val topK: Int = 8, val compressionConfig: CompressionConfig = CompressionConfig(), val llm: <Error class: unknown class> = LlmOptions.withAutoLlm(), val labels: Set<String> = emptySet(), val ragResponseFormatter: RagResponseFormatter = SimpleRagResponseFormatter, val service: String? = null, val listener: RagEventListener = RagEventListener.NOOP) : RagRequestRefinement
Operations for RAG use as an LLM tool. Options are immutable and stable.
Parameters
similarity Threshold
minimum similarity threshold for results (0.0 to 1.0)
top K
maximum number of results to return
labels
optional set of labels to filter results. If not set all entities may be returned. If set, only the given entities will be searched for.
rag Response Formatter
formatter to convert RagResponse to String
service
optional name of the RAG service to use. If null, the default service will be used.
Constructors
Link copied to clipboard
constructor(similarityThreshold: <Error class: unknown class> = 0.7, topK: Int = 8, compressionConfig: CompressionConfig = CompressionConfig(), llm: <Error class: unknown class> = LlmOptions.withAutoLlm(), labels: Set<String> = emptySet(), ragResponseFormatter: RagResponseFormatter = SimpleRagResponseFormatter, service: String? = null, listener: RagEventListener = RagEventListener.NOOP)