Package-level declarations
Types
Link copied to clipboard
Link copied to clipboard
class DualShotRagServiceSearchTools(val ragService: RagService, val options: RagOptions, val summarizer: RagResponseSummarizer)
Expose a RagService as tools. Once the tools instance is created, options such as similarity cutoff are immutable and will be used consistently in all calls. The LLM needs to provide only the search query.
Link copied to clipboard
data class RagOptions constructor(val similarityThreshold: <Error class: unknown class> = 0.7, val topK: Int = 8, val hyDE: HyDE? = null, val desiredMaxLatency: Duration = Duration.ofMillis(5000), val compressionConfig: CompressionConfig = CompressionConfig(), val llm: <Error class: unknown class> = LlmOptions.withAutoLlm(), val contentElementSearch: ContentElementSearch = ContentElementSearch.CHUNKS_ONLY, val entitySearch: EntitySearch? = null, val ragResponseFormatter: RagResponseFormatter = SimpleRagResponseFormatter, val service: String? = null, val listener: RagEventListener = RagEventListener.NOOP, val dualShot: DualShotConfig? = null) : RagRequestRefinement<RagOptions>
Operations for RAG use as an LLM tool. Options are immutable and stable.
Link copied to clipboard
Expose a RagService as tools. Once the tools instance is created, options such as similarity cutoff are immutable and will be used consistently in all calls. The LLM needs to provide only the search query.