Package-level declarations

Types

Link copied to clipboard
data class DualShotConfig(val summaryWords: Int = 100)
Link copied to clipboard

Expose a RagService as tools. Once the tools instance is created, options such as similarity cutoff are immutable and will be used consistently in all calls. The LLM needs to provide only the search query.

Link copied to clipboard
data class RagOptions constructor(val ragService: RagService, val similarityThreshold: <Error class: unknown class> = 0.7, val topK: Int = 8, val hyDE: HyDE? = null, val desiredMaxLatency: Duration = Duration.ofMillis(5000), val compressionConfig: CompressionConfig = CompressionConfig(), val llm: <Error class: unknown class> = LlmOptions.withAutoLlm(), val contentElementSearch: ContentElementSearch = ContentElementSearch.CHUNKS_ONLY, val entitySearch: EntitySearch? = null, val ragResponseFormatter: RagResponseFormatter = SimpleRagResponseFormatter, val dualShot: DualShotConfig? = null) : RagRequestRefinement<RagOptions>

Operations for RAG use as an LLM tool. Options are immutable and stable.

Link copied to clipboard
class RagReference(val name: String, val description: String, val options: RagOptions, summarizerPromptRunner: PromptRunner) : LlmReference

Expose a RagService as an LlmReference with tools.

Link copied to clipboard

Expose a RagService as tools. Once the tools instance is created, options such as similarity cutoff are immutable and will be used consistently in all calls. The LLM needs to provide only the search query.