OpenAiCompatibleModelFactory

open class OpenAiCompatibleModelFactory(val baseUrl: String?, apiKey: String?, completionsPath: String?, embeddingsPath: String?, observationRegistry: <Error class: unknown class>)

Generic support for OpenAI compatible models. Use to register LLM beans.

Parameters

baseUrl

The base URL of the OpenAI API. Null for OpenAI default.

apiKey

The API key for the OpenAI compatible provider, or null for no authentication.

Inheritors

Constructors

Link copied to clipboard
constructor(baseUrl: String?, apiKey: String?, completionsPath: String?, embeddingsPath: String?, observationRegistry: <Error class: unknown class>)

Properties

Link copied to clipboard

Functions

Link copied to clipboard
fun openAiCompatibleEmbeddingService(model: String, provider: String): <Error class: unknown class>
Link copied to clipboard
fun openAiCompatibleLlm(model: String, pricingModel: <Error class: unknown class>, provider: String, knowledgeCutoffDate: LocalDate?, optionsConverter: <Error class: unknown class><out <Error class: unknown class>> = OpenAiChatOptionsConverter, retryTemplate: <Error class: unknown class> = RetryUtils.DEFAULT_RETRY_TEMPLATE): <Error class: unknown class>