Embabel Agent Documentation/com.embabel.chat/InMemoryChatbot

InMemoryChatbot

abstract class InMemoryChatbot(maxSessions: Int = 1000, evictionBatchSize: Int = maxOf(1, maxSessions / 10)) : Chatbot

Abstract implementation of Chatbot that maintains sessions in memory. This implementation is thread-safe and supports configurable maximum number of sessions. When the maximum number of sessions is reached, the oldest sessions are evicted to make room for new ones.

Parameters

maxSessions

The maximum number of concurrent chat sessions to maintain. Defaults to 1000.

evictionBatchSize

The number of sessions to evict when the limit is reached. Defaults to 10% of maxSessions.

Constructors

InMemoryChatbot

constructor(maxSessions: Int = 1000, evictionBatchSize: Int = maxOf(1, maxSessions / 10))

Functions

clearAllSessions

fun clearAllSessions()

Clears all sessions from memory.

createSession

override fun createSession(user: User?, systemMessage: String?): ChatSession

Creates a new chat session and automatically registers it with the chatbot. Subclasses must implement doCreateSession to provide their specific session implementation.

findSession

override fun findSession(conversationId: String): ChatSession?

Finds an existing chat session by its conversation ID.

getActiveConversationIds

fun getActiveConversationIds(): Set<String>

Gets all active conversation IDs.

getActiveSessionCount

fun getActiveSessionCount(): Int

Gets the current number of active sessions.

getMaxSessions

fun getMaxSessions(): Int

Gets the maximum number of sessions that can be maintained.

removeSession

fun removeSession(conversationId: String): Boolean

Removes a chat session from the chatbot.