Embabel Agent Documentation/com.embabel.agent.rag.ingestion/ContentChunker

ContentChunker

class ContentChunker(val config: ContentChunker.Config = DefaultConfig())

Converts MaterializedContainerSection objects into Chunk objects with intelligent text splitting.

For container sections with small total content (aggregated from leaves), creates a single chunk containing all leaf content. For large leaf sections within containers, splits them individually into multiple chunks.

Constructors

ContentChunker

constructor(config: ContentChunker.Config = DefaultConfig())

Types

Config

interface Config

DefaultConfig

data class DefaultConfig constructor(val maxChunkSize: Int = 1500, val overlapSize: Int = 200) : ContentChunker.Config

Configuration for the splitter

Properties

config

val config: ContentChunker.Config

Functions

chunk

fun chunk(section: MaterializedContainerSection): List<Chunk>

Split a MaterializedContainerSection into one or more Chunks

splitSections

fun splitSections(sections: List<MaterializedContainerSection>): List<Chunk>

Split multiple MaterializedContainerSections into Chunks