Module text_chunker 

Helpers for slicing strings into token-aware chunks for embeddings and documentation.

Structs

ChunkerConfig

Configuration for text chunking

TextChunk

Represents a chunk of text with metadata

Functions

chunk_text

Chunks text into overlapping segments based on token count