Struct ChunkerRegistry 

pub struct ChunkerRegistry {
    chunkers: HashMap<String, Arc<dyn Chunker>>,
    type_mapping: HashMap<String, String>,
    default_chunker: Option<String>,
}

Registry of chunking strategies.

Fields

chunkers: HashMap<String, Arc<dyn Chunker>>

Named chunkers

type_mapping: HashMap<String, String>

Content type to chunker name mapping

default_chunker: Option<String>

Default chunker name

Implementations

impl ChunkerRegistry

pub fn new() -> Self

Create a new empty registry.

pub fn register<C: Chunker + 'static>(&mut self, name: &str, chunker: C)

Register a chunker.

pub fn set_default(&mut self, name: &str)

Set the default chunker.

pub fn get_for_content_type( &self, content_type: &ContentType, ) -> Option<Arc<dyn Chunker>>

Get a chunker for a content type.

pub async fn chunk( &self, content: &ExtractedContent, content_type: &ContentType, config: &ChunkConfig, ) -> Result<Vec<ChunkOutput>, ChunkError>

Chunk content using appropriate strategy.

Trait Implementations

impl Default for ChunkerRegistry

fn default() -> Self

Returns the “default value” for a type.