Module code

Module code 

Source
Expand description

Code-aware chunking strategy.

Chunks code at function/class/method boundaries using pattern matching. Supports Rust, Python, JavaScript, TypeScript, Go, Java, and C/C++.

StructsΒ§

CodeBoundary πŸ”’
A code boundary (start of a function/class/method).
CodeChunker
Code-aware chunker that splits at function/class boundaries.

EnumsΒ§

BoundaryKind πŸ”’
Language πŸ”’
Supported programming languages.

FunctionsΒ§

calculate_byte_range πŸ”’
Calculate byte range for a line range.
chunk_by_lines πŸ”’
Chunk by lines when no code boundaries are found.
create_chunks_from_boundaries πŸ”’
Create chunks from detected boundaries.
detect_boundary πŸ”’
Detect if a line starts a code boundary.
detect_c_boundary πŸ”’
Detect C/C++ code boundaries.
detect_go_boundary πŸ”’
Detect Go code boundaries.
detect_java_boundary πŸ”’
Detect Java code boundaries.
detect_js_boundary πŸ”’
Detect JavaScript/TypeScript code boundaries.
detect_python_boundary πŸ”’
Detect Python code boundaries.
detect_rust_boundary πŸ”’
Detect Rust code boundaries.
extract_after_keyword πŸ”’
extract_c_fn_name πŸ”’
extract_const_fn_name πŸ”’
extract_go_fn_name πŸ”’
extract_go_method_name πŸ”’
extract_java_method_name πŸ”’
extract_js_fn_name πŸ”’
extract_python_fn_name πŸ”’
extract_rust_fn_name πŸ”’
find_code_boundaries πŸ”’
Find code boundaries (functions, classes, etc.) in source code.
split_large_chunk πŸ”’
Split a chunk that’s too large.