RCreddit.com·
Not on the current live radar
A chunking lib in Rust that is ~20x faster [P]
A new Rust-based chunking library, Chunkr, demonstrates significantly faster performance compared to existing solutions like LangChain and LlamaIndex. Benchmarks show Chunkr achieving speeds up to 3,232 MB/s for Python Code chunking and 2,264 MB/s for Recursive chunking (1 MB, 1000/200). In PDF processing, Chunkr PDFLoader is 15.9x to 16.5x faster than pypdf, and its end-to-end PDF processing with recursive splitting is 14.9x faster than pypdf with LangChain RecursiveTextSplitter.
Time & source
Times shown in UTC
Display time zone: UTC
Local time zone unavailable; showing UTC.
IngestedOffset at this time: UTC+0Oct 6, 2026, 00:00 UTC
- Ingested
- Oct 6, 2026, 00:00
- Source type
- Dev community
Full text isn't available here.
Read at source →