跳到正文
RCreddit.com·
暂不在当前实时榜单

A chunking lib in Rust that is ~20x faster [P]

AI 摘要

A new Rust-based chunking library, Chunkr, demonstrates significantly faster performance compared to existing solutions like LangChain and LlamaIndex. Benchmarks show Chunkr achieving speeds up to 3,232 MB/s for Python Code chunking and 2,264 MB/s for Recursive chunking (1 MB, 1000/200). In PDF processing, Chunkr PDFLoader is 15.9x to 16.5x faster than pypdf, and its end-to-end PDF processing with recursive splitting is 14.9x faster than pypdf with LangChain RecursiveTextSplitter.

时间与来源

时间显示为 UTC

显示时区:UTC

本地时区尚不可用,暂时显示 UTC。

收录当时偏移:UTC+02026年10月6日 00:00 UTC

收录
2026年10月6日 00:00
来源类型
开发者社区

本站未收录正文。

前往源站阅读 →
来源·reddit.com