CATEGORY
Text processing 4,995 crates
Data as of 2026-07-25 (crates.io database dump, timestamp 2026-07-25T02:00:36Z). Source: crates.io · db-dump.tar.gz · methodology & corrections.
mla-titlecaseMLA title casing library112MIT
mermdTerminal Markdown renderer with Mermaid flowcharts drawn as ASCII art111MIT
streamdownA streaming markdown renderer for modern terminals (Rust port of Streamdown)111MIT
mos-parseParser for the Mosaic source language (manifest §3, §6 stages 1–2).111MIT
psf2-fontPSF2 (PC Screen Font v2) parser with embedded Terminus Unicode font for no_std environments111Apache-2.0
patpubrenderParse USPTO patent grant/application XML (and Green Book APS) into a canonical document model and render compact Markdown.…111Apache-2.0
mdwright-lspLanguage Server Protocol delivery for mdwright111MIT OR Apache-2.0
use-slugComposable slug and URL-safe text primitives for RustUse.111MIT OR Apache-2.0
use-tokenComposable tokenization primitives for RustUse.111MIT OR Apache-2.0
scrybe-cliScrybe CLI — headless render/lint/mermaid/panel command-line tool111Apache-2.0
rune-tokenizeApproximate token counting, budget checking, text truncation, and overlapping chunk splitting for LLM context windows110MIT
ragA Rust library and CLI for Retrieval-Augmented Generation110Apache-2.0
fatouA language server, formatter, and linter for Julia110MIT
use-wordComposable word-level text primitives for RustUse.110MIT OR Apache-2.0
aurora-semanticLocal embedded semantic search engine for source code, designed for IDE integration109MIT
panini-lang-coreCore traits and types for the Panini linguistic feature extraction framework109MIT
bmdTerminal TUI markdown viewer with vim bindings, mermaid diagrams, and in-app document navigation109Apache-2.0
glumA reading-focused terminal markdown viewer109Apache-2.0
egui-chinese-supportCross-platform Chinese font loading for egui applications109MIT
tokenless-semanticSemantic-aware field compression: context-driven keep/drop decisions for JSON responses109Apache-2.0
cmfConversational Markdown Format - parse and convert LLM conversations108BSD-3-Clause
hoogle-syntaxHaskell syntax highlighting and tokenization for hoogle-tui108MIT
wikiextWikiext is a tool for extracting and processing Wikipedia data, implemented in Rust.108MIT
legalis-ukUnited Kingdom jurisdiction support for Legalis-RS (Employment Law, UK GDPR, Consumer Rights, Contract Law, Company Law)108Apache-2.0
flarumdownFlarum down - read Markdown!108MIT
unitokenFast BPE tokenizer/trainer with a Rust core and Python bindings108MIT
anyllm_optimize_coreFrozen-Frontier Extractive Compression: IR, edit scripts, frontier, selection, invariants (IO-free, no serde)108MIT
md2dataCLI and library for converting Markdown → JSON/YAML/TOML/XML107MIT
use-friend-markdownSimple markdown rendering helpers for Fellow Friends fixture records107MIT OR Apache-2.0
semantic-sift-coreHigh-performance Rust core for context distillation (Studio of Two)107Apache-2.0
prim-fmtThe prim formatting engine — Markdown/JSON/JSONC/YAML/TOML plus whitespace hygiene (library).107MIT
doc2quartoCLI tool to conver Docusaurus markdown files to quarto format106MIT
dhadDeterministic Arabic text canonicalization with cryptographic hashing106MIT
chinese-validatorCore validation logic for Chinese data (address,id_card, license_plate,name, phone, postal_code,qq,username,etc.)106MIT
mineru-refineMinerU output linter/fixer — LLM tool-use loop that restructures (never generates) MinerU content_list. Machine-verified…106MIT
prompting-pressPublic Rust consumer surface for Prompting Press, layered on the FFI-free kernel.106MPL-2.0
hattrieA high-performance, cache-conscious, ordered map for string keys, based on the HAT-trie paper.105MPL-2.0
use-markdownComposable Markdown text primitives for RustUse.105MIT OR Apache-2.0
rok-utilsLaravel/AdonisJS-inspired utility helpers for the Rok ecosystem105MIT
phonetics-rsIPA-based phonetic distance metrics: strict edit distance, listener-confusion distance, and per-phoneme acoustic and perceptual…105MIT
jasper-coreJoplin sync-format core: model, parser, serializer, in-memory index (no IO; portable to WASM)104MIT OR Apache-2.0
rqmdrqmd: command-line interface (binary `rqmd`)104MIT
use-text-lineComposable line-level text primitives for RustUse.104MIT OR Apache-2.0
mullamaComprehensive Rust bindings for llama.cpp with memory-safe API and advanced features103MIT
rxrayDeterministic regex worst-case complexity (ReDoS) analysis: classify a pattern as linear/polynomial/exponential under…103MIT
rustorch-textNLP utilities and datasets for RusTorch103MIT OR Apache-2.0
wikrsFast, honest wikitext extraction and parsing in Rust103MIT OR Apache-2.0
udataframe_rsA pure Rust library for data frame operations, particularly useful for processing data extracted from PDF files or OCR recognize103MIT OR Apache-2.0
cloakrs-adaptersFormat adapters for scanning text, JSON, CSV, logs, and SQL with cloakrs103MIT
ai_tokenoptAdaptive token optimization engine for LLM inference pipelines — compresses prompts, conversation history, tool schemas, and…103MIT
sastrawi-rsHigh-performance Indonesian stemmer (Nazief-Adriani + ECS). Zero-regex, FST-powered, Rust 2024.103MIT
lectito-cliCommand-line article extraction and readability tools.102MPL-2.0
cube-drone-marquee-markupMarquee, batteries included: source in, complete styled HTML page out - css, fonts, and emoji embedded, plus the `marquee` CLI102MPL-2.0
mrzZero-dependency ICAO 9303 Machine Readable Zone (MRZ) parser, emitter, and check-digit validator for TD1/TD2/TD3 and MRV-A/MRV-B…102MIT
is-truthyFlexible boolean parsing from string values with core, standard and custom truthy/falsy matching101MIT
scriniumOKF (Open Knowledge Format) CLI — create, validate, bundle and visualize Markdown knowledge graphs with a TUI editor101MIT
litedoc-coreDeterministic document parser for machine-generated output with error recovery101Apache-2.0
conpubAgent-first CLI for publishing local knowledge files to Confluence Cloud101MIT
ferrelex_coreCore runtime types for ferrelex — LexBuf, character sets, and Unicode data101LGPL-3.0-only
qplanCompile a typed query AST (qexpr) into execution-friendly plans (prime-ideal: planning).101MIT OR Apache-2.0
obfsckText obfuscation library for redacting secrets, IPs, emails, users, and hostnames from logs and alerts100MIT
libdawgA fast, memory-efficient DAWG (Directed Acyclic Word Graph) for word validation and prefix queries100MIT
fxtranslate-cliBatteries-included CLI for Firefox Translations models: discover, download/cache, and translate (stdin/pipe or interactive) —…100MPL-2.0
archelonRenamed to sapphire-journal / sapphire-journal-core. Markdown-based task and note manager that keeps your data alive as plain…100MIT OR Apache-2.0
suture-mergeDead-simple semantic merge for structured files. Merge JSON, YAML, TOML, CSV, XML, Markdown, DOCX, XLSX, PPTX, SVG, HTML,…100Apache-2.0
neco-decorPlatform-agnostic decoration data model for text editor highlight, marker, and widget ranges100MIT
wind-wikiLLM-powered Wiki SDK — Ingest, Query, and Lint pipelines100MIT OR Apache-2.0
searchlite-coreEmbedded full-text search engine: BM25, inverted index, WAL durability, aggregations100MIT
sup-xml-xsltXSLT 1.0 transformation engine built on sup-xml's XPath core100non-standard
xledsed and awk for tabular data — regex transforms over Excel-style ranges on CSV/DSV100MIT
use-textComposable text primitives for RustUse.99MIT OR Apache-2.0
docsite-to-mdA robust Rust CLI and library for exporting documentation sites to Markdown99MIT OR Apache-2.0
mdja日本語に最適化されたMarkdownパーサー - CommonMark + GFM対応、目次生成、読了時間計算99MIT OR Apache-2.0
decamelizeConvert a camelCase string to a separated lower-case string (e.g. fooBar -> foo_bar). A faithful, zero-dependency port of the…98MIT OR Apache-2.0
justpdfPure Rust PDF engine - read, render, extract, create, modify98MIT OR Apache-2.0
scivex-nlpScivex — Tokenization, embeddings, and text processing98MIT
suzuriText rendering library98MIT OR Apache-2.0
dowseWindows 本地文件内容全文搜索:PDF/Office、中文分词、图片 OCR、NTFS/USN 与只读 MCP98MIT OR Apache-2.0
nerdle-proc-macroThe macro crate for the nerdle Nerd Font macro library98MIT
crabular-cliA CLI tool for generating ASCII tables98MIT
mdx-cliA fast, beautiful terminal markdown viewer with gradient headings, syntax highlighting, and 8 themes98MIT
loran-renderLoran — Markdown to terminal renderer (text and TUI).98GPL-3.0-or-later
paddleocr_rs_onnxONNX-based OCR engine using PaddleOCR models (text detection, recognition, orientation classification)98MIT
jxoesneon-tectonicA modernized, complete, embeddable TeX/LaTeX engine.97MIT
sda-libStructured Data Algebra as a pure Rust library for validating, formatting, and transforming structured data.97GPL-3.0-or-later
ragloomThe minimalist RAG ingestion engine97Apache-2.0
lagrange-libraryA WASI-rendered Markdown static site facility — multilingual out of the box97non-standard
lindera-binding-coreShared FFI-independent helpers for the Lindera language bindings.97MIT
unimorph-cliCommand-line interface for UniMorph morphological data96Apache-2.0
lucid-lintA cognitive accessibility linter for prose. Bilingual EN/FR. CI-native.96MIT OR Apache-2.0
latentdirichletallocationA Rust implementation of Latent Dirichlet Allocation (LDA) using collapsed Gibbs sampling for topic modeling.96non-standard
fast_h2m_pyPython bindings for fast_h2m96MIT
trifleEmbedded, typo-tolerant trigram fuzzy search backed by SQLite, for large corpora of small documents.96MIT OR Apache-2.0
text-scattersA cut-up technique generator from text and ebook files in the terminal95MIT
semstoreLocal semantic search for Rust applications — store text, search by meaning, no cloud required95MIT
quarb-atrepAtrep semantic-document adapter for the Quarb query engine95MIT OR Apache-2.0
terrainA lightweight, configurable, local-first full-text search engine for Markdown knowledge bases with Japanese text support95MIT OR Apache-2.0
texformLaTeX formula parser, editor, and normalizer — the public TeXForm facade95Apache-2.0
unlocrOCR PDFs to markdown via Unlimited-OCR (DeepSeek-OCR) + llama.cpp94MIT
bgustdownHigh-performance document-to-markdown & NLP dataset engine in Rust with NAPI-RS bindings.94non-standard
lera-trigramA trigram-based regex optimization library inspired by PostgreSQL's pg_trgm94MIT
tokenfold-coreToken-aware compression for LLM payloads: shrink JSON tool-call bodies, command output, and diffs with exact tiktoken accounting…93Apache-2.0
tok3niz3r-coreCore types and on-disk schema for the tok3niz3r byte-level BPE tokenizer: token ids, vocabulary, merge table, and the GPT-2…93MIT
legalis-caCanada jurisdiction support for Legalis-RS (Charter of Rights, Federal/Provincial Law, Quebec Civil Law)93Apache-2.0
llm-output-parserProduction-grade parser for extracting structured data from LLM responses. Handles think blocks, markdown fences, malformed JSON,…93MIT
mkdA calm Markdown viewer and editor for the terminal.92MIT OR Apache-2.0
chaptrFilename tokenizer for manga, manhwa, manhua, and light novels92GPL-3.0-or-later
proserpinaMulti-agent critique and cross-examination pipeline for documents requiring intellectual rigor — provider-agnostic…92Apache-2.0
response-validatorDetect and truncate hallucinated conversation turns in LLM responses92AGPL-3.0-only
tmdpTerminal Markdown Preview — render markdown with Mermaid diagrams, math equations, and syntax highlighting in your terminal92MIT
mq-lintStatic analysis linter for mq92MIT
wordnet-lemmatizerWordNet morphological lemmatizer (the 'morphy' algorithm), ported from NLTK, with baked-in data and no_std support92Apache-2.0
code-search-pleaseHybrid code search for agents — core library (Rust rewrite of MinishLab/semble).92MIT
sngram-weightsPre-trained sparse n-gram weight tables, embedded at compile time and selectable per training-data tier via Cargo features.92MIT
kael_documentDocument lifecycle services for Kael92Apache-2.0
eregexAn advanced regular expression engine for Rust, inspired by mrab-regex92Apache-2.0
uniko-storeLayer 1: Graph storage, search, and Locy runtime for uniko91Apache-2.0
hyphaObsidian vault link graph traverser — neighborhood BFS, shortest path, and co-citation link suggestions91MIT
h2mdHTML to Markdown converter powered by a browser-grade HTML parser91MIT
papyrus-corePDF-to-Markdown conversion engine with smart heading detection, bold/italic text extraction, and CommonMark output. Pure Rust,…91MIT OR Apache-2.0
pii-vaultPresidio-compatible PII detection, anonymization, and reversible tokenization91MIT
dictx-parserDictionary source parsers for DictX.91MIT
ink-mdThe most advanced terminal markdown reader90non-standard
meta_oxideUniversal metadata extraction library supporting 13 formats (HTML Meta, Open Graph, Twitter Cards, JSON-LD, Microdata,…90MIT OR Apache-2.0
vn-nlp-tokenizeVietnamese tokenization algorithms for vn-nlp90MIT OR Apache-2.0
spdf-coreOrchestrator for the spdf pipeline.90MIT
legalis-auAustralia jurisdiction support for Legalis-RS (Commonwealth Constitution, ACL, Fair Work, Mabo)90Apache-2.0
bare-metal-tokenizerHuggingFace BPE tokenizer wrapper for bare-metal LLM inference90MIT
generative-artifact-protocolGenerative Artifact Protocol (GAP) — token-efficient artifact generation and updates for LLMs90Apache-2.0
chump-perceptionStructured perception layer for LLM agents: rule-based extraction of entities, constraints, risk indicators, ambiguity score, and…89Apache-2.0
bearingA Rust port of Apache Lucene89Apache-2.0
ocrs-cjkPure Rust, offline CJK OCR: PaddleOCR detection, hOCR/ALTO/JSON, WASM-safe.89MIT OR Apache-2.0
kiromi-ai-embed-onnxONNX/fastembed-rs embedder plugin for kiromi-ai-memory. Bundles multilingual-e5-small by default.89Apache-2.0 OR MIT
vn-nlp-normalizeVietnamese text normalization — diacritics, unicode NFC/NFD89MIT OR Apache-2.0
vn-nlp-segmentVietnamese sentence segmentation for vn-nlp89MIT OR Apache-2.0
wetext-rsText normalization library for TTS, Rust implementation of WeText89Apache-2.0
p3ak-vault-coreCore library for P3AK vault — encrypted portable AI knowledge store with hybrid BM25 + vector search89MIT
treesearchStructure-aware document search CLI. Fast keyword matching over hierarchical document trees.89Apache-2.0
g-stringStack-allocated string type with generic configurations.89MIT
rxlsNative Rust spreadsheet library: reads .xls (BIFF8/5/7), .xlsx, .xlsb, .ods and writes .xlsx. Typed cells, formulas, panic-free,…89MIT
spread-cliConverts spreadsheets and CSV files to a friendly JSON format with many field name and data-type options.88MIT
archelon-cli[DEPRECATED] CLI for archelon — use the archelon crate instead88MIT OR Apache-2.0
scrivener-mcpMCP server for Scrivener 3 projects — AI-powered writing assistant tools88MIT
mdbook-slidesAn mdbook preprocessor that renders slide presentations from markdown88GPL-3.0
talon-cliTalon CLI: hybrid retrieval over Obsidian vaults and markdown corpora, with grounded answers, MCP server, and agent-native output.88MIT
marxmlFast markdown + XML query and mutation. Rust core for the marxml ecosystem.88MIT OR Apache-2.0
course-matcherCourse matcher — pairwise course-record matching with weighted fuzzy + deterministic strategies, modelled on schema.org/Course88MIT OR Apache-2.0 OR BSD-3-Clause OR GPL-2.0-only OR GPL-3.0-only
briefliSwiss letter management CLI using Typst - create properly formatted letters for Swiss envelope windows87MIT OR Apache-2.0
parangiPDF text extraction library — Rust port of Apache PDFBox87Apache-2.0
pdfsmithA customizable PDF generation library from Markdown or structured JSON input87MIT
cognigraph-chunkerFast text chunking toolkit: fixed-size, delimiter, semantic, cognition-aware, intent-driven, topology-aware, enriched, and…87MIT
markstayReference Rust implementation of the markstay spec (v1.1, parser-free core): a source-level identity primitive for Markdown…87MIT
zed-chat-exportExport your Zed editor AI chat history to Markdown files for archiving and LLM context.86AGPL-3.0-or-later
hanzo-engineHanzo Engine - fast, flexible LLM inference engine written in Rust.86MIT
lnhashTokenización determinista — texto a Togens con detección de dominio (lenguaje natural/código/datos) e idioma.86MIT
heroindex_clientClient library for HeroIndex search server86MIT
fetchium-coreFetchium core library — search, extract, rank, validate, cache86MIT OR Apache-2.0
fast-bpe-rsFast Byte Pair Encoding (BPE) tokenizer with Python bindings powered by PyO3.86Apache-2.0
altui-textareaaltui-textarea is an altui-oriented fork of tui-textarea. It keeps the original
textarea API while adding support for altui…86MIT
a3s-deep-researchEvidence-first, domain-agnostic deep research engine for A3S86MIT
use-patternFeature-gated facade crate for RustUse pattern helpers86MIT OR Apache-2.0
hanzi-sortSort Chinese text by pinyin or stroke count, with polyphonic overrides and terminal-friendly output85AGPL-3.0-only
perl-ts-statement-trackerStatement boundary and heredoc context tracking for Perl tree-sitter tooling85MIT OR Apache-2.0
terraphim-cliCLI tool for semantic knowledge graph search with JSON output for automation85Apache-2.0
rtexNative TeX to PDF converter written in Rust with zero external LaTeX dependencies85Apache-2.0
sup-xmlModern idiomatic Rust API for SupXML85non-standard
llmwikiA local-first wiki search and indexing tool85MIT
penknifeGit-style remotes for your documents: sync a folder of markdown to GitHub Gists, track drift per file, and copy anything as rich…85MIT
detexStrip TeX/LaTeX commands from input files84BSD-3-Clause
neco-historyTree-based edit history with undo/redo and automatic checkpointing84MIT
aozora2textConvert Aozora Bunko format to plain text84MIT
bytecode-filterFast bytecode-compiled filter engine for delimiter-separated records84MIT
word_saverA minimalist CLI tool to collect words into decks84MIT
orbokorbok application binary: backend bootstrap and GUI launch84Apache-2.0
typf-os-macSingle-pass text rendering using macOS CoreText83Apache-2.0
anno-cliCLI for anno: extract entities, coreference chains, relations, and PII from text, HTML, and URLs83MIT OR Apache-2.0
fastcsvA fast SIMD parser for CSV files as defined by RFC 4180, based on simdcsv (C++)83MIT
mdi-coreLanguage-neutral parser for MDI 2.0 syntax83MIT
moinePublic Rust API for Lattice Path Edit Distance and language adapters83MIT OR Apache-2.0
sapphire-journalMarkdown-based task and note manager that keeps your data alive as plain text - timeless like fossils82MIT OR Apache-2.0
zcolorizerReal-time log file colorizer (ccze/pygments port) — fully customizable regex→token rules, swappable themes, cyberpunk by default82MIT
inputx-pinyin-data-coreEmbedded core Mandarin Pinyin dictionary (inputx-fsa Dict format) for the inputx-pinyin engine — single byte slice, zero deps,…82MIT OR Apache-2.0
markdown-rs-cliConvert Markdown to mdast JSON, and convert mdast JSON to canonical Markdown.82AGPL-3.0-or-later
anyllm_optimize_passesFFEC provider adapters (OpenAI/Anthropic JSON <-> IR), cache strategies, cost gate, heuristics82MIT
cairn-ingestArtifact loading and normalization for Cairn ingestion81MIT
engram-core-rsAI memory engine core with hybrid retrieval, salience scoring, and conflict detection81Apache-2.0
qubit-caseNaming style detection and conversion helpers for Rust applications81Apache-2.0
html-safe-mdConvert untrusted HTML to safe markdown. No remote fetches, no scripts, no tracking pixels.81MIT OR Apache-2.0
sdsforge-coreGenerate, convert, validate, and render chemical safety data sheets using MHLW/JIS Z 7253 structured JSON, with evidence and…81MIT OR Apache-2.0
zord-coreCore editing logic for Zord text editor (platform-agnostic)81MIT
greppy-cliSub-millisecond semantic code search and trace with AI reranking (Claude/Gemini/Ollama)81MIT
use-encodingFeature-gated facade crate for RustUse encoding helpers81MIT OR Apache-2.0
archelon-mcp[DEPRECATED] MCP server for archelon — use archelon mcp instead81MIT OR Apache-2.0
ghrmFast local GitHub-flavored Markdown and repository browser81GPL-3.0-only
typubUniversal publishing tool that converts Typst content to multiple platforms (Ghost, WordPress, Dev.to, Notion, etc.)80MIT
promptuneA tiny tool to auto-augment prompts programmatically80MIT
gbk2utf8CLI tool to detect and convert GBK-encoded source files to UTF-8 safely80MIT
adaptive_memoryAn associative memory system using spreading activation with SQLite FTS5 full-text search80MIT
simi-flowA production-grade similarity and text-analysis engine: 8 algorithms plus intent-aware routing for matching, dedup, spam, and bot…80MIT
inputx-pinyin-data-bigramsEmbedded bigram FSAs (inter-token + intra-token) for the inputx-pinyin engine — single byte slices, zero deps,…80MIT OR Apache-2.0