CATEGORY
Text processing 4,995 crates
Data as of 2026-07-25 (crates.io database dump, timestamp 2026-07-25T02:00:36Z). Source: crates.io · db-dump.tar.gz · methodology & corrections.
mdkbPersistent memory, hybrid search, and code intelligence for Claude Code and Codex — with CLI, lifecycle hooks, and MCP27MIT
mnemesMulti-device memory control plane — device/actor provenance, bitemporal lineage, semantic shard routing, idempotent operation…26Apache-2.0
llmrsUnofficial Rust SDK for IBM WatsonX AI platform26Apache-2.0
thai-number-textConvert numbers to Thai text with Baht currency, accounting style, and scientific notation support26MIT
hermes-pythonPython bindings for Hermes search engine26MIT
tpt-tokenizer-corePure-Rust BPE and WordPiece tokenizer — no_std + alloc compatible, zero dependencies.26MIT OR Apache-2.0
loust-llm-mempipeCompile noisy LLM exports (ChatGPT, Claude, Gemini) into token-efficient JSONL + Markdown for Claude Code, Projects, and agent…26Apache-2.0
minislugA tiny, dependency-free slugifier that turns any &str/String into a safe cross-platform filename26MIT OR Apache-2.0
go-brrrToken-efficient code analysis for LLMs - Rust implementation26Apache-2.0
hanconv-cliConvert between Chinese characters variants.26MIT
gullwingRuntime formatting and parsing with Python's Format Specification Mini-Language26Apache-2.0
sift-searchSift — a DSL for agents to search codebases in faster, deeper, and more sophisticated ways26MIT
figoA Rust-based ASCII art generator for documentation, RFC-style diagrams, flowcharts, tables, trees, banners, and more26Apache-2.0 OR MIT
markdown-code-runnerAutomatically update Markdown files with code block output25MIT
think-lintReasoning trace quality auditor for LLM training data25MIT
aslanParser for ASLAN markup language25MIT
foodshare-searchHigh-performance fuzzy search and text matching25MIT
surf-parseParser for the SurfDoc format — markdown superset with typed block directives25MIT
litedoc-cliCommand-line tool for parsing and validating LiteDoc documents25Apache-2.0
markmvMove markdown files while automatically rewriting all affected links25MIT
tokio-castCAST algorithm implementation for code RAG pipelines, powered by tokio-actors25MIT OR Apache-2.0
iota-parserA PEG parser combinator library for Rust. Write parsers that look like grammars.25MIT
nltk-porterNLTK's Porter stemmer ported to Rust, with the ORIGINAL / MARTIN / NLTK extension modes25Apache-2.0
rd-writerWriter serializing rd-ast documents back to Rd source text25MIT
amt-phoneticArticulatory Moment Transform — language-agnostic phonetic name matching24MIT
biblio-rsExtract footnotes from .docx files and generate bibliographies in multiple citation styles24MIT OR Apache-2.0
rtl_typepadA minimal RTL typepad GUI for Persian/Arabic text with automatic Unicode bidi isolate injection for technical tokens.24MIT OR Apache-2.0
hermes-index-cliCLI tool for building and managing Hermes search indexes24MIT
pbtreeA fast, generic piece-table text buffer backed by a balanced B+ tree24MIT
rstringA comprehensive set of string manipulation utilities inspired by Apache Commons Lang3 StringUtils24MIT
rhema_ingest_chirhoSWORD/OSIS/TEI/IMP importers and normalization into canonical corpus24GPL-2.0-or-later
words2num2-corePure-Rust core for words2num2 — parse spoken-form numbers back to numeric values across 100+ locales (the inverse of num2words2).…24LGPL-2.1-only
wikiext-cliWikiext is a tool for extracting and processing Wikipedia data, implemented in Rust.24MIT
agentic-veritas-mcpMCP server for AgenticVeritas24MIT
anselmusAbridged Notation for Scholarly Editions: Leiden Markup Utility System. (Placeholder for upcoming release)24MIT
aistackFunctional text-to-function AI utilities24Apache-2.0
rulekitTOML rule parsing, validation, linting, indexing, and merge utilities for scan patterns24MIT
narrative-engineA reusable library for procedural text generation in games24MIT
pdflyConvert PDFs to clean Markdown (and JSON/HTML/text), with chapter splitting, image extraction, and tagged-PDF output. Pure Rust,…24MIT
khmer-tokenizer-cliCommand-line Khmer word segmenter (installs the `khmer-tokenizer` binary).24MIT OR Apache-2.0
mf2_i18n_stdStd-target locale formatting backend for Unicode MessageFormat v2 (MF2).24MIT OR Apache-2.0
elizaos-plugin-local-embeddingLocal text embedding and tokenization plugin for elizaOS - Rust implementation23MIT
change-case-rsConvert strings between camelCase, snake_case, PascalCase, kebab-case, and more23MIT
flabildA fast Markov chain-based fake word generator that produces pronounceable pseudo-words23MIT
cairn-extractRule-based claim extraction from markdown with confidence scoring23MIT
unicode-interferenceUnicode script-mixing detector using forward/reverse interference patterns. Finds hidden non-Latin characters embedded in Latin…23MIT
tex2word-irtex2word intermediate representation: the front-end/back-end contract23MIT
tiktoken-streamStreaming token counter for partial LLM responses. Accumulates token count across chunks without holding the full text. Pluggable…23MIT OR Apache-2.0
elizaos-plugin-pdfelizaOS PDF Plugin - PDF reading and text extraction23MIT
shingA lightweight AI prompt template library23MIT OR Apache-2.0
llm-diffOutput diffing and versioning primitives for LLM outputs: semantic diff, version store, lineage tracking23MIT
embedsearchLightweight embeddable full-text search engine in pure Rust23MIT
rhema_accel_chirhoFPGA acceleration: packed hierarchical bit-domain engine (Chi-Rho patent)23GPL-2.0-or-later
rhema_ai_chirhoAI integration: LLM providers, embeddings, vector search, query expansion23GPL-2.0-or-later
rhema_testkit_chirhoShared test fixtures, generators, golden harnesses, differential runners23GPL-2.0-or-later
rhema_module_chirhoSelf-contained SQLite module format (.rhema) for distributing Bible modules23GPL-2.0-or-later
checkstream-proxyHigh-performance HTTP/SSE proxy server for LLM guardrails with sub-10ms latency23Apache-2.0
agentic-veritas-ffiFFI bindings for AgenticVeritas23MIT
infinite-probability-coreCore library and CLI for Infinite Probability plugin marketplace - AISP (AI Structured Protocol) conversion with Claude SDK…23MIT
re-xAI-native regex CLI — Test, validate, explain. Built for coding agents.23MIT
contextgrepGrep your documents with context — fast offline search for PDFs, DOCX, Markdown and code23MIT
strjoinHigh-performance zero-allocation string join extension for Rust iterators / 针对 Rust 迭代器的高性能零临时分配字符串拼接扩展23MulanPSL-2.0
strxA powerful string manipulation tool with JWT, hash, encoding, and crypto support23MIT OR Apache-2.0
df-ocr-switcherDocument OCR pipeline in pure Rust: scanned PDF / multi-page TIFF / image → Markdown. PaddleOCR PP-OCRv6 and Tesseract 5.5 as…23MIT
wasm-word-char-countCount word and chars in TXT/MD/PDF in the frontend very fast23MIT
paperserveSave articles from URLs as Markdown files, synced to a git repo23MIT
markplus_renderHTML and PDF renderer for the MarkPlus ecosystem (AST → HTML / Typst → PDF)23Apache-2.0
nltk-lancasterNLTK's Lancaster (Paice/Husk) stemmer ported to Rust, with prefix stripping and custom rule sets23Apache-2.0
nltk-cistemNLTK's CISTEM stemmer for German ported to Rust (stem + segment, case-insensitive option)23Apache-2.0
aozora-flavored-markdown-cliAozora Flavored Markdown (aozora-flavored-markdown): command-line interface23Apache-2.0 OR MIT
json-extractorHigh-performance two-stage JSON fragment scanner with SIMD acceleration22MIT OR Apache-2.0
transmdConvert any English PDF document into Chinese Markdown.22AGPL-3.0
acdc-coreShared set of data structures and types22MIT OR Apache-2.0
markastRust-powered markdown to HTML renderer with customizable styles22MIT
rantyThe Ranty procedural templating language22MIT
cockpitctl-renderDeterministic markdown and annotation rendering for cockpitctl reports.22MIT OR Apache-2.0
hemmerRust-powered email HTML transformation pipeline22MIT
pelagicSmall command parsing primitives for CLI tools and text interfaces.22MIT
strlingSTRling core library - Next-gen string pattern DSL & compiler for Rust22MIT
dci-toolDirect Corpus Interaction: a sandboxed, ripgrep-backed corpus-search toolset and agent for cyber-focused LLM agents, built on rig.22MIT OR Apache-2.0
privacy-filter-rsOpenAI Privacy Filter — PII detection inference in pure Rust with Burn ML22Apache-2.0
promptmlType-safe LLM prompt templates for Rust — catch missing variables at compile time22MIT OR Apache-2.0
regex-pii-rsRegex-only PII detector for emails, phones, SSNs, credit cards, and prefixed API keys. Rust port of pii-sentry. Zero deps.22MIT OR Apache-2.0
agentic-veritas-cliCLI for AgenticVeritas22MIT
grift_unicodeUnicode character operations for the Grift Scheme language22MIT OR Apache-2.0
perl-source-editingSource text editing heuristics for insertion points and display truncation22MIT OR Apache-2.0
tomllmTOML + LLM comment conventions: tribal knowledge in #comments, stripped for data pipelines22MIT
lore-enginePure Rust wiki engine — SQLite FTS5, petgraph link graph, wiki link parsing, file watching. No GUI dependencies.22MIT OR Apache-2.0
hybrid-matchHybrid string similarity22MPL-2.0
jemdoc-rsA Rust rewrite of jemdoc, a light text-based markup language for creating static websites.22Apache-2.0
hippmem-writeWrite engine for HIPPMEM — AssociationKeys generation, multi-dimensional candidate discovery, association scoring and edge…22AGPL-3.0-only
quorumragQuorum-based retrieval-augmented generation: fuse multiple retrievers and keep only the evidence they agree on.22MIT OR Apache-2.0
rjtd-modelExperimental document model and parser integration for Ichitaro JTD files.22Apache-2.0
pikchr-rsPure-Rust port of the Pikchr (PIC-like) diagram language: text -> SVG, no C / no FFI.22MIT
turbo-pdf-coreNative HTML/CSS-to-PDF engine with a Jinja-compatible templating DSL (core crate)22MIT
pdf-struct-chunkerLLM-free, layout-aware PDF chunking for RAG pipelines. Pure Rust.22MIT
mf2_i18n_embeddedEmbedded-friendly runtime support for Unicode MessageFormat v2 (MF2).22MIT OR Apache-2.0
mf2_i18n_runtimeRuntime formatting and evaluation for Unicode MessageFormat v2 (MF2).22MIT OR Apache-2.0
fibpetokenizerA blazing fast Byte Pair Encoding (BPE) tokenizer library with Python bindings21MIT OR Apache-2.0
tex2word-mathtex2word math engine: LaTeX math -> OMML (OfficeMath)21MIT
think-scrubberStateful streaming parser to scrub/extract thinking blocks in LLM completions.21Apache-2.0
mdtype-coreCore types and traits for mdtype — a type checker for Markdown.21MIT
writing-promptsWriting prompt templates for grammar practice, paraphrasing, and style improvement.21MIT
zero-width-stripStrip zero-width and bidi-control Unicode characters from text. Defends against invisible-payload prompt injection. Zero deps.21MIT OR Apache-2.0
emoji-sanitizeNormalize or strip emoji-related Unicode (presentation selectors, variation selectors, zero-width joiners) from text before LLM…21MIT OR Apache-2.0
tool-output-truncateTruncate tool output (file reads, command runs, search hits) before adding to LLM message history. Char-aware head/middle/tail…21MIT OR Apache-2.0
spache-formulacompute US grade-level readability score from sentence/word/unfamiliar-word counts21MIT
yaml-repairRepair messy YAML emitted by LLMs: strip markdown fences, tabs->spaces, dedent leading whitespace, normalize line endings.…21MIT OR Apache-2.0
toml-repairRepair messy TOML emitted by LLMs: strip markdown fences, normalize line endings, fix common quote-style slips, trim trailing…21MIT OR Apache-2.0
bm25-rerankBM25 reranker for RAG: in-memory term-frequency reranking against a small candidate set. Stateless, zero deps.21MIT OR Apache-2.0
fe2o3-highlightLightweight syntax highlighter for the Fe2O3 terminal suite — source code (18 languages), email mode, HyperList, Markdown, LaTeX,…21Unlicense
web2llm-cliCLI for fetching web pages as clean Markdown with web2llm21MIT
cmls-knowledge-cliGlobal cumulus CLI, TUI, and MCP server for local-first AI knowledge graphs21AGPL-3.0-only
jotdown-rsA minimalist, command-line jotting utility that's fast, private, and git-friendly.21MIT
text-statisticsComprehensive text statistics: word/sentence/character counts, average word and sentence length, estimated reading time, and a…21MIT
datalab-cliA powerful CLI for converting, extracting, and processing documents using the Datalab API21MIT
llm-pii-redactRegex-based PII redaction for LLM prompts and tool outputs, with reversible placeholders.21MIT
hippmem-retrievalRetrieval engine for HIPPMEM — multi-channel seed recall, spreading activation, rerank21AGPL-3.0-only
sdsconvCLI for converting chemical safety SDS documents (PDF/DOCX) ↔ MHLW/JIS Z 7253 standard JSON via LLM (Claude/GPT/Gemini). Batch…21MIT OR Apache-2.0
name-variantsMultilingual name romanization lookup tables: Chinese, Japanese, Korean, Arabic, Vietnamese, Indian, Persian, Hebrew, Thai,…21MIT
marxdownMarkdown to docx, defaulting to Shunn manuscript format21MIT OR Apache-2.0
qubit-text-codecBuffer-oriented text encoding and decoding utilities for Rust21Apache-2.0
stylometry-cliAuthorship-verification stylometry CLI: build author profiles and verify authorship with calibrated Burrows/Cosine Delta. Local,…21MIT
okpyeonKorean IME candidate data: hangul reading -> hanja candidates with hun-eum glosses (옥편), plus the MS-IME-style consonant ->…21(MIT OR Apache-2.0) AND BSD-3-Clause
upyr-corePortable English-Ukrainian layout conversion and correction engine for Upyr20MIT
hanzo-server-coreHanzo Engine - fast, flexible LLM inference engine written in Rust.20MIT
oxidocsWord-compatible .docx layout and rendering engine — parse, lay out, and render Microsoft Word documents20MPL-2.0
tokelang-cliTokelang Lite compression CLI: OptA→MEC prompt/context compression over the local engine. The single kernel binary behind the…20Apache-2.0
cranberryA versatile Rust library for Russian Cyrillic transliteration20GPL-3.0-or-later
solomd-mcpModel Context Protocol server for SoloMD vaults — exposes a Markdown notes folder to Claude Code, Codex CLI, Cursor, Cline,…20MIT
prompetaDeclarative prompt engineering with semantic roles and pluggable rendering strategies20MIT OR Apache-2.0
char-token-estTokenless byte/char-based token-count estimator for LLM prompts. Per-model-family calibration for Claude, GPT, Gemini, Llama.…20MIT OR Apache-2.0
parfillAlias for parfit — paragraph fit, a codebase-aware comment reflow tool. Installs a parfill binary with identical behaviour. See…20MIT
mlrs-coreCore RLM engine — recursive LLM inference via Rhai scripting20MIT OR Apache-2.0
german-impressum-extractorExtract structured data from German B2B website Impressum text — email, phone, address, HR-Nummer, USt-IdNr., Geschäftsführer…20MIT OR Apache-2.0
Moha_regexAn implementation of regular expressions for Rust. This implementation uses
finite automata and guarantees linear time matching…20MIT OR Apache-2.0
elizaos-plugin-knowledgeKnowledge plugin for elizaOS, providing Retrieval Augmented Generation (RAG) capabilities20MIT
postcode-validatorper-country postal code format validation20MIT
readability-statsFlesch reading-ease, Flesch-Kincaid grade level, syllable counts, and sentence/word statistics for prose — pure, zero-dependency…20MIT
typesetterStreaming Markdown rendering into styled Ratatui text20Apache-2.0
regast-syntaxLossless syntax tree for the regast regular expression engine20MIT OR Apache-2.0
pdf_to_markdownConvert a PDF into Markdown, one file per page, organized into chapter folders derived from the PDF's outline20MIT
rustdown-mdMarkdown parsing and rich-text rendering widgets for egui20MIT
vyre-stdVyre standard library: GPU DFA assembly pipeline, Aho-Corasick construction, and compositional arithmetic helpers20MIT OR Apache-2.0
stopstreamStreaming-safe stop-sequence detector for LLM token streams. Handles partial matches at chunk boundaries.20MIT OR Apache-2.0
popsam-pyPython extension crate for AI-assisted selection of semantically representative texts20MIT
json-streamparse-rsStreaming JSON balance detector: feed bytes incrementally, ask whether the buffer currently holds a complete top-level value.…20MIT OR Apache-2.0
tool-arg-fuzzyFuzzy-match LLM-generated args to JSON Schema enum values. Zero-Levenshtein cascade (exact / case-insensitive / prefix /…20MIT OR Apache-2.0
sentiment-basicSimple, deterministic positive/negative word-count sentiment scoring with built-in word lists — pure, zero-dependency, no network.20MIT
finvaderFinance-aware sentiment analysis for Rust — VADER extended with a financial lexicon, phrase rules, and catalyst detection for…20MIT
aura-redactTwo-pass secret and PII scrubber: regex patterns + Shannon-entropy detection. Drop-in for LLM logs and telemetry.20Apache-2.0
skanda_engineA zero-dependency, ultra-high-performance retrieval engine designed for the next generation of RAG.20MIT
sapphire-journal-cliMarkdown-based task and note manager that keeps your data alive as plain text - timeless like fossils20MIT OR Apache-2.0
kaijiHigh-performance CJK fuzzy search and text normalization engine20MIT OR Apache-2.0
llm-guard-mlONNX-runtime-backed scanners for llm-guard. Catches paraphrased / novel prompt-injection attacks the rules tier can't. CPU by…20MIT OR Apache-2.0
txt-cleanerA smarter text cleanup library for Rust that trims whitespace, removes BOM/zero-width chars, and cleans markdown/html artifacts.20MIT
humanize-stringConvert a camelCase / snake_case / dash-case string into a human-readable one (fooBar -> Foo bar). A faithful port of the…20MIT OR Apache-2.0
kcode-doc-extractionLocal PDF, DOCX, spreadsheet, and plain-text extraction20MIT
inputx-nihongo-wasmWASM bindings for inputx-nihongo — Japanese romaji → hiragana/katakana + on-yomi kanji + jukugo, browser/Node ready. Powers the…20MIT OR Apache-2.0
aho-corasick-rsAho-Corasick multi-pattern string matching and automaton construction20MIT
inputx-pinyin-helpersPinyin-specific stateless helpers + embedded IDFv1 dict (with prior_correction baked) + embedded NGMv1 bigram blob, for the…20MIT OR Apache-2.0
inputx-wubi-dataEmbedded Wubi 86 IDFv1 dict blob + IdfReader OnceLock + Layer-from-EntryFlags helper for the inputx-wubi engine. Pure data +…20MIT OR Apache-2.0
inputx-nihongo-data-jukugoEmbedded Japanese jukugo (熟語) IDFv1 dict blob + IdfReader OnceLock for the inputx-nihongo engine. Pure data + stateless lookup…20MIT OR Apache-2.0
fuzzy_search_liteFast fuzzy string scoring and top-k search with optional Rayon parallelism.20MIT
docrafter-layoutFlow layout engine for docrafter documents20MIT OR Apache-2.0
ukrainianUkrainian inflection and morphology. Work in progress — name reserved while the implementation is developed.20MIT OR Apache-2.0
org-elementAST types and a tree-sitter-backed parser for Org mode documents, compatible with Emacs org-element20MIT OR Apache-2.0
sacrebleu-rsA Rust port of sacrebleu: reproducible BLEU (and later chrF/TER) machine-translation metrics, score-faithful to the Python…20MIT
llm-json-extractExtract valid JSON from messy LLM outputs. Handles reasoning blocks, markdown fences, truncated payloads, and broken syntax.…20MIT OR Apache-2.0
mf2_i18n_buildReusable build and project APIs for compiling and validating Unicode MessageFormat v2 (MF2) assets.20MIT OR Apache-2.0
inpdfA CLI tool and MCP server for searching, navigating, and extracting content from PDFs.19MIT
qubit-codec-textBuffer-oriented text encoding and decoding utilities for Rust19Apache-2.0
tex2word-frontendtex2word LaTeX front-end: LaTeX -> IR19MIT
tex2word-latextex2word IR -> LaTeX writer (round-trip)19MIT
tex2word-backendtex2word OOXML back-end: IR -> .docx (fields, zip, images)19MIT
is-number-finitecoercion-aware finite-number predicate for numbers and numeric strings19MIT
prompt-part-builderBuild structured prompt parts: instruction, example, context, format, constraint19MIT
tagpipe-coreDictionary-based, explainable / auditable tagging & attribute-extraction pipeline engine with Japanese text normalization19MIT OR Apache-2.0
rune-regex-secSecurity-focused regex patterns for detecting IPs, CVEs, hashes, secrets, and PII in text19MIT
homoglyph-detectDetect Cyrillic/Greek lookalike chars masquerading as ASCII. For prompt-injection and phishing defense. Zero deps.19MIT OR Apache-2.0
rtl-flip-detectDetect right-to-left override (U+202E) and other bidi-control characters that flip rendering of strings. Used in filename-spoof…19MIT OR Apache-2.0
easi-publish-axumAxum integration for easi-publish: render Typst templates to PDF or HTML responses.19Apache-2.0
chardet-cliDetect text file encoding via chardetng (BOM-aware, single-binary Rust CLI)19Apache-2.0
bgustscraperAdvanced semantic scraping engine with AI-driven compliance checks and legal terms validation19non-standard
bom-stripStrip UTF-8/16/32 BOM bytes and stray U+FEFF code points from text before parsing or hashing. Zero deps.19MIT OR Apache-2.0
llm-message-hashStable canonical hash of LLM request/message structures. Recursive key-sorting JSON canonicalization + sha256, with per-provider…19MIT OR Apache-2.0
chaqaqRich text editor engine — inline styles, Unicode cursor/selection, undo/redo, markdown parser19MIT OR Apache-2.0
tool-secret-scrubberStrip secrets (API keys, JWTs, bearer tokens, AWS keys, etc.) from arbitrary JSON-like values before they hit your logs. Walks…19MIT OR Apache-2.0
java_regexRust implementation of Java's java.util.regex.Pattern, byte-for-byte compatible with OpenJDK19MIT OR Apache-2.0
markdown-chunkSplit Markdown into RAG-friendly chunks that respect heading hierarchy. Keeps each chunk under a soft char cap; never splits…19MIT OR Apache-2.0
rnk-styleStandalone terminal styling library - style text without the full TUI framework19MIT
trace-redactRedact sensitive fields (api keys, tokens, emails, phone numbers) from agent traces before exporting to OTel or a log sink. Zero…19MIT OR Apache-2.0
rdgnru-libA small, dependency-free utility library for Rust projects.19MIT OR Apache-2.0
pdfmuseDeterministic PDF/DOCX parser for RAG / LLMs — Rust core with Python, Node & WASM bindings. Placeholder, under construction.19MIT OR Apache-2.0
promptbudgetToken-budget-aware text truncation with multiple strategies. Bring-your-own tokenizer, no hard tiktoken dep.19MIT OR Apache-2.0
stream-chunkrecRecombine LLM streaming token deltas into stable text. Buffers partial words, handles UTF-8 fragments across chunks. Zero deps.19MIT OR Apache-2.0
prompt-inj-rsPrompt-injection risk scanner. Rust port of @mukundakatta/prompt-injection-shield. Returns a 0-1 score plus per-rule findings.…19MIT OR Apache-2.0
output-sanitize-rsStrip dangerous HTML/SQL/shell snippets from LLM output before render, query, or shell sinks. Rust port of…19MIT OR Apache-2.0
morphx-wordlistFast keyword-based wordlist generator for combinatoric password, username, and pattern expansion19MIT
hlstate-httpdWeb scrapper for Xash3D/FWGS servers, based on Rocket engine19MIT