Text processing 4,995 crates

cerberustFast Rust guardrails for LLM input/output — composable scanners (PII, secrets, prompt-injection) and streaming middleware.494MIT OR Apache-2.0Text processing copybook-lexerCOBOL copybook lexical analysis and tokenization primitives.493AGPL-3.0-or-laterParsing toolsText processing prosesmasher-domain-typesInternal domain types crate for the prosesmasher workspace. Published to support the workspace dependency graph.491MITDevelopment toolsText processing spoor-coreDeterministic, embeddable document parsing engine for LLM-friendly output490MITParser implementationsText processing ucm-engineTransformation engine for the Unified Content Model489MITText processing anda_hippocampus🧠 Anda Hippocampus (海马体) — Autonomous Graph Memory for AI Agents489Apache-2.0AccessibilityDevelopment tools tiptap-rusty-parserFast schema-agnostic parser and manipulator for Tiptap/ProseMirror JSONContent documents488MITParsing toolsText processing owl2shaclA CLI tool that tries to convert simple OWL ontologies into SHACL shapes. OWL ontologies define logical relationships. …487AGPL-3.0-or-laterCommand line utilitiesFilesystem anno-evalEvaluation harnesses, datasets, and muxer-backed sampling for anno487MIT OR Apache-2.0Text processing nodedb-ftsShared full-text search engine for NodeDB — inverted index, BM25 scoring, analyzers, fuzzy matching486Apache-2.0AlgorithmsText processing unimorph-coreCore library for UniMorph morphological data483Apache-2.0ScienceText processing rtb-redactFree-form secret redaction for log lines, telemetry events, and diagnostic surfaces. Part of the phpboyscout Rust toolkit.482MITDevelopment toolsText processing asimov-qdrant-moduleASIMOV module for indexing knowledge using the Qdrant vector database.480UnlicenseCommand line utilitiesText processing triblespace-searchContent-addressed BM25 + HNSW indexes on top of triblespace piles.479MIT OR Apache-2.0Data structuresText processing oxifont-webfontPure Rust WOFF1/WOFF2 decoder for OxiFont (oxiarc-deflate + oxiarc-brotli)479Apache-2.0EncodingText processing zenbase-llmlLightweight Language Markup Language - converts data structures to XML-like markup478MITParsing toolsText processing semantic-memoryLocal-first hybrid semantic search (SQLite + FTS5 + usearch 2.25) with bitemporal truth and typed receipts477Apache-2.0Data structuresDatabase interfaces herolib-webWeb utilities for herolib - HTML/Markdown processing and web scraping477Apache-2.0Text processingWeb programming lopdf-parangA fork of lopdf optimized for PDF text extraction — lazy streams, O(1) object slicing, zlib-rs.477MITText processing md-tmplLightweight template engine for .tmpl.md prompt files with typed frontmatter477Apache-2.0 OR MITTemplate engineText processing turbo-html2pdf-coreNative HTML/CSS-to-PDF engine with a Jinja-compatible templating DSL (core crate)477MITTemplate engineText processing readmdictA Rust implementation for reading MDict dictionary files (.mdx format)476MITParsing toolsText processing justpdf-corePure Rust PDF engine — parsing, writing, compression, text extraction, encryption, digital signatures476MIT OR Apache-2.0Parser implementationsText processing burgertocow-libReverse-engineers a diff on a rendered minijinja template back into template-level and variable-level changes via shadow…475MITDevelopment toolsTemplate engine rucora-coreCore abstractions and types for the rucora LLM agent framework474MITAPI bindingsAsynchronous laurusUnified search library for lexical, vector, and semantic retrieval473MITText processing langidentify-models-lite-bLite embedded model data (part B: other scripts) for the langidentify language detection library471Apache-2.0Internationalization (i18n)Text processing rutleRob's Universal Text Layout Engine: a rendering-agnostic structured editor and layout core for tdoc::Document471MITGUIRendering langidentify-models-lite-aLite embedded model data (part A: European Latin) for the langidentify language detection library469Apache-2.0Internationalization (i18n)Text processing stringfyBrazilian-focused string manipulation library with CPF/CNPJ validation and formatting467MIT OR Apache-2.0Localization (L10n)Text processing unifast-coreHigh-performance Markdown/MDX compiler466MITParsing toolsText processing asimov-imessage-moduleASIMOV module for importing iMessage chats.462UnlicenseCommand line utilitiesText processing ja-furigana-cliCLI and HTTP server for ja-furigana — Japanese ruby annotation. Installs the `furigana` binary.461MITInternationalization (i18n)Text processing ripsed-jsonAgent/JSON interface for ripsed — request/response schema, auto-detection461MIT OR Apache-2.0Command line utilitiesText processing markdown-org-extractCLI utility for extracting tasks from markdown files with Emacs Org-mode support461MITCommand line utilitiesText processing ripsed-fsFile system layer for ripsed — discovery, reading, atomic writes461MIT OR Apache-2.0Command line utilitiesText processing typst-batchTypst helper library for batch processing — friendly API, shared resources, virtual files, customizable diagnostics460MITCompilersText processing usfm3Error-tolerant USFM 3.x parser with USJ, USX, and USFM output460MITParser implementationsText processing dongler-coreRust-native PDF and document extraction core for Markdown, LaTeX, and JSON output.458MITParser implementationsText processing asimov-snapshot-cliASIMOV Snapshot Command-Line Interface (CLI)456UnlicenseCommand line utilitiesText processing obadgenGenerates (aka "bakes") basic Open Badge annotated images (lib & CLI-tool).456AGPL-3.0-or-laterCommand line utilitiesMultimedia::Images fontheight-cliFind out the vertical extents your font reaches on shaped words455Apache-2.0Text processingVisualization mentions-hashtagsExtracts @mentions and #hashtags from text (like social media descriptions). Built in safe, fast, idiomatic Rust using regex.454MITParsing toolsText processing mudssky_utilsA comprehensive Rust utility library providing common functionality for everyday programming tasks454MITAlgorithmsData structures mdvault-coreCore library for mdvault - markdown vault management453MITCommand line utilitiesText processing semtree-coreCore types for semtree: Language, Span, Node, Chunk452MITDevelopment toolsText processing ferroniPure-Rust Oniguruma regex engine with SIMD-accelerated search451BSD-2-ClauseParsing toolsText processing lexime-trieA char-wise Double-Array Trie with zero dependencies451MITData structuresText processing yamcYet Another Markdown Converter - A fast and feature-rich markdown to HTML and PDF converter450MIT OR Apache-2.0Command line utilitiesText processing dmc-diagnosticShared diagnostic codes and source metadata for the dmc MDX compiler450MITCompilersParser implementations lssg-char-readerA simple streaming character reader useful for parsing450MITParser implementationsText processing prosesmasher-ports-outbound-traitsInternal outbound port traits crate for the prosesmasher workspace. Published to support the workspace dependency graph.449MITDevelopment toolsText processing md-forgeA blazingly fast, lightweight Markdown to HTML converter built entirely in Rust446MITCommand line utilitiesParser implementations tokmatStandalone high-performance Canadian address parsing engine core446MITParser implementationsText processing suscCompiler for the SUS Hardware Design Language439GPL-3.0-or-laterCompilersText processing sansaccentConvertit les chaînes françaises en slugs URL-friendly en supprimant accents et caractères spéciaux439MIT OR Apache-2.0Text processing varnaVarna — multilingual language engine: phoneme inventories, G2P rules, scripts, grammar, and lexicon for 50+ languages439GPL-3.0-onlyScienceText processing japanese-codepointsA high-performance Rust library for Japanese character validation and code point handling based on JIS standards438MIT OR Apache-2.0Internationalization (i18n)Text processing dioxus-mdxMDX parsing and rendering components for Dioxus438MITParsing toolsText processing chafA CLI filter tool that removes lines based on logical conditions using AND, OR, NOT, and parentheses.438MIT OR Apache-2.0Command line utilitiesText processing lexepubHigh-performance streaming EPUB parser and extractor for Rust, WASM, and C/C++.436Apache-2.0Parser implementationsText processing num2words2-coreNumber-to-words conversion for 120+ languages (Rust port of num2words). 42 -> forty-two.436MIT OR Apache-2.0Internationalization (i18n)Text processing flash_rerankCore reranking engine — cross-encoder and ColBERT inference via ONNX Runtime435AGPL-3.0-or-laterAlgorithmsScience yekdastA utility library for normalizing and cleaning up Persian (Farsi) text.435MITText processing nixdocParser for Nixdoc documentation comments433MPL-2.0Parsing toolsText processing pdf_semanticSemantic PDF layout model construction for document comparison and diffing.433MITText processing trie_hard_rsFast, memory-efficient Trie (prefix tree) implementation with autocomplete support - Rust implementation432MIT OR Apache-2.0AlgorithmsData structures tateStructured diff, patch algebra, and sheaf-pushout merge for tree-shaped data430MITDevelopment toolsText processing text-document-cliCLI for text-document429MPL-2.0Data structuresParsing tools json-carverDigital forensics tool that reads (carves) JSON strings from a dump. Think of it as a more accurate and faster replacement for…428MIT OR Apache-2.0Command line utilitiesText processing par-term-fontsFont management and text shaping for par-term terminal emulator428MITText processing enderecobr_rsEsta biblioteca tem por objetivo prover de funções utilizadas para padronizar endereços brasileiros, afim de facilitar…427MITScience::GeospatialText processing mdriverStreaming markdown printer for the terminal with syntax highlighting426MITCommand line utilitiesText processing bit-parallel-searchBlazing fast string search using bit-parallel algorithms - up to 8x faster than naive search426MIT OR Apache-2.0AlgorithmsNo standard library blazegraph-ioParse PDFs into semantic document graphs with bounding boxes. Built for GraphRAG.426MIT OR Apache-2.0Command line utilitiesText processing zpl_toolchain_cliCommand-line interface for parsing, validating, formatting, and printing ZPL II label code (part of the zpl-toolchain project)424MIT OR Apache-2.0Command line utilitiesText processing triplets-coreCore types, traits, and algorithms for the triplets data pipeline framework.423MIT OR Apache-2.0AlgorithmsArtificial intelligence namesakeA CLI tool and library to generate names by combining words.422MITCommand line utilitiesText processing pdfluent-extractPDF content extraction: images, text with positions, and full-text search422non-standardParser implementationsText processing polymathyTurn search results into answers - a web service that fetches, chunks, and returns semantic content from search queries421GPL-3.0-onlyText processingWeb programming::HTTP server cjclassifierClassify ideograph text as Chinese Simplified, Chinese Traditional, or Japanese using a statistical model421Apache-2.0Internationalization (i18n)Text processing anno-metricsShared evaluation/analysis primitives for anno (metrics + cluster encoders)421MIT OR Apache-2.0ScienceText processing zettel-clicli app for Luhmann-style Zettelkasten management420MITCommand line utilitiesText processing terminal_toolsPower-Terminal TUI - fuzzy file and text finder, process manager, git browser, and more418MITCommand line utilitiesDevelopment tools tiktokenxA high-performance Rust implementation of OpenAI's tiktoken library418MITAlgorithmsText processing yuru-coreCore fuzzy matching and ranking library for Yuru418MIT OR Apache-2.0Text processing promptrsA framework for building composable agentic workflows417LGPL-3.0Development toolsParsing tools smart-formatComposable, zero-allocation Display formatting combinators for Rust.417MIT/Apache-2.0Rust patternsText processing langidentify-models-liteLite embedded model data for the langidentify language detection library416Apache-2.0Internationalization (i18n)Text processing satchA high-performance Rust implementation of picomatch/micromatch pattern matching412MITCommand line utilitiesFilesystem py-import-helperOrganize Python imports automatically - sorts and groups them according to PEP 8, perfect for code generation projects412MITDevelopment toolsParser implementations ducaSearch and read Dante's Divine Comedy from your terminal412MITCommand line utilitiesText processing windancerAn org-mode toolkit, including parser, renderer.410GPL-3.0Parser implementationsParsing tools dmc-lexerMDX, JSX, and GFM tokenizer for the dmc compiler410MITCompilersParser implementations mecab-ko한국어 형태소 분석기 - MeCab-Ko의 순수 Rust 구현410MIT OR Apache-2.0ScienceText processing promptyPrompty is an asset class and format for LLM prompts410MITDevelopment toolsText processing ucl-parserParser for the Unified Content Language (UCL)409MITParsing toolsText processing archelon-coreRenamed to sapphire-journal / sapphire-journal-core. Markdown-based task and note manager that keeps your data alive as plain…408MIT OR Apache-2.0Data structuresFilesystem siSI and IEC prefixes406Apache-2.0 OR MITMathematicsNo standard library::No dynamic allocation ranked-searcherSearch inside text files using tf-idf formula, showing the most relevant search at the top406MITCommand line utilitiesText processing argus-redact-corePII detection and redaction primitives — pure Rust core406Apache-2.0Text processing undocxDOCX to Markdown converter written in Rust406MITCommand line utilitiesParser implementations oxipdf-shapingText shaping and font provider for the oxipdf PDF engine405MIT OR Apache-2.0RenderingText processing llm-json-repairClean and parse JSON emitted by LLMs. Strips markdown fences, trailing commas, and surrounding prose so serde_json::from_str…405MIT OR Apache-2.0Parsing toolsText processing vectorize-rsFast local text embeddings for Rust400Apache-2.0ScienceText processing spoor-cliCLI adapter for the spoor document parsing engine399MITCommand line utilitiesText processing fusefilesConcatenate a directory full of files into a single prompt for use with LLMs398Apache-2.0Command line utilitiesText processing html2text-cliRender HTML as plain text.398MITText processing sanitize-piiDetect and mask personally identifiable information (PII) in strings397MITText processing iword-rsHigh-speed keyword search — Rust implementation of iWord397MITAlgorithmsText processing sql_docsA crate for parsing comments from sql files and using them for documentation generation394GPL-3.0Database interfacesDevelopment tools bpe-matchA pattern matching library for BPE tokenization, intended to replace regex-based approaches.393MIT OR Apache-2.0Text processing chunkshop-rsStandalone ingest-to-pgvector: source -> chunker -> embedder -> extractor -> table. int8 BGE by default; bakeoff matrix evaluator…392MITDatabase interfacesScience carta-astDocument model (AST) and its JSON serialization.391AGPL-3.0-onlyData structuresText processing docxide-templateType-safe .docx template engine — generate Rust structs from Word templates with {placeholder} patterns391MITTemplate engineText processing superbook-pdfHigh-quality PDF converter for scanned books with AI enhancement, deskew correction, and Japanese OCR390AGPL-3.0Command line utilitiesMultimedia::Images rustyclaw-coreCore library for RustyClaw — config, gateway protocol, secrets, tools, and shared types390MITDevelopment toolsText processing jtool-grepnotebook-specific grep tool for jtool390MIT OR Apache-2.0Command line utilitiesText processing trumpSpawn a background thread that prints a Donald Trump quote every 10 seconds.389MITCommand line utilitiesText processing symbi-invis-stripStrip invisible / steganographic Unicode code points from strings before they reach a knowledge store, a journal, or a prompt.388Apache-2.0Text processing tale-ndjsonA tail-compatible tool for pretty-printing ndjson files, especially logs.388Parity-7.0.0Command line utilitiesText processing mq-docsDocumentation generator for mq functions and macros387MITCommand line utilitiesText processing geoff-contentMarkdown parsing, TOML frontmatter extraction, and triple generation for Geoff386MITParsing toolsText processing nltk-metricsRust port of NLTK's metrics: string distance metrics and inter-annotator agreement coefficients386Apache-2.0AlgorithmsText processing flowmarkA Markdown auto-formatter for clean diffs and semantic line breaks384MITCommand line utilitiesText processing heyiwei何意味384MITCommand line utilitiesText processing bamboo-coreVietnamese input method engine written in Rust384MITText processing mnem-embed-providersEmbedding-provider adapters for mnem (OpenAI, Ollama). Sync, TLS-via-rustls, tokio-free.383Apache-2.0API bindingsText processing format_manyExtended format_many! macro which allows formatting with variable number of argument inside one macro call383MITTemplate engineText processing llmprogramA Rust library that provides a structured and powerful way to create and run programs that use Large Language Models (LLMs). It…382MITScienceText processing avocado-coreCore engine for AvocadoDB - deterministic context compilation for AI agents381MITDatabase interfacesText processing decollCommand-line interface for blazing-fast locale-aware sorting using decollate380MITCommand line utilitiesText processing ratel-ai-coreTool and skill retrieval for AI agents — selectable BM25, dense (semantic), or hybrid search over catalogs. Core of the Ratel…380Apache-2.0AlgorithmsText processing carta-coreShared conversion options, error types, and text/attribute helpers.378AGPL-3.0-onlyText processing rhema_contracts_chirhoShared type-level contracts, newtypes, DTOs, and trait definitions for the Rhema Chirho engine378GPL-2.0-or-laterText processing lexirLexical scoring over postings lists.377MIT OR Apache-2.0AlgorithmsText processing bolivar-corePDF content extraction library377MITParser implementationsText processing oxifont-discoveryPure Rust OS font-directory discovery for OxiFont376Apache-2.0FilesystemText processing slack-markdown-converterA Rust library for converting standard Markdown to Slack mrkdwn format.375MITText processingWeb programming webtools-coreShared primitives: compression, token budgeting, and reference-style URLs375MITText processingWeb programming mdbook-exercisesAn mdBook preprocessor for interactive exercises with hints, solutions, and test execution375MIT OR Apache-2.0Command line utilitiesDevelopment tools ah-ah-ahVUN token! TWO tokens! Count all the beautiful tokens ... offline! Ah-ah-ah!374Apache-2.0 OR MITAlgorithmsText processing markdowndownA Rust library for acquiring markdown from URLs with smart handling372MITText processingWeb programming vecgrepSemantic grep — like ripgrep, but with vector search370MITCommand line utilitiesText processing pulldown-cmark-to-flowedConvert Markdown to Plain Text with format=flowed369EUPL-1.2EmailText processing checkstream-coreCore types, token buffer, and error handling for CheckStream guardrail platform369Apache-2.0AsynchronousText processing langidentifyFast, high-accuracy language detection for Rust. Uses ngram classification augmented with a topwords signal for improved…367Apache-2.0Internationalization (i18n)Text processing oxipdf-layoutSpatial layout engine for the oxipdf PDF engine366MIT OR Apache-2.0RenderingText processing mdrA lightweight Markdown viewer with live reload and multiple rendering backends366MITCommand line utilitiesText processing hwarangFast HWP document text extractor366MITParser implementationsText processing tiny-grepA simple grep-like text search utility written in Rust366MITCommand line utilitiesText processing cognee-utilsShared utilities — deterministic IDs, hashing, and config helpers — for the cognee pipeline.366MIT OR Apache-2.0Database interfacesScience jag-textText layout and editing utilities for jag365MITRenderingText processing kevy-textDictionary-free full-text search core: CJK bigram tokenizer, inverted segments, BM25 scoring.365Apache-2.0 OR MITDatabase implementationsText processing miku_best_friend_printerContains a MikuPrinter that can produce an ASCII art of Miku - your best friend - from the music video 'Monitoring (Best Friend…364MITTemplate engineText processing dm2xcodDOCX to Markdown converter written in Rust360MITCommand line utilitiesParser implementations rushdown-metaMeta(YAML frontmatter) extension for rushdown markdown parser360MITText processing deobfuscateMulti-pass text deobfuscation and encoding-evasion detector for LLM security pipelines.359MITEncodingText processing rtranslateA simple, dependency-free Rust wrapper for Google Translate public web API357MITAPI bindingsText processing diff_coreSemantic PDF comparison engine for matching document blocks and reporting meaningful changes.357MITText processing oxifont-adapter-purePure Rust FontDatabase adapter for OxiFont (composes discovery + parser)357Apache-2.0Text processing lreRust bindings for the regular expression library from QuickJS356MITText processing widest-lineFind the widest line in a string with proper Unicode and ANSI escape code support355MIT OR Apache-2.0Command line utilitiesText processing diff_reportStable JSON, Markdown, HTML, and AI-review reports for semantic PDF comparison.355MITText processing mq-mcpMarkdown Query - MCP server implementation355MITCommand line utilitiesText processing webshiftDenoised web search library — fetch, clean, and rerank web content for AI agents.354MITText processingWeb programming dmc-parserTyped AST parser for the dmc MDX compiler353MITCompilersParser implementations langmailEmail preprocessing for LLMs353MIT OR Apache-2.0EmailText processing bytediffA bytearray diff353MITAlgorithmsCompression cold-stringA 1-word SSO string that saves up to 24 bytes over String.352MIT OR Apache-2.0EncodingMemory management mdbook-tikzmdBook preprocessor that renders TikZ and tikzcd diagrams to inline SVG351MITCommand line utilitiesText processing atheneumAgent coordination graph database - episodic and semantic memory for multi-agent workflows351GPL-3.0-onlyData structuresDatabase implementations imekitA cross-platform Rust library for IME (Input Method Engine) integration using native protocols350MIT OR Apache-2.0GUIOperating systems dtxt-detectRust library for dangerous text detection, optimized for high speeds.350MITParsing toolsText processing pdf-rsA PDF parsing library written in Rust349Apache-2.0EncodingParsing tools laurus-servergRPC server for the Laurus search engine349MITText processing zer-compareFellegi-Sunter field comparison, similarity functions, and EM scoring for zer348Apache-2.0AlgorithmsText processing spdf-typesCore types for the spdf workspace: TextItem, ParsedPage, ParseResult, ParseConfig.347MITCommand line utilitiesParser implementations mq-testTest runner for mq345MITCommand line utilitiesText processing jc-adfPure markdown <-> Atlassian Document Format (ADF) converter. Lossless via an `adf:<type>` fenced-block escape hatch.344MITParsing toolsText processing regex_ansiANSI escape sequence regular expression (Rust port of ansi-regex behavior)344MITParsing toolsText processing onde-mistralrs-metal-compileFast, flexible LLM inference.343MITAPI bindingsScience carta-writersOutput-format writers: render the document model to a target format's text.340AGPL-3.0-onlyText processing ix-embeddingsShared embedding infrastructure for Ixchel with pluggable providers339MITDevelopment toolsText processing md-tmpl-coreCore template engine for md-tmpl — parsing, compilation, and rendering339Apache-2.0 OR MITTemplate engineText processing semtree-embedEmbedding trait and backends (fastembed, openai)338MITDevelopment toolsText processing ascfixAutomatic ASCII diagram repair tool for Markdown files337MITCommand line utilitiesText processing casefoldCompact Unicode simple case-folding via a paged bitmap + run-length encoding (≈1 KB table).336MITCompressionInternationalization (i18n) mdvsA database of markdown documents — schema validation and semantic search336MITCommand line utilitiesText processing fastgrepFast parallel grep with SIMD-accelerated search and trigram indexing334MIT OR Apache-2.0Command line utilitiesText processing syntaxfmtA derive macro-based library for flexible syntax tree formatting with pretty printing support.334MIT OR Apache-2.0Development toolsText processing carta-readersInput-format readers: parse a source format's text into the document model.334AGPL-3.0-onlyParser implementationsText processing harfshapedfaGlue functionality between skrifa & harfrust332Apache-2.0Text processing emoji-removerA fast command-line tool to remove emojis from source code files331MITCommand line utilitiesDevelopment tools qjA fast, jq-compatible JSON processor powered by simdjson331MITCommand line utilitiesText processing mdbook-termlinkmdBook preprocessor that auto-links glossary terms throughout documentation331MITCommand line utilitiesText processing leakguardFast, zero-dependency redaction of secrets and PII (emails, credit cards, IPs, JWTs, API keys, and more) from text and logs.328MIT OR Apache-2.0Command line utilitiesText processing atomr-agents-ingestDocument loaders, text splitters, and CachedEmbedder for atomr-agents.328Apache-2.0AsynchronousText processing kotoba-formatterKotoba Code Formatter - Formats .kotoba files with consistent style327MIT OR Apache-2.0Development toolsText processing oxifontPure Rust font discovery + parsing (OxiFont facade crate)327Apache-2.0GraphicsText processing