Text processing 4,995 crates

typeline_ext_pythonpython integration for typeline1,140MITCommand line utilitiesText processing scribe-analyzerAdvanced code analysis and repository exploration library with AI-powered insights1,135MIT OR Apache-2.0Development toolsParsing tools rust_test_repo_dont_use_it_1337TODO1,134MIT OR Apache-2.0Multimedia::AudioScience simd-normalizerSIMD-accelerated Unicode normalization (NFC, NFD, NFKC, NFKD)1,132Apache-2.0No standard libraryText processing llm-extract-deriveDerive macro for llm-extract Extract trait1,131MIT OR Apache-2.0Parsing toolsText processing apple-notes-exporterA library and CLI tool for exporting Apple Notes to Markdown1,128MITCommand line utilitiesText processing postingsInverted-index postings lists and codecs.1,127MIT OR Apache-2.0AlgorithmsText processing mdbook-frontmatter-stripmdBook preprocessor that strips YAML frontmatter from chapters1,126Apache-2.0Command line utilitiesText processing papermakeFast PDF generation library using Typst with a virtual file system for templates, images, and fonts1,125Apache-2.0RenderingTemplate engine docling-asrAudio/ASR pipeline for docling.rs (Whisper via ONNX; a Rust port of docling's ASR pipeline).1,124MITParser implementationsText processing interbA high-performance, thread-safe string interner backed by a concurrent bump allocator.1,123MIT OR Apache-2.0Data structuresMemory management asimov-host-moduleASIMOV module for information about the current host.1,122UnlicenseCommand line utilitiesConfiguration syntect-5-no-panictemporary fork of Syntect1,120MITParser implementationsParsing tools asimov-clock-moduleASIMOV module for the current date and time.1,119UnlicenseCommand line utilitiesDate and time mdwright-latexTeX math-body parsing, Unicode layout, and source translation for mdwright1,119MIT OR Apache-2.0Command line utilitiesText processing typeline_ext_sqlitesqlite integration for typeline1,117MITCommand line utilitiesText processing kenlm-rsRust bindings for KenLM language model inference1,115LGPL-3.0-or-laterAPI bindingsScience libfseFused Semantic Execution: fail-closed policy engine with O(1)-in-rule-count scanning, zero-allocation hot path, and guaranteed…1,115MITAlgorithmsData structures typeline_ext_csvcsv parsing and serialization for typeline1,115MITCommand line utilitiesText processing rust-md2htmlA simple Rust CLI to convert Markdown to HTML with file watching1,115MIT OR Apache-2.0Command line utilitiesText processing caseifyA CLI tool to convert strings between different cases1,115MIT OR Apache-2.0Command-line interfaceCommand line utilities panache-parserLossless CST parser and syntax wrappers for Pandoc markdown, Quarto, and RMarkdown1,114MITParser implementationsParsing tools siftdb-coreHigh-performance grep-native database for code and text collections with regex support1,112MITCommand line utilitiesDatabase interfaces fartdownAn experimental semantic markup language and static site generator for crafting hypertext documents1,112AGPL-3.0-onlyCommand line utilitiesCompilers oxi-hashlineLine-anchored patch format for AI-assisted code editing1,111MITDevelopment toolsText processing pipe-cliA simple command line tool to pipe data between commands1,107MITCommand line utilitiesText processing typeline_ext_httphttp(s) tooling for typeline1,107MITCommand line utilitiesText processing aozora-proptestProptest strategies (Aozora-shaped input generators) for the aozora parser. Internal crate; reach it via the aozora crate's…1,107Apache-2.0 OR MITLocalization (L10n)Parser implementations emoji_converterConverts text to emojis1,101MITText processing rragHigh-performance Rust framework for Retrieval-Augmented Generation with pluggable components, async-first design, and…1,101MITAPI bindingsAsynchronous InscribeA markdown preprocessor that executes code fences and embeds their output.1,099MITCommand line utilitiesParsing tools fracturedjsonRust port of FracturedJsonJs: human-friendly JSON formatter with optional comment support.1,095MITCommand line utilitiesEncoding llm-extractExtract structured data from LLM responses — fence strip, JSON repair, fuzzy repair, typed deserialization1,093MIT OR Apache-2.0Parsing toolsText processing suffixsort[DEPRECATED — renamed to `invlex`] Library for inverse lexicographic sorting1,088MIT OR Apache-2.0AlgorithmsText processing dirdocsGenerate terse, one-sentence documentation for files; plus Nushell-style directory viewers (dls, dtree) that surface .dirdocs.nu…1,088CC-BY-SA-4.0Command line utilitiesDevelopment tools badwords-rsAn implementation of filtering based on badwords (https://github.com/hughsie/badwords).1,088MIT AND LGPL-2.1-or-laterText processing shifterA CLI tool to rotate lines from stdin by n positions1,081MITCommand line utilitiesText processing viterbi_pos_taggerA part-of-speech (POS) tagger using the Viterbi algorithm.1,081GPL-3.0-or-laterText processing sffSemanticFileFinder (sff): Fast semantic file finder using sentence embeddings. Searches .txt, .md, .mdx files.1,080MIT OR Apache-2.0Command line utilitiesText processing chordsketch-coreChordPro parser, AST, and transforms1,076MITParser implementationsText processing yosinaJapanese text transliteration library1,075MITInternationalization (i18n)Text processing blockletA cross-platform CLI tool that generates ASCII art using Unicode block characters, similar to figlet but with beautiful solid…1,074non-standardCommand line utilitiesText processing perl-builtins-phfPHF-backed Perl builtin signature tables for O(1) lookup1,073MIT OR Apache-2.0Development toolsText processing compact_stringCompact representation of UTF-8 Strings that are immutable and less than 256 bytes in length.1,072Apache-2.0CachingEncoding hwpforge-smithy-hwpxHWPX format codec (encoder + decoder) for HwpForge1,070MIT OR Apache-2.0EncodingInternationalization (i18n) ripvec-mcpMCP + LSP server for ripvec — semantic code search, PageRank repo maps, and multi-language code intelligence1,069MIT OR Apache-2.0Development toolsText processing lex-extensionPublic surface for Lex extensions: handler trait, wire types, schema types1,067MITText processing codetypo-cliSource Code Spelling Correction1,066MIT OR Apache-2.0Development toolsText processing harfruzzA complete harfbuzz shaping algorithm port to Rust.1,065MITText processing pdf_oxide_mcpMCP server for PDF extraction — gives Claude, Cursor, and AI assistants the ability to read PDFs locally. Text, markdown, and…1,062MIT OR Apache-2.0Command line utilitiesText processing ssort[DEPRECATED — renamed to `invlex-cli`, binary `invlex`] CLI tool for inverse lexicographic sorting1,054MIT OR Apache-2.0AlgorithmsCommand line utilities bbpeBinary byte pair encoding (BPE) trainer and CLI compatible with Hugging Face tokenizers1,052Apache-2.0EncodingText processing mandarin-to-pinyinA Rust crate for converting Mandarin Chinese to Pinyin.1,051MITLocalization (L10n)Text processing cow-rewriteRewrite copy-on-write types copying only when it's neccessary1,049MITData structuresText processing sakurs-coreHigh-performance sentence boundary detection using Delta-Stack Monoid algorithm1,047MITAlgorithmsParser implementations cli_app_capoA Rust CLI application with Unix-like tools.1,043MIT OR Apache-2.0Command line utilitiesText processing breadchunksHeading-aware, token-budgeted semantic chunker for Markdown — for RAG and embedding pipelines.1,043MITText processing asimov-file-moduleASIMOV module for file system access.1,042UnlicenseCommand line utilitiesText processing pobuilderBuild or modify translation catalogs in PO format.1,041MITInternationalization (i18n)Text processing aprender-shellAI-powered shell completion trained on your history1,041MITCommand line utilitiesText processing sview-fmindexFM-index library with slice view architecture for efficient text indexing and pattern matching1,036MITAlgorithmsData structures diaryx_coreCore library for Diaryx - a tool to manage markdown files with YAML frontmatter1,034non-standardText processing perl-builtinsBuiltin symbol metadata for Perl parser and LSP tooling1,032MIT OR Apache-2.0Development toolsText processing perl-quotePerl quote-like operator parsing helpers1,028MIT OR Apache-2.0Parsing toolsText processing text_to_emojiConvert text to emoji1,023MITText processing grok2A rust implementation of the popular java & ruby grok library which allows easy text and log file processing with composable…1,021Apache-2.0Text processing mq-dapDebug Adapter Protocol implementation for mq1,018MITCommand line utilitiesText processing doclingDocumentConverter and format backends for docling.rs (a Rust port of docling).1,018MITParser implementationsText processing shimmyjinjaMinimal Jinja-like engine for Hugging Face chat_template strings1,018MITTemplate engineText processing string-simpleA library containing some simple string utilities that I use in my other projects.1,017non-standardAlgorithmsText processing memvid-ask-modelLLM inference module for Memvid Q&A with local and cloud model support1,017Apache-2.0ScienceText processing asimov-nexus-moduleASIMOV module for knowledge import powered by the ASIMOV.Nexus intelligence platform.1,016UnlicenseAPI bindingsCommand line utilities heart-stringsQuickly get random heart emojis to copy!1,013UnlicenseCommand line utilitiesText processing json-fixRobust JSON repair engine for fixing malformed or partial JSON strings, especially from AI output1,013MITData structuresParsing tools sqz-engineAdaptive multi-pass LLM context compression engine — content-aware pipeline with AST parsing, token counting, session…1,011non-standardCommand line utilitiesText processing lex-extension-hostRuntime for the Lex extension system: registry, transports, trust gate, sandboxing1,005MITText processing realhydroper-utf16Work with UTF-16 in Rust1,004Apache-2.0EncodingText processing cli_app_capo15A Rust CLI application with Unix-like tools.999MIT OR Apache-2.0Command line utilitiesText processing asposepdfAspose.PDF for Rust via C++ is a powerful toolkit that allows developers to manipulate PDF files directly and helps do various…999MITAPI bindingsEncoding jsonpositionFinds a path to a JSON element at a provided string index998MITAlgorithmsText processing fortune-rsA Rust implementation of the classic BSD fortune program997MITCommand line utilitiesGames nyx-scannerA multi-language static analysis tool for detecting security vulnerabilities995GPL-3.0-or-laterCommand line utilitiesDevelopment tools perl-heredocHeredoc collector and processor for Perl — handles multi-line heredoc syntax including indentation stripping and CRLF…994MIT OR Apache-2.0Parsing toolsText processing perl-tokenizerToken stream and utilities for Perl parser994MIT OR Apache-2.0Parsing toolsText processing asimov-ftp-moduleASIMOV module for FTP/FTPS protocol support.991UnlicenseCommand line utilitiesText processing sentencepiece-rustFrom-scratch pure-Rust SentencePiece inference (encode/decode), differentially verified against the upstream C++/Python…990Apache-2.0Text processing rfc9839-rsA rust implementation of RFC9839 to test for problematic Unicode code points981MIT OR Apache-2.0Text processing sealex-apiSealex API (sealex-api) is a web service that exposes a REST API that provides services related to the lexicons of SouthEast…980Unlicense OR MITScienceText processing rsnum2persianA Rust library for converting numbers to their Persian representation.977MITLocalization (L10n)Text processing gitdVisualizes the differences between the current HEAD and a specified branch in a git repository using a formatted table output in…973Unlicense OR MITCommand line utilitiesText processing awful_knowledge_synthesizerGenerate LLM-powered exam questions from YAML books, manpages, mdbooks, tealdeer pages, and code.972CC-BY-SA-4.0Command line utilitiesDevelopment tools chordsketch-irealiReal Pro AST types and a zero-dep JSON debug serializer / parser970MITParser implementationsText processing mq-lspLanguage Server Protocol implementation for mq query language970MITCommand line utilitiesText processing chinese-telegraphConvert Unicode Chinese characters to Chinese telegraph codes (中文電碼)969MIT OR Apache-2.0EncodingNo standard library ironmarkFast Markdown to HTML parser written in Rust with WebAssembly bindings967MITParsing toolsText processing jpostaA fast and intuitive Terminal User Interface (TUI) tool for searching Japanese postal codes and addresses965MITCommand line utilitiesText processing auk_markdownMarkdown support for Auk.964MITTemplate engineText processing form-of-wordplayA Rust crate for representing and working with various forms of wordplay.963MIT OR Apache-2.0Data structuresText processing c2pa-textReference implementation for embedding C2PA manifests in text using Unicode variation selectors962MITEncodingText processing form-of-joke-humorA Rust crate for representing and working with various forms of jokes and humor.960MIT OR Apache-2.0Data structuresText processing ai-context-genA context generator for Rust repositories that creates structured markdown files with relevant information for LLMs and AI agents958MITCommand line utilitiesDevelopment tools templatiaA template library writedown and load the struct957MIT or Apache-2.0Parser implementationsParsing tools x12-delimitersLow-level handling of X12 EDI delimiters.955MIT OR Apache-2.0Parsing toolsText processing mdast2minimadA crate for converting markdown AST to minimad texts953MITText processing m2hConvert Markdown to HTML with syntax highlighting.951MITCommand line utilitiesText processing textfsm-macrosCompile-time template validation macros for TextFSM951MIT OR Apache-2.0Development tools::Procedural macro helpersParsing tools asimov-ipfs-moduleASIMOV module for IPFS protocol support.944UnlicenseCommand line utilitiesText processing ewts-cConverter from EWTS (Extended Wylie Transliteration Scheme) to Tibetan Unicode symbols (c lib)943MIT OR Apache-2.0EncodingInternationalization (i18n) localgptLocalGPT CLI — a local-only AI assistant943Apache-2.0Command line utilitiesText processing moeixSub-millisecond code search via sparse trigram indexing.938MITCommand line utilitiesDevelopment tools enpsrlibEnglish Phrase Structure Rules library938MITScienceText processing anno-coreCore types and invariants for anno: entities, spans, confidence scores, coreference chains938MIT OR Apache-2.0Text processing docspec-pandoc-native-writerStreaming Pandoc native (block-list) writer for DocSpec events937MITText processing name-and-titleA Rust library for representing personal names with optional titles, middle names/initials, and convenience macros.926MITText processing hwpforge-smithy-mdMarkdown codec (decoder + lossy/lossless encoder) for HwpForge922MIT OR Apache-2.0EncodingInternationalization (i18n) syndiffStandalone library that implements a structural diff algorithm inspired by Difftastic918MITAlgorithmsDevelopment tools reg_matchA match style regex tool.916non-standardText processing chordsketch-render-irealiReal Pro chart renderer (SVG skeleton)915MIT AND OFL-1.1RenderingText processing patchloomStructured file editing library and CLI for AI agents: parser-backed JSON/YAML/TOML edits, AST-aware code operations, multi-file…915MIT OR Apache-2.0Command line utilitiesConfiguration webfontsA Rust library for working with web fonts914MITText processingWeb programming oxidoc-highlightLightweight syntax highlighting for documentation engines914MIT OR Apache-2.0Text processingWebAssembly xml_magicA reasonably fast XML formatter.913MITCommand line utilitiesDevelopment tools chatpackPrepare chat data for RAG / LLM ingestion. Supports Telegram, WhatsApp, Instagram, Discord.913MITParsing toolsText processing qsv-calamineAn Excel/OpenDocument Spreadsheets reader and deserializer in pure rust903MITEncodingParsing tools okh-scraperA scraper of Open Source Hardware (OSH) projects. based on the Open Know-How (OKH) standard.902AGPL-3.0-or-laterCommand line utilitiesText processing esedEasy sed899MITCommand line utilitiesDevelopment tools kowalski-web-agentKowalski Web Agent: A Rust-based agent for interacting with Ollama models898MITNetwork programmingScience byteforgeA next-generation byte-level transformer with multi-signal patching and SIMD optimization897MITAlgorithmsScience addbibAn app to add linked bibliographies to markdown files.894EUPL-1.2Command line utilitiesText processing kowalski-federationKowalski Federation: A Rust-based agent for interacting with Ollama models890MITNetwork programmingScience yeehaw_tuiBatteries Included Text Based Application Framework888Apache-2.0Command-line interfaceCommand line utilities gaze-recognizersBuilt-in recognizers for Gaze888Apache-2.0 OR MITText processing typelineEfficient, Type-Safe Pipeline Processor887MITCommand line utilitiesText processing retrofontRetro terminal font toolkit: TDF/FIGlet parsing, rendering, conversion.884MIT OR Apache-2.0Command line utilitiesParser implementations kowalski-code-agentKowalski Code Agent: A Rust-based agent for interacting with Ollama models879MITNetwork programmingScience betlangTiny source-language detection for code.878MITDevelopment toolsText processing tess-cliA less-style terminal pager for files, pipes, and live logs — with structured-log filtering, pretty-printing…877MITCommand line utilitiesText processing kowalski-academic-agentKowalski Academic Agent: A Rust-based agent for interacting with Ollama models876MITNetwork programmingScience htmlfixinatorA composable HTML transformation library with filters for cleaning, modifying, and standardizing HTML content875LGPL-3.0-onlyText processingWeb programming async-regexEmpower regex with streaming capabilities - high-performance async streaming pattern search using regex for multi-byte pattern…875MITAsynchronousParsing tools ndg-commonmarkFlavored CommonMark processor for Nix-related projects, with support for CommonMark, GFM, and Nixpkgs extensions.874MPL-2.0Text processing phoneticsPhonetic algorithms for encoding and comparing strings.869MITAlgorithmsText processing webpage_quality_analyzerHigh-performance webpage quality analyzer with 115 comprehensive metrics - Rust library with WASM, C++, and Python bindings866MIT OR Apache-2.0Development toolsText processing gourdstdA rust standard library extension providing utility functions for various types, inspired by javascript and others858MITNo standard libraryText processing crate-startercrate starter857MITDevelopment toolsText processing reedyA terminal-based RSS reader with a clean TUI interface856MITCommand line utilitiesText processing tessera-embeddingsMulti-paradigm embedding library: ColBERT, dense, sparse, vision-language, and time series models855Apache-2.0ScienceText processing textfsm-rustTemplate-based state machine for parsing semi-formatted text based on Google's TextFSM855MIT OR Apache-2.0Network programmingParsing tools thread-utilitiesA collection of utilities for working with Thread. Includes fast hashers, SIMD operations, and more.853AGPL-3.0-or-laterAlgorithmsData structures tiny-cleanA lightweight, high-performance string sanitizer with configurable rules.850Apache-2.0AlgorithmsDevelopment tools markdown-ai-cite-removeHigh-performance removal of AI-generated citations and annotations from Markdown text848MIT OR Apache-2.0Command line utilitiesParsing tools prefrontalA blazing fast text classifier for real-time agent routing, built in Rust847Apache-2.0AlgorithmsParsing tools bracket-parserA Rust library that detects if positions in text are inside or outside brackets846MITParsing toolsText processing mdvTerminal Markdown Viewer846MITCommand line utilitiesText processing mecab-ko-hangul한글 처리 유틸리티 - 자모 분리/결합, 음절 처리, 정규화844MIT OR Apache-2.0Internationalization (i18n)Text processing kowalski-data-agentKowalski Date Agent: A Rust-based agent for interacting with Ollama models843MITNetwork programmingScience sakurs-cliCommand-line interface for Sakurs sentence boundary detection843MITCommand line utilitiesText processing cargo-reedmeGenerate README.md from doc comments in lib.rs837MIT OR Apache-2.0Command-line interfaceDevelopment tools triedA fast, compact double-array trie with `no_std` + `alloc` support. Fork of [yada](https://crates.io/crates/yada) providing…836Apache-2.0AlgorithmsData structures panache-formatterCore formatting engine for Pandoc markdown, Quarto, and RMarkdown836MITText processing mia-deriveA model inference framework.834MIT OR Apache-2.0ScienceText processing sigye-fontsASCII art fonts for sigye clock app827MITCommand line utilitiesText processing fast_whitespace_collapseCollapse consecutive spaces and tabs into a single space using SIMD826MITText processing revelo-parsers-textText and subtitle parsers for revelo (SubRip, WebVTT, TTML, teletext, ...).824BSD-2-ClauseParser implementationsParsing tools gaze-piiReversible PII pseudonymization runtime for agentic workflows824Apache-2.0 OR MITCryptographyText processing mdkitGet markdown out of any document — Pandoc + pdfium + platform-native OCR, dispatched per format.823MIT OR Apache-2.0FilesystemParser implementations asimov-signal-moduleASIMOV module for importing Signal chats.817UnlicenseCommand line utilitiesText processing fea-rs-astfontTools-like AST wrapper around fea-rs parser817Apache-2.0 OR MITParser implementationsText processing toml-collapseA simple cli application for merging TOML files with duplicate keys816non-standardCommand line utilitiesParsing tools libpgfmtA Rust library for formatting PostgreSQL SQL and PL/pgSQL816BSD-3-ClauseDevelopment toolsText processing haqumeiHaqumei is a Japanese Grapheme-to-Phoneme (G2P) library implemented in Rust.815Apache-2.0Parsing toolsText processing mdbook-qrAn mdBook preprocessor that generates a QR code using fast_qr.813MITText processingWeb programming mctextMinecraft text formatting, parsing, and rendering812MITGame developmentRendering webots-proto-templateTemplate evaluation for Webots PROTO documents.807MITCompilersScience::Robotics epcmanagerEPC text tool for RFID806Apache-2.0CompressionEncoding colligoBlazing-fast locale-aware Unicode collation, specialized to the context-free majority of human languages803(MIT OR Apache-2.0) AND Unicode-3.0Command line utilitiesInternationalization (i18n) gfrA blazingly-fast, Rust tool for finding patterns in code, inspired by 'gf'.799MITCommand line utilitiesDevelopment tools scribe-webserviceWeb service interface for Scribe repository analysis799MIT OR Apache-2.0Development toolsParsing tools sais_drumAn implementation of the SAIS algorithm for suffix array construction797MIT OR Apache-2.0AlgorithmsData structures tokieBlazingly fast tokenizer - 50x faster tokenization, 10x smaller model files, 100% accurate drop-in replacement for HuggingFace797MIT OR Apache-2.0ScienceText processing pdfluent-lopdfA Rust library for PDF document manipulation.796MITText processing anda_brain🧠 Anda Brain (大脑) — Autonomous Graph Memory for AI Agents796Apache-2.0AccessibilityDevelopment tools finetype-coreCore taxonomy and data generation for FineType792MITScienceText processing thread-ast-engineCore AST engine for Thread - parsing, matching, and transforming code using AST patterns. Forked from ast-grep-core.786AGPL-3.0-or-later AND MITArtificial intelligenceCommand line utilities pdf-converterA simple and efficient library for converting images (JPG, PNG, GIF, BMP, WebP) to PDF documents. Commercial use permitted under…780MIT OR Apache-2.0Multimedia::ImagesText processing wn-parserSimple Rust parser for WordNet database files778MITText processing srt2txtConvert SRT subtitle files into clean plain text (strip timestamps, tags, merge lines)777non-standardCommand line utilitiesText processing bunpoLightweight Japanese conjugation reversal (deinflection) system775MITInternationalization (i18n)Text processing hwpforgeProgrammatic control of Korean HWP/HWPX documents — read, write, and convert Hancom 한글 files774MIT OR Apache-2.0EncodingInternationalization (i18n) cliuxStyled terminal output made simple — boxes, sections, dividers, and emoji-aware padding for CLI tools.773MITCommand-line interfaceText processing irohatypeIrohaType — Japanese typing TUI. Practice common Japanese words with a focused terminal UI.772MITCommand line utilitiesGames tui-syntaxTree-sitter based syntax highlighting for TUI applications772MITCommand-line interfaceText processing bytepunch-rsProfile-aware semantic compression for structured documents (CML and beyond)771MITCompressionEncoding no-crlfA CLI tool to convert CRLF line endings to LF in text files770non-standardCommand line utilitiesText processing ip-extractHigh-performance IP address extraction and tagging engine770Unlicense OR MITNetwork programmingText processing html2typstConvert HTML files to Typst syntax768MITParser implementationsParsing tools molioA library for reading chemical file formats766BSD-3-ClauseParser implementationsScience rsstoConvert RSS feeds into multiple formats763MITCommand line utilitiesParsing tools dwg-coreDeterministic Writing Guard core analysis engine for spotting AI-styled prose.762MITText processing asimov-account-cliASIMOV Account Command-Line Interface (CLI)760UnlicenseText processing