Text processing 4,995 crates

chisel-jsonSimple JSON parser for Rust46,735MIT OR Apache-2.0Parser implementationsText processing jpreprocess-coreJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).46,612BSD-3-ClauseText processing widewordFast word-length bucketing for text documents using SIMD46,296MITAlgorithmsText processing trafilaturaExtract readable content, comments, and metadata from web pages46,196Apache-2.0Parser implementationsText processing pidginsimple non-recursive grammars46,135MITParsing toolsText processing jpreprocessJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).45,964BSD-3-ClauseText processing asimov-cliASIMOV Command-Line Interface (CLI)45,726UnlicenseCommand line utilitiesText processing yozuk-sdkTypes used in the Yozuk ecosystem45,514MITText processing aartyMini-framework to display pictures on your terminal45,330MITCommand line utilitiesMultimedia eddieFast and well-tested implementations of edit distance/string similarity metrics: Levenshtein, Damerau-Levenshtein, Hamming, Jaro,…45,314MITAlgorithmsText processing jpreprocess-dictionaryJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).45,191BSD-3-ClauseText processing rantThe Rant procedural templating language44,997MIT OR Apache-2.0Game developmentTemplate engine zalgo-codec-commonConvert an ASCII text string into a single unicode grapheme cluster and back.44,897MIT OR Apache-2.0EncodingText processing jpreprocess-windowJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).44,838BSD-3-ClauseText processing jpreprocess-njdJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).43,653BSD-3-ClauseText processing zhconvTraditional, Simplified and regional Chinese variants converter powered by MediaWiki & OpenCC rulesets and the Aho-Corasick…43,248GPL-2.0-or-laterCommand line utilitiesLocalization (L10n) kitokenFast tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization42,784BSD-2-ClauseAlgorithmsNo standard library jpreprocess-jpcommonJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).42,657BSD-3-ClauseText processing keep-a-changelogRust library for generating and manipulating CHANGELOG.md files that use the Keep A Changelog format.42,613MITDevelopment toolsText processing txtaiRust client for txtai42,582Apache-2.0AlgorithmsAPI bindings azure-speechPure Rust SDK for Azure Speech Service42,244MITMultimediaMultimedia::Audio text-to-pngA simple way to render text to a png image with basic options42,088MIT OR Apache-2.0EncodingGame development cognitive-services-speech-sdk-rsRust bindings for Microsoft Speech SDK.41,996MIT OR Apache-2.0MultimediaMultimedia::Audio srgnA grep-like tool which understands source code syntax and allows for manipulation in addition to search41,616MITCommand line utilitiesDevelopment tools basic-textBasic Text strings and I/O streams41,577Apache-2.0 WITH LLVM-exception OR Apache-2.0 OR MITOperating systemsText processing chisel-decodersChisel UTF-8 and ASCII byte stream decoder implementations41,384MIT OR Apache-2.0EncodingText processing str_overlapMethods for finding the overlap between two string slices.41,185MIT OR Apache-2.0AlgorithmsNo standard library rsonpath-libBlazing fast JSONPath query engine powered by SIMD. Core library of `rsonpath`.41,081MITText processing jpreprocess-naist-jdicJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).41,066BSD-3-ClauseText processing amadeus-coreHarmonious distributed data analysis in Rust.40,881Apache-2.0ConcurrencyDatabase interfaces flexarAn extremely flexible lexer/parser (get it?) for writing your own programming language40,876MIT OR Apache-2.0Parsing toolsText processing zalgo-codec-macroProvides the zalgo_embed! macro for compiling source code that's been converted into a single grapheme cluster by the…40,842MIT OR Apache-2.0EncodingText processing simple-string-patternsMakes it easier to match, split and extract strings in Rust without regular expressions. The parallel string-patterns crate…40,616MITParsing toolsText processing oxidize-pdfPure Rust PDF library for AI/RAG: structure-aware chunking with bounding boxes, heading context, and token estimates. No Python,…40,359MITEncodingGraphics pandoc_typesRust port of pandoc-types40,160Apache-2.0Text processing text-tablesA terminal/text table prettifier with no dependencies40,052MIT/Apache-2.0Command line utilitiesText processing cmark-writerA CommonMark writer implementation in Rust for serializing AST nodes to CommonMark format39,785MITText processing kbnfA fast constrained decoding engine based on context free grammar.39,461MIT OR Apache-2.0ScienceText processing kreuzberg-tesseractRust bindings for Tesseract OCR with cross-compilation, C++17, and caching improvements39,425MITComputer visionExternal FFI bindings aki-xcatconcatenate files that are plain, gzip, xz and zstd.39,230MIT OR Apache-2.0Command line utilitiesText processing kas-textText layout and font management39,227Apache-2.0Text processing simplematchFast wildcard pattern matching for strings and bytes with a simple api39,177Apache-2.0 OR MITAlgorithmsNo standard library tstTernary search trie collection in rust with similar API to std::collections as it possible38,728MITData structuresText processing allsorts-azulAzul's fork of the allsorts font parser / shaping engine / subsetter. Adds pixel-snap hinting fixes, slimmer direct dependencies…38,689Apache-2.0Text processing text2numParse and convert numbers written in English, Dutch, Spanish, Portuguese, German, Italian or French into their digit…38,654MITText processing to-binaryConverts From Hex, UTF-8, Vector of Bytes, or a Byte Slice to a Binary String And Implements Many Useful Functions For Binary…38,626MIT OR Apache-2.0Data structuresEncoding chat-gpt-lib-rsA Rust library for interacting with OpenAI's ChatGPT API, providing a simple interface to make API requests and handle responses.38,336Apache-2.0API bindingsText processing file-chunkerEfficiently process a file in (approximately) equally-sized parts37,801MITFilesystemText processing aki-xteecopy standard input to each files and standard output.37,339MIT OR Apache-2.0Command line utilitiesText processing aki-resortsort lines of text. You can use regex to specify the KEY.37,306MIT OR Apache-2.0Command line utilitiesText processing wordfreq-modelModel loaders for wordfreq-rs37,259MIT OR Apache-2.0Text processing waken_snowballRust implementation of Snowball stemming algorithms for 33 languages37,172BSD-3-ClauseText processing codepage-stringsencode / decode strings for Windows code pages36,909MITInternationalization (i18n)Text processing vaporetto_tantivyVaporetto Tokenizer for Tantivy36,884MIT OR Apache-2.0Text processing amadeus-deriveHarmonious distributed data analysis in Rust.36,668Apache-2.0ConcurrencyDatabase interfaces amadeus-parquetAn Apache Parquet implementation in Rust.36,350Apache-2.0ConcurrencyDatabase interfaces split-first-charThis crate is DEPRECATED, use split-char-from-str instead36,162MITNo standard libraryParsing tools amadeus-commoncrawlHarmonious distributed data analysis in Rust.36,133MIT OR Apache-2.0ConcurrencyDatabase interfaces amadeus-postgresHarmonious distributed data analysis in Rust.36,088Apache-2.0ConcurrencyDatabase interfaces heck-but-macrosA proc macro wrapper around the heck crate, so that its casing functions can be applied to identifiers. Also contains a…35,935MIT OR Apache-2.0Development tools::Build UtilsRust patterns amadeus-awsHarmonious distributed data analysis in Rust.35,931Apache-2.0ConcurrencyDatabase interfaces amadeus-serdeHarmonious distributed data analysis in Rust.35,919Apache-2.0ConcurrencyDatabase interfaces amadeusHarmonious distributed data processing & analysis in Rust. parquet postgres aws s3 cloudfront elb json csv logs hadoop hdfs…35,720Apache-2.0ConcurrencyDatabase interfaces emojicEmoji constants35,662MITText processing contractionsContractions is a rust library to expand contractions in English.35,524MITText processing soupyA library for querying tree-based formats, similar to BeautifulSoup.35,304MIT OR Apache-2.0Parsing toolsText processing jpreprocess-dictionary-builderJapanese text preprocessor for Text-to-Speech application (OpenJTalk rewrite in rust language).35,140BSD-3-ClauseText processing mdbook-pdfA backend for mdBook written in Rust for generating PDF based on headless chrome and Chrome DevTools Protocol35,085GPL-3.0Command-line interfaceText processing hgrephgrep is a grep tool with human-friendly search output. This is similar to `-C` option of `grep` command, but its output is…34,983MITCommand line utilitiesText processing word_filterA Word Filter for filtering text.34,956MIT OR Apache-2.0Data structuresGame development pandoras_potHoneypot designed to send huge amounts of data to rude web scrapers34,585AGPL-3.0-onlyNetwork programmingText processing lexerplugin based lexical reader34,197MIT/Apache-2.0Parsing toolsText processing nlpo3Thai natural language processing library, with Python and Node bindings34,063Apache-2.0Text processing egui_sgrA Rust library that converts ASCII/ANSI escape sequence color models into colored text in egui33,893MITGUIText processing aki-gsubsubstitude text command, replace via regex.33,804MIT OR Apache-2.0Command line utilitiesText processing arborium-jqjq grammar for arborium (tree-sitter bindings)33,702MITParsing toolsText processing tagsearchFilter plaintext files based on @keyword tags33,613MITCommand-line interfaceText processing utf8_sliceLightweight UTF8 Slice Utilities33,431MITRust patternsText processing aki-mlinematch line, regex text filter like a grep of linux command.33,277MIT OR Apache-2.0Command line utilitiesText processing aki-mcolormark up text with color33,167MIT OR Apache-2.0Command line utilitiesText processing drama_llamaLocal LLM inference behind an Anthropic-shaped API: llama.cpp and Metal-MoE backends, chat sessions with prefix caching,…32,911non-standardAPI bindingsScience rsonpathBlazing fast JSONPath CLI tool powered by SIMD32,854MITCommand line utilitiesParser implementations lindera-jiebaA Chinese morphological dictionary for Jieba.32,840MITText processing miette-arboriumArborium-powered syntax highlighter for miette diagnostics32,502MIT OR Apache-2.0Development toolsText processing nixelParser for the Nix Expressions Language32,495GPL-3.0-onlyCommand line utilitiesData structures termux-clipboardAccess to Android clipboard using Termux API32,463MITCommand-line interfaceText processing linkcheck2A library for extracting and validating links.32,308MIT OR Apache-2.0Text processing tantivy-analysis-contribA set of analysis components for Tantivy32,194MIT OR Apache-2.0Internationalization (i18n)Localization (L10n) cc2pConvert a CSV to parquet file format32,114non-standardParsing toolsText processing proc-macro-regexA proc macro regex library32,059BSD-3-ClauseText processing pptx-to-mdParse Microsoft PowerPoint files (.pptx) and OpenDocument Presentations (.odp) into Markdown (.md)32,052MIT OR Apache-2.0Parser implementationsText processing notnowA terminal based task and TODO management software.32,013GPL-3.0-or-laterCommand line utilitiesDatabase implementations varconSource Code Spelling Correction31,918MIT OR Apache-2.0Development toolsText processing strtointParse integers from strings, with support for base prefixes31,901MITNo standard libraryParsing tools lazy-transform-strLazy-copying lazy-allocated scanning `str` transformations. This is good e.g. for (un)escaping text, especially if individual…31,838MIT OR Apache-2.0AlgorithmsText processing uastUnicode Aware Saṃskṛta Transliteration in Rust 🦀31,459Apache-2.0Command line utilitiesEncoding obsidian-exportRust library and associated CLI program to export an Obsidian vault to regular Markdown.31,231BSD-2-Clause-PatentCommand line utilitiesText processing termdiffWrite a diff with color codes to a string30,945CC0-1.0Development toolsText processing string-template-plusRender string template with more options30,913GPL-3.0-onlyTemplate engineText processing asimov-promptASIMOV Software Development Kit (SDK) for Rust30,858UnlicenseData structuresEncoding k_boardA keyboard event handler that allows dynamic development30,704GPL-3.0Development tools::FFIEncoding elefontA library that handles caching rendered glyphs on the GPU30,659MIT OR Apache-2.0Text processing google-cognitive-apisLibrary wrapping Google speech-to-text, text-to-speech and dialogflow APIs. Provides high level API layer wrapping the underlying…30,580MIT OR Apache-2.0MultimediaMultimedia::Audio matcher_cA high-performance matcher designed to solve LOGICAL and TEXT VARIATIONS problems in word matching, implemented in Rust.30,340Apache-2.0 OR MITText processing kytea-tokenizerWrapper of tokenization by KyTea30,325MIT OR Apache-2.0Text processing matcher_pyA high-performance matcher designed to solve LOGICAL and TEXT VARIATIONS problems in word matching, implemented in Rust.30,318Apache-2.0 OR MITText processing kaoliniteA crate to assist in the creation of TUI text editors.30,313MITText processing word-tallyOutput a tally of the number of times unique words appear in source input.29,807MITCommand line utilitiesText processing domrsDocument builder and serializer29,781MIT OR Apache-2.0EncodingText processing hangulUtilities to manipulate Hangul Syllables29,676MITEncodingLocalization (L10n) zawkAn efficient Awk-like language implementation by Rust with stdlib29,597MIT OR Apache-2.0Command line utilitiesText processing tui-bannerColorful ASCII art banner renderer for Rust CLI/TUI29,525Apache-2.0Command-line interfaceText processing exec-targetthe simple invoke command for test29,506MIT OR Apache-2.0Development tools::TestingText processing find-simdocTime- and memory-efficient all pairs similarity searches in documents.29,136MIT OR Apache-2.0AlgorithmsText processing aki-unbodyoutput first or last n lines, like a head and tail of linux command.29,106MIT OR Apache-2.0Command line utilitiesText processing aki-mcyclemark up text with cycling color29,051MIT OR Apache-2.0Command line utilitiesText processing gen-epub-bookGenerate an ePub book from a simple plaintext descriptor29,011MITEncodingText processing viAn input method library for vietnamese IME28,997non-standardText processing yozuk-helper-preprocessorPreprocessor utilities for Yozuk28,801MITText processing all-pairs-hammingAll pairs similarity search on binary sketches in the Hamming space.28,716MIT OR Apache-2.0AlgorithmsText processing malachiA domain specific pattern matching language made for defining bot commands.28,674Apache-2.0Parser implementationsText processing diffy-imaraTools for finding and manipulating differences between files28,611MIT OR Apache-2.0Text processing xcb-imdkitWrapper around xcb-imdkit, providing an IME client for the XIM protocol using XCB28,480LGPL-2.1-onlyAPI bindingsGUI escapingconfigurable string escaping and unescaping28,480MITText processing anda_engineAgents engine for Anda -- an AI agent framework built with Rust, powered by ICP and TEEs.28,459MIT OR Apache-2.0AccessibilityDevelopment tools maybe_xmlXML processing library28,449MIT OR Apache-2.0EncodingNo standard library mdcat-http-reqwestReqwest-based HTTP resource handler for mdcat28,427MPL-2.0 AND Apache-2.0Command line utilitiesText processing formatjsonFormats JSON files28,233MITCommand line utilitiesText processing genpdfiUser-friendly PDF generator written in pure Rust28,230Apache-2.0 OR MITText processing markdown-it-tasklistA markdown-it plugin for parsing GFM tasklists28,106Apache-2.0Parsing toolsText processing asimov-coreASIMOV Software Development Kit (SDK) for Rust27,878UnlicenseAPI bindingsData structures pomskyA new regular expression language27,784MIT OR Apache-2.0Parser implementationsText processing aki-statsoutput the statistics of text, like a wc of linux command.27,532MIT OR Apache-2.0Command line utilitiesText processing markdown-it-front-matterA markdown-it plugin for parsing front matter27,438Apache-2.0Parsing toolsText processing trie-matchFast match macro27,160MIT OR Apache-2.0AlgorithmsData structures markdown-it-heading-anchorsA markdown-it plugin for parsing GFM tasklists27,103Apache-2.0Parsing toolsText processing rust-aiA collection of 3rd-party AI APIs for Rust26,999Apache-2.0API bindingsText processing docstrErgonomic multi-line string literals26,884MIT OR Apache-2.0Data structuresDevelopment tools asimov-patternsASIMOV Software Development Kit (SDK) for Rust26,867UnlicenseParsing toolsRust patterns kami-parserKami tries to be a machine-first human-also-first markup language26,760non-standardParser implementationsText processing markdown-it-supA markdown-it plugin for parsing superscripts26,580GPL-3.0EncodingParsing tools markdown-it-subA markdown-it plugin for parsing subscripts26,572GPL-3.0EncodingParsing tools markdown-it-block-spoilerA markdown-it plugin for parsing block spoilers26,293GPL-3.0EncodingParsing tools yozuk-modelNLP model generator for Yozuk26,094MITText processing github-sluggerA slugger for GitHub headings25,985Apache-2.0Parsing toolsText processing astray_coreCore functionality of the astray macro25,749MITAlgorithmsCompilers hime_redistRedistributable runtime library for parsers generated with Hime (LR, RNGLR).25,387Apache-2.0AlgorithmsParser implementations comment-stripRemove comments out of text files25,037MITCommand line utilitiesText processing recaseChanges the convention case of input text.25,020BSD-2-ClauseText processing tgrepToy grep that honors .gitignore24,856UnlicenseCommand line utilitiesText processing acornsGenerate an AsciiDoc release notes document from tracking tickets.24,850GPL-3.0-or-laterCommand line utilitiesTemplate engine markdown-it-rubyA markdown-it plugin for parsing ruby text24,796GPL-3.0EncodingParsing tools earlgreyA library for parsing context-free grammars using Earley algorithm24,515MITParsing toolsText processing fuzzy-filterA fast implementation (O(n)) of fuzzy-filtering.24,462MITAlgorithmsText processing rustdoc-mdConvert Rust documentation JSON into clean, organized Markdown files24,426MIT OR Apache-2.0Command line utilitiesDevelopment tools web-rwkv-deriveAn implementation of the RWKV language model in pure WebGPU.24,411MIT OR Apache-2.0ScienceText processing markdown-it-deflistA markdown-it plugin for parsing definition lists24,369Apache-2.0Parsing toolsText processing slicerA utility that slices string slices into smaller string slices.24,362MIT/Apache-2.0Text processing text_analysisA robust multilingual text analysis CLI with context, N-grams, named entities, and CSV/JSON export.24,309MIT OR Apache-2.0Command line utilitiesParsing tools sealImplementation of Needleman-Wunsch & Smith-Waterman sequence alignment.24,295MPL-2.0AlgorithmsText processing markdown-it-autolinkA markdown-it plugin for parsing GFM autolinks24,196Apache-2.0Parsing toolsText processing batuta-commonShared utilities for the Batuta stack: formatting, system info, display helpers24,041MIT OR Apache-2.0Command line utilitiesText processing pomsky-macroMacro for converting pomsky expressions to regexes23,929MIT OR Apache-2.0Text processing ilmeniteA rust library for shaping, placing, and rasterizing text primarily for Basalt.23,835MITGraphicsGUI mediawiki_parserA strict parser for MediaWiki markdown.23,668MITParsing toolsText processing anda_coreCore types and traits for Anda -- an AI agent framework built with Rust, powered by ICP and TEEs.23,326MIT OR Apache-2.0AccessibilityDevelopment tools fetchkitAI-friendly web content fetching and HTML-to-Markdown conversion library23,307MITText processingWeb programming tiktokenA high-performance pure-Rust implementation of OpenAI's tiktoken BPE tokenizer23,137MIT OR Apache-2.0AlgorithmsText processing ascii-hangmancustomizable Hangman game with ASCII-art rewarding for children (desktop version)23,109MIT/Apache-2.0Command line utilitiesGames chinese_dictionaryA searchable Chinese / English dictionary with helpful utilities.22,965MITInternationalization (i18n)Localization (L10n) edgequake-pdf2mdConvert PDF documents to Markdown using Vision Language Models — CLI and library22,920MIT OR Apache-2.0Command line utilitiesText processing jenA simple CLI generation tool for creating large datasets.22,904MITCommand-line interfaceCommand line utilities kvcVery simple key-value-count tools to go from / to pandas data frames or streaming formats22,789MITScienceText processing bashdocA tool for generating documentation/help menu for user defined bash functions.22,605MITCommand line utilitiesText processing dcsvDyanmic csv reader,writer,editor22,595MIT OR Apache-2.0Text processing unreferenced_filesA utility for finding unused and unreferenced files.22,579AGPL-3.0Command line utilitiesData structures srtemplateTemplate String blazing fast with dependencyless22,441MIT OR Apache-2.0Template engineText processing colonnadeformat tabular data for display22,303MITCommand-line interfaceText processing slicestringslicestring is a crate for slicing Strings22,258MIT OR Apache-2.0AlgorithmsText processing bogrepFull-text search for bookmarks from multiple browsers22,217Apache-2.0Command line utilitiesText processing unhwpA high-performance library for extracting HWP/HWPX documents into structured Markdown22,158MITParser implementationsText processing cskkC ABIから使う事を目的とした SKK(Simple Kana Kanji henkan)方式のかな漢字変換ライブラリ21,990GPL-3.0-or-laterInternationalization (i18n)Text processing csv-noseCSV dialect sniffer using Garcia's Table Uniformity Method21,985MIT OR Apache-2.0Command line utilitiesParsing tools gnurx-sysRegular expression functionality from glibc extracted into a separate library, for Win3221,899LGPL-2.1-or-laterExternal FFI bindingsOperating systems::Windows APIs arborium-nixNix grammar for arborium (tree-sitter bindings)21,692MITParsing toolsText processing markdown-it-gfmA markdown-it plugin for parsing definition lists21,576Apache-2.0Parsing toolsText processing listinfoA zero-copy MAME ListInfo format DAT files parser and deserializer.21,285MITEmulatorsParser implementations ansicAnsic is a crate which does ansi parsing in a dynamic DSL and at compile time for efficient and zero cost ansi styling.21,222Apache-2.0Command-line interfaceDevelopment tools cindexCSV indexing library21,157MIT OR Apache-2.0Text processing unic-ucd-coreUNIC - Unicode Character Database - Version21,089MIT/Apache-2.0Internationalization (i18n)Parsing tools pomsky-syntaxParser for pomsky, a new regular expression language21,034MIT OR Apache-2.0Parser implementationsText processing cli-justifyA CLI text justify tool20,999MITCommand line utilitiesParser implementations block-alignerSIMD-accelerated library for computing global and X-drop affine gap penalty sequence-to-sequence or sequence-to-profile…20,987MITAlgorithmsHardware support prefixA customizable pretty printer for FIX messages20,943GPL-3.0-onlyCommand line utilitiesDevelopment tools yeslogic-unicode-scriptFast lookup of the Unicode Script property20,841MIT / Apache-2.0Text processing mdbook-angularmdbook renderer to run angular code samples20,791EUPL-1.2Text processing detect-newline-styleDetermine a string's preferred newline character20,741MIT OR Apache-2.0EncodingFilesystem frontmatter-genA Rust library for generating and parsing frontmatter in various formats.20,729MIT OR Apache-2.0Command line utilitiesData structures llm-toolkitA low-level, unopinionated Rust toolkit for the LLM last mile problem.20,578MITParsing toolsText processing colaA text CRDT for real-time collaborative editing20,428MITData structuresText editors