All 305,250 crates, alphabetically

llmfit-coreCore library for llmfit — hardware detection, model fitting, and provider integration16,983MITHardware support llmfleetFleet-level batch dispatcher for LLM APIs. Pool requests across tasks, route to provider Batch APIs, save 50% on cost without…19MITAPI bindingsAsynchronous llmg-coreCore types and traits for LLMG - LLM Gateway698MIT OR Apache-2.0API bindingsWeb programming llmg-gatewayHTTP gateway server for LLMG275MIT OR Apache-2.0API bindingsWeb programming llmg-providersProvider implementations for LLMG - LLM Gateway575MIT OR Apache-2.0API bindingsWeb programming llmgraphThis library provides a framework for building conversational AI applications with function calling capabilities using a…906MIT llmgrepSmart grep over Magellan code maps with schema-aligned JSON output779GPL-3.0-only llmgymLLM Gym766Apache-2.0 llmignoreParse and match .llmignore files — the .gitignore for AI. Supports all 13 AI ignore formats.22MITConfigurationDevelopment tools llmignore-cliLike .gitignore, but tells AI tools what NOT to read. Fast native scanner for .llmignore files.37MITCommand line utilitiesDevelopment tools llmioMinimal OpenAI-compatible chat completions client (async + blocking)55MITAPI bindingsWeb programming::HTTP client llmix-rsRust binding for the LLMix orchestration contract with cache, resilience, and config parity75Apache-2.0API bindingsAsynchronous llmkitProduction-grade LLM client - 100+ providers, 11,000+ models. Pure Rust.354MIT OR Apache-2.0API bindingsAsynchronous llmkit-anthropicAnthropic (Claude) Messages API provider adapter for llmkit-rs31MIT OR Apache-2.0API bindingsAsynchronous llmkit-coreCore traits, types, and errors for llmkit-rs — no I/O, runtime-agnostic77MIT OR Apache-2.0 llmkit-macrosProcedural macros for llmkit-rs — #[derive(ToolSchema)]31MIT OR Apache-2.0Development tools::Procedural macro helpers llmkit-ollamaOllama (local Llama/Mistral) provider adapter for llmkit-rs32MIT OR Apache-2.0API bindingsAsynchronous llmkit-openaiOpenAI (GPT-4o, o1) provider adapter for llmkit-rs31MIT OR Apache-2.0API bindingsAsynchronous llmkit-rsUnified multi-provider async LLM client for Rust — OpenAI, Anthropic, Ollama, with Tower middleware17MIT OR Apache-2.0API bindingsAsynchronous llmkit-towerTower middleware (retry, rate limit, cost tracking, tracing) for llmkit-rs31MIT OR Apache-2.0AsynchronousNetwork programming llmlImplementation of basic math data types with high level frontend and low level backend7,965MIT OR Apache-2.0Data structuresHardware support llml_derive_crateDerive macros for llml1,709MIT OR Apache-2.0Data structuresHardware support llml_simdSIMD (Single Instruction Multiple Data) extension for a variety of targets9,294MITEmbedded developmentHardware support llml_simd_procProcedural macros for llml_simd6,301MITEmbedded developmentHardware support llmleaf-clientOfficial Rust client SDK for the llmleaf LLM proxy (OpenAI/OpenRouter-shaped JSON over HTTP).387MIT OR Apache-2.0API bindingsWeb programming::HTTP client llmletDistributed AI Agent orchestration infrastructure. [O]19Apache-2.0AsynchronousCommand line utilities llmlintLLM-as-judge linter: enforce code-quality checks deterministic linters can't express, by driving real coding harnesses through…1,166MITCommand line utilitiesDevelopment tools llmnopA command-line tool for benchmarking the performance of LLM inference endpoints.1,202Apache-2.0Command line utilitiesDevelopment tools llmosBoilerplate agent trait, types, and llmos CLI entrypoint.21MITCommand line utilities llmosafeSafety-critical cognitive safety library for AI agents. 4-tier architecture (Resource Body, Kernel, Working Memory, Sifter) with…2,575MITAlgorithmsDevelopment tools llmoxideProvider-agnostic Rust SDK for OpenAI, Anthropic, Gemini, and Ollama (streaming + tools)89MIT OR Apache-2.0API bindings llmoxide-cliCLI for llmoxide (chat, streaming output, model listing)18MIT OR Apache-2.0 llmoxide-toolsTool-calling runner for llmoxide (schemas, dispatch, streaming callbacks)18MIT OR Apache-2.0 llmposterDrop-in mock server for OpenAI, Anthropic & Gemini APIs — library or standalone CLI. SSE streaming, tool calling, OAuth2, failure…692AGPL-3.0-or-laterDevelopment tools::TestingWeb programming::HTTP server llmprogramA Rust library that provides a structured and powerful way to create and run programs that use Large Language Models (LLMs). It…382MITScienceText processing llmproxyA simple HTTP proxy server for llm api requests2,684MIT llmptrAI API protocol translation matrix: convert between OpenAI, Claude, Gemini, Codex, Antigravity, Kimi, xAI formats15MITAPI bindingsWeb programming llmptr-infraInfrastructure layer for AI API protocol translation — model registry, thinking config, schema utilities23MIT llmrix-rust-sdkOfficial Rust SDK for the llmrix AI Agent Platform API18Apache-2.0 llmrsUnofficial Rust SDK for IBM WatsonX AI platform26Apache-2.0API bindingsText processing llmrustUnified Rust interface for 7 LLM providers (OpenAI, Anthropic, DeepSeek, Google Gemini, Ollama, Moonshot, OpenRouter) with HTTP…369MIT OR Apache-2.0API bindingsAsynchronous llmsTiny CLI for streaming responses from OpenAI, Gemini, and Claude41MITCommand line utilities llms-from-scratch-rsRust (candle) code for Build a LLM From Scratch by Sebastian Raschka7,900MITScience llms-sdkUnified interface to call OpenAI and Anthropic-compatible LLM APIs from Rust60MIT llmsdkVercel ai-sdk for Rust — unified facade re-exporting the provider trait crate and one feature-gated module per concrete provider33Apache-2.0 llmsdk-amazon-bedrockAmazon Bedrock provider for llmsdk (Rust port of @ai-sdk/amazon-bedrock)37Apache-2.0 llmsdk-anthropicAnthropic provider for llmsdk (Rust port of @ai-sdk/anthropic)84Apache-2.0 llmsdk-anthropic-awsClaude Platform on AWS provider for llmsdk (Rust port of @ai-sdk/anthropic-aws)37Apache-2.0 llmsdk-azureAzure OpenAI provider for llmsdk (Rust port of @ai-sdk/azure)35Apache-2.0 llmsdk-cohereCohere provider for llmsdk (Rust port of @ai-sdk/cohere)37Apache-2.0 llmsdk-googleGoogle Gemini provider for llmsdk (Rust port of @ai-sdk/google)53Apache-2.0 llmsdk-google-vertexGoogle Vertex AI provider for llmsdk (Rust port of @ai-sdk/google-vertex)36Apache-2.0 llmsdk-mistralMistral provider for llmsdk (Rust port of @ai-sdk/mistral)37Apache-2.0 llmsdk-openaiOpenAI provider for llmsdk (Rust port of @ai-sdk/openai)87Apache-2.0 llmsdk-providerProvider trait abstractions for llmsdk (Rust port of @ai-sdk/provider v4)202Apache-2.0 llmsdk-provider-utilsHTTP, SSE and config utilities shared by llmsdk providers (Rust port of @ai-sdk/provider-utils)187Apache-2.0 llmsdk-xaixAI provider for llmsdk (Rust port of @ai-sdk/xai)36Apache-2.0 llmserveTUI for serving local LLM models. Pick a model, pick a backend, serve it.232MITCommand line utilities llmservice-flowsLLM Service integration for flows.network15,216MIT/Apache-2.0 llmshimBlazing fast LLM API translation layer in pure Rust599MITAPI bindingsWeb programming llmsimLLM Traffic Simulator - A lightweight, high-performance LLM API simulator28,854MITDevelopment tools::TestingSimulation llmtaskEngine-agnostic Task abstraction for LLM structured-output: Task trait + Grammar (JSON Schema, Lark, Regex) + ImageAnalysis161MIT OR Apache-2.0API bindingsData structures llmtermYour friendly local LLM terminal companion1,352MIT llmtextTurns any website into a single LLM-ready markdown file1,835MITCommand line utilitiesDevelopment tools llmtoolThe macro for the llmtoolbox crate5,567Apache-2.0 llmtoolboxA common API for turning Rust code into callable functions for llms6,716Apache-2.0 llmtopRealtime TUI monitor for local LLM servers (ollama, llama.cpp). The only GPU monitor that knows what model is running and how…29MITCommand line utilities llmtraceTransparent proxy server for LLM API calls110MIT llmtrace-coreCore types, traits, and errors for LLMTrace543MIT llmtrace-proxyTransparent proxy server for LLM API calls24MIT llmtrace-sdkEmbeddable SDK for Rust applications124MIT llmtrace-securitySecurity analysis engines for prompt injection detection303MIT llmtrace-storageStorage abstraction layer with SQLite backend and repository pattern288MIT llmtrimStatic, deterministic LLM prompt/payload compressor — cut input tokens 30-90% with zero extra model calls941MPL-2.0Command line utilitiesCompression llmtrim-coreStatic, deterministic LLM prompt/payload compression engine — the zero-LLM-call transform core behind llmtrim. No network, no…1,155MPL-2.0API bindingsCompression llmtrim-ledgerSQLite ledger (data layer) shared by llmtrim-cli and llmtrim-tray636MPL-2.0Database interfacesDevelopment tools llmtxt-coreCore primitives for llmtxt: compression, patching, hashing, signing, and encoding325MITCompressionEncoding llmurLightweight LLM Proxy - Binary application for running an LLM proxy server3,409MITCommand line utilities llmusageTrack token usage and costs across AI providers88MITCommand line utilities llmuxHook-driven LLM model multiplexer with pluggable switch policy685MIT llmuxerSynchronous Rust client for Anthropic, Gemini, OpenAI, and Ollama with a unified trait interface285MITAPI bindings llmuxer-eguiegui widget for configuring llmuxer providers at runtime22MITGUI llmuxer-keystoreCredential persistence for llmuxer: stores one LlmConfig per provider in ~/.config/llmuxer/config.json82MITConfiguration llmvm-backend-utilUtility functions for llmvm backends.3,456MPL-2.0 llmvm-chatAn llmvm frontend that acts as a CLI chat interface.2,791MPL-2.0Command line utilitiesScience llmvm-codeassistA LLM-powered code assistant that automatically retrieves context (i.e. type definitions) from a Language Server Protocol server.5,429MPL-2.0Development toolsScience llmvm-coreThe core application for llmvm.6,111MPL-2.0API bindingsCommand line utilities llmvm-core-libThe library for the llmvm core application.7,649MPL-2.0API bindingsText processing llmvm-outsourceAn llmvm backend which sends text and chat generation requests to known hosted language model providers.6,063MPL-2.0API bindingsCommand line utilities llmvm-outsource-libThe library for the outsource backend for llmvm.6,603MPL-2.0API bindingsText processing llmvm-protocolA library that contains protocol/communication elements for llmvm.7,374MPL-2.0API bindingsData structures llmvm-utilUtility functions for llmvm.6,561MPL-2.0 llmwebExtract any webpage to structured data with headless Chrome + LLM3,157MITCommand line utilitiesParsing tools llmwerewolfLLM Werewolf — a Rust toolkit for building automated social deduction games.196MIT llmwerewolf-rsLLM Werewolf — a Rust toolkit for building automated social deduction games.361MIT llmwikiA local-first wiki search and indexing tool85MITCommand line utilitiesText processing llmwiki-toolingCLI for managing LLM-wikis with Obsidian-style wikilinks.98MIT OR Apache-2.0 llmxUtilities for working with LLM outputs (e.g. fuzzy JSON extraction/parsing).74MITText processingWebAssembly llmx-mcpFast codebase indexing and semantic search MCP server with BM25 and hybrid embeddings75MITCommand line utilitiesDevelopment tools llmyAll-in-one LLM utilities.1,130MIT llmy-agentAll-in-one LLM utilities.1,352MIT llmy-agent-deriveAll-in-one LLM utilities.1,507MIT llmy-agent-toolsAll-in-one LLM utilities.1,245MIT llmy-clapAll-in-one LLM utilities.1,412MIT llmy-cliAll-in-one LLM utilities.636MIT llmy-clientAll-in-one LLM utilities.1,737MIT llmy-harnessAll-in-one LLM utilities.1,126MIT llmy-modelsAll-in-one LLM utilities.46MIT llmy-tokenizerAll-in-one LLM utilities.1,861MIT llmy-typesAll-in-one LLM utilities.1,989MIT llnparsellnparse1,185MIT llnparse-macrosProc-macro crate for llnparse1,226MIT llogCommand line note taking tool called 'Lincoln Log' (llog). Mostly used to learn Rust.2,960non-standard lloggsLogging configuration for clap applications13,880Apache-2.0 OR MITCommand-line interfaceDevelopment tools::Debugging lloginLPU WiFi Manager: A CLI tool for managing Lovely Professional University WiFi connections.5,771MITCommand line utilities lloneA simple, single token lookahead, imperative parser library15GPL-3.0-or-laterParsing tools lloom-authLicense activation client for the Lloom desktop app: machine fingerprint, API client, local activation cache.122MIT OR Apache-2.0Authentication lloom-guardsDefensive guards for desktop apps: path-traversal protection, size limits, and Claude Code headless sandboxing helpers.34MIT OR Apache-2.0Filesystem llosA short description of my package1,701MIT OR Apache-2.0 llqWait-free SPSC linked-list queue with individually reusable nodes71,463MIT/Apache-2.0 llqlA tool to run SQL-like query on your LLVM IR or Bitcode files5,653MITCommand line utilities llrb-indexLeft Leaning Red Black index6,260AGPL-3.0 llrt_buildLLRT build helpers16Apache-2.0 llrt_compressionLLRT compression helpers15Apache-2.0 llrt_navigatorLLRT Module navigator15Apache-2.0 llrt_testLLRT test helpers15Apache-2.0 llrt_test_tlsLLRT test helpers for TLS15Apache-2.0 llrt_utilsLLRT utilities1,273Apache-2.0 llslist listening sockets6,222MITCommand line utilities llscload-link/store-conditional implementation using atomics1,506MITAlgorithms llsdLLSD serializer and deserializer1,897GPL-3.0-or-later llsd-rsA Rust library for parsing and serializing LLSD (Linden Lab Structured Data) format.3,027LGPL-2.1 llsd-rs-deriveProc-macro derives for llsd-rs (LlsdFrom, LlsdInto, LlsdFromTo).1,015LGPL-2.1 llt-rsLow-Latency Primitives Toolkit for Rust304MITConcurrencyData structures lltopWIP18MIT OR Apache-2.0 lltsTypeScript to native compiler via LLVM24MIT llts_analysisLLTS analysis — subset validation and type resolution172MIT llts_codegenLLTS codegen — LLVM IR generation via Inkwell172MIT llts_driverLLTS driver — pipeline orchestration from TypeScript to native99MIT llts_frontendLLTS frontend — oxc parser and semantic analysis wrappers241MIT lluaLow level bindings to Lua5.45,220MITAPI bindingsNo standard library lluviaA stripped down Entity Component System that allows for no-nonsense data storage in finite time.2,802MIT OR BSD-2-Clause llvmA safe wrapper for LLVM bindings5,558MIT llvm-altA wrapper for LLVM, a powerful library and toolkit for compilers55,614BSD-3-Clause llvm-alt-sysBindings to LLVM's C API2,744MIT llvm-assemblerLLVM IR assembler for Gaia project157MPL-2.0 llvm-bitcodeLLVM Bitcode parser in Rust70,919MIT AND Apache-2.0 WITH LLVM-exceptionParser implementations llvm-bitcursorA no-frills bitstream cursor library for Rust12,898MITCompilersEncoding llvm-bitstreamA content-agnostic parser for LLVM's bitstream container format8,612MITCompilersEncoding llvm-bundler-rsA bundler to download automatically LLVM and MLIR9,117MIT OR Apache-2.0 llvm-casefile-rsReceipt and claim-ladder schema for llvm-native forensic parity courts20MIT OR Apache-2.0 llvm-configA thin wrapper around the `llvm-config` tool so you can call it from Rust.4,063MIT OR Apache-2.0API bindingsDevelopment tools llvm-constantsNumeric and enum constants for interacting with LLVM bitstreams and IR5,398MITCompilersEncoding llvm-cov-jsonA library capable of parsing llvm-cov JSON exports.5,561AGPL-3.0-only llvm-cov-prettyMore beautiful HTML reports for llvm-cov/cargo-llvm-cov26,680AGPL-3.0-onlyCommand line utilitiesDevelopment tools llvm-in-rustTop-level facade crate for the LLVM-in-Rust compiler pipeline.18Apache-2.0CompilersDevelopment tools llvm-in-rust-analysisControl-flow, call-graph, dominance, loop, and use-def analyses for LLVM-in-Rust IR.160Apache-2.0CompilersDevelopment tools llvm-in-rust-bitcodeCompact bitcode reader and writer for LLVM-in-Rust IR modules.45Apache-2.0CompilersDevelopment tools llvm-in-rust-codegenMachine-independent code generation infrastructure for LLVM-in-Rust.113Apache-2.0CompilersDevelopment tools llvm-in-rust-irCore LLVM-inspired intermediate representation data structures and builders for LLVM-in-Rust.224Apache-2.0CompilersDevelopment tools llvm-in-rust-ir-parserLexer and parser for LLVM textual IR into LLVM-in-Rust data structures.46Apache-2.0CompilersDevelopment tools llvm-in-rust-target-armAArch64 target backend for LLVM-in-Rust code generation.44Apache-2.0CompilersDevelopment tools llvm-in-rust-target-riscvRISC-V target backend for LLVM-in-Rust code generation.45Apache-2.0CompilersDevelopment tools llvm-in-rust-target-x86x86-64 target backend for LLVM-in-Rust code generation.47Apache-2.0CompilersDevelopment tools llvm-in-rust-transformsOptimization and transformation passes for LLVM-in-Rust IR.46Apache-2.0CompilersDevelopment tools llvm-infraLLVM Compiler Infrastructure in Rust80GPL-3.0-or-later llvm-irLLVM IR in natural Rust data structures125,696MIT llvm-ir-analysisStatic analysis on LLVM IR13,281MIT llvm-ir-taintTaint tracking for LLVM IR2,962MIT llvm-libLLVM library with safe and flexibility in mind, without over complexity based on LLVM-C API261,951MITCompilersDevelopment tools llvm-mapperA library for mapping the contents of bitstreams into LLVM IR models5,353MITCompilersEncoding llvm-mcaMacros for generating `llvm-mca` marker comments2,719MIT OR Apache-2.0Development tools::Profiling llvm-mca-macrosProcedural macros for generating `llvm-mca` marker comments1,040MIT OR Apache-2.0Development tools::Profiling llvm-nativeForensic-parity Rust reimplementation of LLVM toolchain behavior through oracle courts43MIT OR Apache-2.0Command line utilitiesCompilers llvm-native-cliLLVM-native CLI frontends: drop-in llc, opt, llvm-as, llvm-dis, and more20MIT OR Apache-2.0 llvm-native-coreLLVM-native core semantic engine — IR, CodeGen, X86 MC, Clang frontend pipeline296MIT OR Apache-2.0 llvm-native-core-extExtended modules for llvm-native-core: analysis passes, transforms, codegen extras, bitcode, linker, JIT, utilities. Part of the…22MIT OR Apache-2.0 llvm-oracle-rsOracle admission for LLVM tools: locate, fingerprint, and query pinned LLVM binaries21MIT OR Apache-2.0 llvm-passgenA tool for quickly creating LLVM pass skeletons7,041non-standard llvm-pluginA wrapper for easily implementing out-of-source-tree LLVM plugins in Rust.16,800Apache-2.0Development tools::FFI llvm-plugin-inkwellInkwell aims to help you pen your own programming languages by safely wrapping llvm-sys.10,682Apache-2.0Development tools::FFI llvm-plugin-inkwell-internalsInternal macro crate for inkwell7,713Apache-2.0 llvm-plugin-macrosProc macros for llvm-plugin5,696Apache-2.0Development tools::FFI llvm-pmSafe Rust wrapper for LLVM new PassManager143MITCompilersDevelopment tools llvm-pm-macrosProc macros for llvm-pm (LLVM plugin attribute)68MIT llvm-pm-sysRaw FFI bindings for LLVM new PassManager C++ stubs186MITExternal FFI bindings llvm-rsA wrapper for LLVM, a powerful library and toolkit for compilers8,010BSD-3-Clause llvm-scratchFree Standing library in Rust19,780MIT llvm-supportSupport types and routines for parsing LLVM's bitcode6,777MITCompilersEncoding llvm-symbolizer-rust-wrapperFix Rust demangling for llvm-symbolizer1,489GPL-3.0 llvm-sysBindings to LLVM's C API4,774,849MITExternal FFI bindings llvm-sys-featuredBindings to LLVM's C API3,183MITExternal FFI bindings llvm-sys-wrapperShallow wrapper for llvm-sys.22,897non-standard llvm-toolsProvides access to the llvm tools installed through the `llvm-tools-preview` rustup component.799,676MIT/Apache-2.0 llvm-tools-previewReserved/placeholder crate.90MIT OR Apache-2.0 llvm-wrapA safer wrapper for the LLVM C API bindings in Rust, based on llvm-sys8,107MIT llvm-wrapperSafe llvm-sys wrapper6,821MIT llvm_build_utilsEver wanted to build “native” assembly stuff in your cargo build scripts… something gcc crate cannot quite handle yet? Welcome…6,008ISC/Apache-2.0 llvm_linkHigh level bindings to the LLVM v3.9.1 release of libLTO, for building a linker with.2,255MIT/Apache-2.0 llvm_profparserParsing and interpretation of llvm coverage profiles and generated data1,573,586Apache-2.0Encoding