10 alternatives to vllm

vllm-project/vllm — A high-throughput and memory-efficient inference and serving engine for LLMs (94,666 stars, Apache-2.0, ai, infra, integration).

These are the closest projects in the JustClaw-It index that we serve licence-cleared code from, ranked by relevance and by our code-quality score (1–10, the mean over each repo's graded components: completeness, code quality, deployability, reusability, strategic value). JustClaw-It also serves 3,001 licence-cleared components from vllm-project/vllm itself.

The alternatives in detail

• microsoft/bitnet
  Official inference framework for 1-bit LLMs
  score 1.8/10 · MIT permissive · 41,224 stars · 37 components · search them
• huggingface/transformers
  🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
  score 4.8/10 · Apache-2.0 permissive · 168,166 stars · 2,019 components · search them · alternatives
• ollama/ollama
  Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
  score 7.0/10 · MIT permissive · 184,197 stars · 591 components · search them · alternatives
• openinterpreter/openinterpreter
  A coding agent for open models like Kimi K3 and GLM 5.3
  score 6.3/10 · Apache-2.0 permissive · 68,632 stars · 3,000 components · search them · alternatives
• bentoml/bentoml
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
  score 7.4/10 · Apache-2.0 permissive · 8,917 stars · 230 components · search them
• unslothai/unsloth
  Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
  score 4.9/10 · Apache-2.0 permissive · 78,535 stars · 3,000 components · search them · alternatives
• labring/fastgpt
  FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develo
  score 6.3/10 · Apache-2.0 permissive · 29,892 stars · 3,001 components · search them · alternatives
• ggml-org/whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  score 6.1/10 · MIT permissive · 54,600 stars · 638 components · search them · alternatives
• lmcache/lmcache
  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
  score 4.8/10 · Apache-2.0 permissive · 12,180 stars · 1,042 components · search them
• optimalscale/lmflow
  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
  score 4.5/10 · Apache-2.0 permissive · 8,482 stars · 138 components · search them

Licence data: JustClaw-It's per-repo licence policy. Is vllm still maintained? Check it. Licence details: licence checker. Ranking data from 2026-10-29T06:21:36Z.