nixos-unstable · x86_64-linux · 151fa4e8ddfd · generated 2026-10-07T01:01:54Z

vllm 0.24.0 maintained

High-throughput and memory-efficient inference and serving engine for LLMs

Name
vllm-0.24.0
Package set
top-level
Homepage
https://github.com/vllm-project/vllm
License
Apache-2.0
Main program
vllm
Source
pkgs/development/python-modules/vllm/default.nix:693
Derivation
/nix/store/2hs3k2hsn85fyp70y40vf4h7rxsv1vv0-python3.13-vllm-0.24.0.drv

Maintainers 4

HandleNameContactVia
CertainLach Yaroslav Bolyukin GitHub · iam@lach.pw listed on package
daniel-fahey Daniel Fahey GitHub · daniel.fahey+nixpkgs@pm.me listed on package
happysalada Raphael Megzari GitHub · raphael@megzari.com · @happysalada:matrix.org listed on package
LunNova Luna Nova GitHub · nixpkgs-maintainer@lunnova.dev listed on package

Dependencies 95

PackageAsMaintainersUsed by (transitive)Status
gcc 16.2.0 propagatedBuildInputs
andir, balsoft, Ericson2314, pyrox0, vcunat
 102,420 team-only
python313 3.13.15 propagatedBuildInputs
mweinelt
 13,660 team-only
python313Packages.aioprometheus 22.5.0-unstable-2023-12-27 propagatedBuildInputs
ryand56
 4 single
python313Packages.anthropic 1.6.0 propagatedBuildInputs
natsukium, sarahec
 66 maintained
python313Packages.bitsandbytes 0.49.2 propagatedBuildInputs
06kellyjac, bcdarwin
 11 maintained
python313Packages.blake3 1.0.8 propagatedBuildInputs
Luflosi
 11 single
python313Packages.cachetools 7.1.4 propagatedBuildInputs
fabaff
 1,533 single
python313Packages.cbor2 6.1.3 propagatedBuildInputs
1,461 unmaintained
python313Packages.compressed-tensors 0.18.0 propagatedBuildInputs
sarahec
 4 single
python313Packages.depyf 0.20.0 propagatedBuildInputs
4 unmaintained
python313Packages.einops 0.8.2 propagatedBuildInputs
yl3dy
 89 single
python313Packages.fastapi 0.141.1 propagatedBuildInputs
wd15
 594 single
python313Packages.grpcio 1.83.1 propagatedBuildInputs
823 unmaintained
python313Packages.grpcio-reflection 1.83.1 propagatedBuildInputs
happysalada
 10 single
python313Packages.httptools 0.8.0 propagatedBuildInputs
610 unmaintained
python313Packages.ijson 3.5.1 propagatedBuildInputs
31 unmaintained
python313Packages.importlib-metadata 9.0.0 propagatedBuildInputs
fabaff
 7,964 single
python313Packages.kaldi-native-fbank 1.22.3 propagatedBuildInputs
CertainLach
 4 single
python313Packages.llguidance 1.8.0 propagatedBuildInputs
GaetanLepage
 8 single
python313Packages.lm-format-enforcer 0.11.3 propagatedBuildInputs
4 unmaintained
python313Packages.mcp 1.29.0 propagatedBuildInputs
bryanhonof, josh
 37 maintained
python313Packages.mistral-common 1.12.0 propagatedBuildInputs
bgamari
 5 single
python313Packages.model-hosting-container-standards 0.1.16 propagatedBuildInputs
GaetanLepage
 4 single
python313Packages.msgspec 0.21.1 propagatedBuildInputs
fabaff
 1,441 single
python313Packages.numba 0.67.0 propagatedBuildInputs
299 unmaintained
python313Packages.numpy 2.5.2 propagatedBuildInputs
doronbehar
 5,137 single
python313Packages.openai 2.53.0 propagatedBuildInputs
malob
 483 single
python313Packages.openai-harmony 0.0.8 propagatedBuildInputs
GaetanLepage
 4 single
python313Packages.opencv-python-headless 4.13.0 propagatedBuildInputs
27 unmaintained
python313Packages.opentelemetry-api 1.43.0 propagatedBuildInputs
natsukium
 991 single
python313Packages.opentelemetry-exporter-otlp 1.43.0 propagatedBuildInputs
natsukium
 32 single
python313Packages.opentelemetry-sdk 1.43.0 propagatedBuildInputs
natsukium
 980 single
python313Packages.opentelemetry-semantic-conventions-ai 0.5.1 propagatedBuildInputs
CertainLach
 4 single
python313Packages.outlines 1.2.12 propagatedBuildInputs
CertainLach
 4 single
python313Packages.pandas 3.0.4 propagatedBuildInputs
7c6f434c
 4,054 single
python313Packages.partial-json-parser 0.2.1.1.post7 propagatedBuildInputs
4 unmaintained
python313Packages.prometheus-fastapi-instrumentator 8.1.0 propagatedBuildInputs
bcdarwin
 4 single
python313Packages.psutil 7.2.2 propagatedBuildInputs
6,817 unmaintained
python313Packages.py-cpuinfo 9.0.0-unstable-2022-11-20 propagatedBuildInputs
953 unmaintained
python313Packages.py-libnuma 1.2 propagatedBuildInputs
4 unmaintained
python313Packages.pyarrow 24.0.0 propagatedBuildInputs
cpcloud, veprbl
 595 maintained
python313Packages.pybase64 1.5.0 propagatedBuildInputs
8 unmaintained
python313Packages.pydantic 2.13.4 propagatedBuildInputs
wd15
 3,876 single
python313Packages.python-dotenv 1.2.2 propagatedBuildInputs
erikarvstedt
 3,781 single
python313Packages.python-json-logger 4.0.0 propagatedBuildInputs
191 unmaintained
python313Packages.python-multipart 0.0.32 propagatedBuildInputs
dotlambda, risicle
 1,131 maintained
python313Packages.pyyaml 6.0.3 propagatedBuildInputs
dotlambda
 5,105 single
python313Packages.pyzmq 27.1.0 propagatedBuildInputs
974 unmaintained
python313Packages.ray 2.59.0 propagatedBuildInputs
BillHuang2001
 7 single
python313Packages.sentencepiece 0.2.1 propagatedBuildInputs
pashashocky
 46 single
python313Packages.setproctitle 1.3.7 propagatedBuildInputs
exi
 3,251 single
python313Packages.starlette 1.3.1 propagatedBuildInputs
wd15
 1,130 single
python313Packages.tiktoken 0.12.0 propagatedBuildInputs
happysalada
 161 single
python313Packages.tokenizers 0.23.2 propagatedBuildInputs
GaetanLepage
 137 single
python313Packages.torch 2.13.0 propagatedBuildInputs
caniko, GaetanLepage, LunNova, teh, thoughtpolice, tscholak
 399 maintained
python313Packages.torchaudio 2.11.0 propagatedBuildInputs
caniko, GaetanLepage, junjihashimoto
 24 maintained
python313Packages.torchvision 0.28.0 propagatedBuildInputs
GaetanLepage
 158 single
python313Packages.transformers 5.17.0 propagatedBuildInputs
GaetanLepage, happysalada, pashashocky
 89 maintained
python313Packages.uvicorn 0.51.0 propagatedBuildInputs
wd15
 3,483 single
python313Packages.uvloop 0.22.1 propagatedBuildInputs
3,777 unmaintained
python313Packages.watchfiles 1.2.0 propagatedBuildInputs
fabaff
 642 single
python313Packages.websockets 16.1 propagatedBuildInputs
fabaff
 1,345 single
python313Packages.xgrammar 0.2.8 propagatedBuildInputs
4 unmaintained
libgcc 16.2.0 buildInputs
andir, balsoft, Ericson2314, pyrox0, vcunat
 102,423 team-only
numactl 2.0.18 buildInputs
36,687 unmaintained
onednn 3.13 buildInputs
184 unmaintained
openssl 3.5.8 buildInputs
andir, balsoft, pyrox0, thillux
 76,863 maintained
cargo 1.98.1 nativeBuildInputs
Mic92, winterqt
 28,718 team-only
ensureNewerSourcesForZipFilesHook 26.05pre-git nativeBuildInputs
74,596 unmaintained setup hook
pkg-config 0.29.2 nativeBuildInputs
78,016 unmaintained
python313Packages.cmake 4.4.3 nativeBuildInputs
5,231 unmaintained
python313Packages.grpcio-tools 1.83.1 nativeBuildInputs
42 unmaintained
python313Packages.jinja2 3.1.6 nativeBuildInputs
nbp
 6,139 single
python313Packages.ninja 1.13.2 nativeBuildInputs
999eagle
 4,759 single
python313Packages.packaging 26.2 nativeBuildInputs
bennofs, mweinelt
 11,614 maintained
python313Packages.protobuf 7.36.2 nativeBuildInputs
GaetanLepage
 958 single
python313Packages.pypaBuildHook 26.05pre-git nativeBuildInputs
11,598 unmaintained setup hook
python313Packages.pypaInstallHook 26.05pre-git nativeBuildInputs
11,625 unmaintained setup hook
python313Packages.pyprojectVersionPatchHook 26.05pre-git nativeBuildInputs
dotlambda
 3,594 single setup hook
python313Packages.pythonCatchConflictsHook 26.05pre-git nativeBuildInputs
11,609 unmaintained setup hook
python313Packages.pythonImportsCheckHook 26.05pre-git nativeBuildInputs
11,642 unmaintained setup hook
python313Packages.pythonNamespacesHook 26.05pre-git nativeBuildInputs
11,634 unmaintained setup hook
python313Packages.pythonOutputDistHook 26.05pre-git nativeBuildInputs
74,564 unmaintained setup hook
python313Packages.pythonRelaxDepsHook 26.05pre-git nativeBuildInputs
11,601 unmaintained setup hook
python313Packages.pythonRemoveBinBytecodeHook 26.05pre-git nativeBuildInputs
74,584 unmaintained setup hook
python313Packages.pythonRemoveTestsDirHook 26.05pre-git nativeBuildInputs
11,634 unmaintained setup hook
python313Packages.pythonRuntimeDepsCheckHook 26.05pre-git nativeBuildInputs
11,611 unmaintained setup hook
python313Packages.setuptools 83.0.0 nativeBuildInputs
mweinelt
 11,500 team-only
python313Packages.setuptools-rust 1.13.0 nativeBuildInputs
5,058 unmaintained
python313Packages.setuptools-scm 10.0.5 nativeBuildInputs
NickCao
 10,397 single
python313Packages.wrapPython 26.05pre-git nativeBuildInputs
11,634 unmaintained setup hook
rustc 1.98.1 nativeBuildInputs
Mic92, winterqt
 30,080 team-only
which 2.25 nativeBuildInputs
mdaniels5757
 69,382 single
bashNonInteractive 5.3p15 other input
andir, balsoft, infinisil, pyrox0
 102,441 maintained
stdenv 26.05pre-git other input
90,330 team-only

Used by 0 directly, 0 transitively

No package depends on this one.