python313Packages.vllm 0.24.0 maintained

High-throughput and memory-efficient inference and serving engine for LLMs

Name: python3.13-vllm-0.24.0
Package set: python313Packages
Homepage: https://github.com/vllm-project/vllm
License: Apache-2.0
Main program: vllm
Source: pkgs/development/python-modules/vllm/default.nix:693
Derivation: /nix/store/rlkkawkh00wmnzs310lyzxk122lfpcxx-python3.13-vllm-0.24.0.drv

Maintainers 4

Handle	Name	Contact	Via
CertainLach	Yaroslav Bolyukin	GitHub · iam@lach.pw	listed on package
daniel-fahey	Daniel Fahey	GitHub · daniel.fahey+nixpkgs@pm.me	listed on package
happysalada	Raphael Megzari	GitHub · raphael@megzari.com · @happysalada:matrix.org	listed on package
LunNova	Luna Nova	GitHub · nixpkgs-maintainer@lunnova.dev	listed on package

Dependencies 96

Package	As	Maintainers	Used by (transitive)	Status
gcc 16.2.0	propagatedBuildInputs	andir, balsoft, Ericson2314, pyrox0, vcunat	102,420	team-only
python313 3.13.15	propagatedBuildInputs	mweinelt	13,660	team-only
python313Packages.aioprometheus 22.5.0-unstable-2023-12-27	propagatedBuildInputs	ryand56	4	single
python313Packages.anthropic 1.6.0	propagatedBuildInputs	natsukium, sarahec	66	maintained
python313Packages.bitsandbytes 0.49.2	propagatedBuildInputs	06kellyjac, bcdarwin	11	maintained
python313Packages.blake3 1.0.8	propagatedBuildInputs	Luflosi	11	single
python313Packages.cachetools 7.1.4	propagatedBuildInputs	fabaff	1,533	single
python313Packages.cbor2 6.1.3	propagatedBuildInputs		1,461	unmaintained
python313Packages.compressed-tensors 0.18.0	propagatedBuildInputs	sarahec	4	single
python313Packages.depyf 0.20.0	propagatedBuildInputs		4	unmaintained
python313Packages.einops 0.8.2	propagatedBuildInputs	yl3dy	89	single
python313Packages.fastapi 0.141.1	propagatedBuildInputs	wd15	594	single
python313Packages.grpcio 1.83.1	propagatedBuildInputs		823	unmaintained
python313Packages.grpcio-reflection 1.83.1	propagatedBuildInputs	happysalada	10	single
python313Packages.httptools 0.8.0	propagatedBuildInputs		610	unmaintained
python313Packages.ijson 3.5.1	propagatedBuildInputs		31	unmaintained
python313Packages.importlib-metadata 9.0.0	propagatedBuildInputs	fabaff	7,964	single
python313Packages.kaldi-native-fbank 1.22.3	propagatedBuildInputs	CertainLach	4	single
python313Packages.llguidance 1.8.0	propagatedBuildInputs	GaetanLepage	8	single
python313Packages.lm-format-enforcer 0.11.3	propagatedBuildInputs		4	unmaintained
python313Packages.mcp 1.29.0	propagatedBuildInputs	bryanhonof, josh	37	maintained
python313Packages.mistral-common 1.12.0	propagatedBuildInputs	bgamari	5	single
python313Packages.model-hosting-container-standards 0.1.16	propagatedBuildInputs	GaetanLepage	4	single
python313Packages.msgspec 0.21.1	propagatedBuildInputs	fabaff	1,441	single
python313Packages.numba 0.67.0	propagatedBuildInputs		299	unmaintained
python313Packages.numpy 2.5.2	propagatedBuildInputs	doronbehar	5,137	single
python313Packages.openai 2.53.0	propagatedBuildInputs	malob	483	single
python313Packages.openai-harmony 0.0.8	propagatedBuildInputs	GaetanLepage	4	single
python313Packages.opencv-python-headless 4.13.0	propagatedBuildInputs		27	unmaintained
python313Packages.opentelemetry-api 1.43.0	propagatedBuildInputs	natsukium	991	single
python313Packages.opentelemetry-exporter-otlp 1.43.0	propagatedBuildInputs	natsukium	32	single
python313Packages.opentelemetry-sdk 1.43.0	propagatedBuildInputs	natsukium	980	single
python313Packages.opentelemetry-semantic-conventions-ai 0.5.1	propagatedBuildInputs	CertainLach	4	single
python313Packages.outlines 1.2.12	propagatedBuildInputs	CertainLach	4	single
python313Packages.pandas 3.0.4	propagatedBuildInputs	7c6f434c	4,054	single
python313Packages.partial-json-parser 0.2.1.1.post7	propagatedBuildInputs		4	unmaintained
python313Packages.prometheus-fastapi-instrumentator 8.1.0	propagatedBuildInputs	bcdarwin	4	single
python313Packages.psutil 7.2.2	propagatedBuildInputs		6,817	unmaintained
python313Packages.py-cpuinfo 9.0.0-unstable-2022-11-20	propagatedBuildInputs		953	unmaintained
python313Packages.py-libnuma 1.2	propagatedBuildInputs		4	unmaintained
python313Packages.pyarrow 24.0.0	propagatedBuildInputs	cpcloud, veprbl	595	maintained
python313Packages.pybase64 1.5.0	propagatedBuildInputs		8	unmaintained
python313Packages.pydantic 2.13.4	propagatedBuildInputs	wd15	3,876	single
python313Packages.python-dotenv 1.2.2	propagatedBuildInputs	erikarvstedt	3,781	single
python313Packages.python-json-logger 4.0.0	propagatedBuildInputs		191	unmaintained
python313Packages.python-multipart 0.0.32	propagatedBuildInputs	dotlambda, risicle	1,131	maintained
python313Packages.pyyaml 6.0.3	propagatedBuildInputs	dotlambda	5,105	single
python313Packages.pyzmq 27.1.0	propagatedBuildInputs		974	unmaintained
python313Packages.ray 2.59.0	propagatedBuildInputs	BillHuang2001	7	single
python313Packages.sentencepiece 0.2.1	propagatedBuildInputs	pashashocky	46	single
python313Packages.setproctitle 1.3.7	propagatedBuildInputs	exi	3,251	single
python313Packages.starlette 1.3.1	propagatedBuildInputs	wd15	1,130	single
python313Packages.tiktoken 0.12.0	propagatedBuildInputs	happysalada	161	single
python313Packages.tokenizers 0.23.2	propagatedBuildInputs	GaetanLepage	137	single
python313Packages.torch 2.13.0	propagatedBuildInputs	caniko, GaetanLepage, LunNova, teh, thoughtpolice, tscholak	399	maintained
python313Packages.torchaudio 2.11.0	propagatedBuildInputs	caniko, GaetanLepage, junjihashimoto	24	maintained
python313Packages.torchvision 0.28.0	propagatedBuildInputs	GaetanLepage	158	single
python313Packages.transformers 5.17.0	propagatedBuildInputs	GaetanLepage, happysalada, pashashocky	89	maintained
python313Packages.uvicorn 0.51.0	propagatedBuildInputs	wd15	3,483	single
python313Packages.uvloop 0.22.1	propagatedBuildInputs		3,777	unmaintained
python313Packages.watchfiles 1.2.0	propagatedBuildInputs	fabaff	642	single
python313Packages.websockets 16.1	propagatedBuildInputs	fabaff	1,345	single
python313Packages.xgrammar 0.2.8	propagatedBuildInputs		4	unmaintained
libgcc 16.2.0	buildInputs	andir, balsoft, Ericson2314, pyrox0, vcunat	102,423	team-only
numactl 2.0.18	buildInputs		36,687	unmaintained
onednn 3.13	buildInputs		184	unmaintained
openssl 3.5.8	buildInputs	andir, balsoft, pyrox0, thillux	76,863	maintained
cargo 1.98.1	nativeBuildInputs	Mic92, winterqt	28,718	team-only
ensureNewerSourcesForZipFilesHook 26.05pre-git	nativeBuildInputs		74,596	unmaintained setup hook
pkg-config 0.29.2	nativeBuildInputs		78,016	unmaintained
python313Packages.cmake 4.4.3	nativeBuildInputs		5,231	unmaintained
python313Packages.grpcio-tools 1.83.1	nativeBuildInputs		42	unmaintained
python313Packages.jinja2 3.1.6	nativeBuildInputs	nbp	6,139	single
python313Packages.ninja 1.13.2	nativeBuildInputs	999eagle	4,759	single
python313Packages.packaging 26.2	nativeBuildInputs	bennofs, mweinelt	11,614	maintained
python313Packages.protobuf 7.36.2	nativeBuildInputs	GaetanLepage	958	single
python313Packages.pypaBuildHook 26.05pre-git	nativeBuildInputs		11,598	unmaintained setup hook
python313Packages.pypaInstallHook 26.05pre-git	nativeBuildInputs		11,625	unmaintained setup hook
python313Packages.pyprojectVersionPatchHook 26.05pre-git	nativeBuildInputs	dotlambda	3,594	single setup hook
python313Packages.pythonCatchConflictsHook 26.05pre-git	nativeBuildInputs		11,609	unmaintained setup hook
python313Packages.pythonImportsCheckHook 26.05pre-git	nativeBuildInputs		11,642	unmaintained setup hook
python313Packages.pythonMetadataCheckHook 26.05pre-git	nativeBuildInputs	dotlambda	11,597	single setup hook
python313Packages.pythonNamespacesHook 26.05pre-git	nativeBuildInputs		11,634	unmaintained setup hook
python313Packages.pythonOutputDistHook 26.05pre-git	nativeBuildInputs		74,564	unmaintained setup hook
python313Packages.pythonRelaxDepsHook 26.05pre-git	nativeBuildInputs		11,601	unmaintained setup hook
python313Packages.pythonRemoveBinBytecodeHook 26.05pre-git	nativeBuildInputs		74,584	unmaintained setup hook
python313Packages.pythonRemoveTestsDirHook 26.05pre-git	nativeBuildInputs		11,634	unmaintained setup hook
python313Packages.pythonRuntimeDepsCheckHook 26.05pre-git	nativeBuildInputs		11,611	unmaintained setup hook
python313Packages.setuptools 83.0.0	nativeBuildInputs	mweinelt	11,500	team-only
python313Packages.setuptools-rust 1.13.0	nativeBuildInputs		5,058	unmaintained
python313Packages.setuptools-scm 10.0.5	nativeBuildInputs	NickCao	10,397	single
python313Packages.wrapPython 26.05pre-git	nativeBuildInputs		11,634	unmaintained setup hook
rustc 1.98.1	nativeBuildInputs	Mic92, winterqt	30,080	team-only
which 2.25	nativeBuildInputs	mdaniels5757	69,382	single
bashNonInteractive 5.3p15	other input	andir, balsoft, infinisil, pyrox0	102,441	maintained
stdenv 26.05pre-git	other input		90,330	team-only

Used by 2 directly, 2 transitively

Package	As	Maintainers	Used by (transitive)	Status
python313Packages.kserve 0.21.0	nativeBuildInputs	GaetanLepage	0	single
python313Packages.torchrl 0.14.0	nativeBuildInputs	GaetanLepage	0	single