staging · x86_64-linux · 8e1af4ab17b2 · generated 2026-11-10T01:02:05Z

python314Packages.lm-eval 0.4.13 single

Framework for few-shot evaluation of language models

Name
python3.14-lm-eval-0.4.13
Package set
python314Packages
Homepage
https://github.com/EleutherAI/lm-evaluation-harness
License
MIT
Source
pkgs/development/python-modules/lm-eval/default.nix:201
Derivation
/nix/store/kgv7ch2fdgbd5naaxh5hzmcvb4ynszd0-python3.14-lm-eval-0.4.13.drv
Repology
not reported as outdated · look up (as of 2026-11-10T01:00:17Z)

Maintainers 1

HandleNameContactVia
booxter Ihar Hrachyshka GitHub · ihar.hrachyshka@gmail.com listed on package

Dependencies 42

PackageAsMaintainersUsed by (transitive)Status
python3 3.14.10 propagatedBuildInputs 71,771 team-only
python314Packages.datasets 5.1.0 propagatedBuildInputs 189 single outdated
python314Packages.dill 0.4.1 propagatedBuildInputs
732 unmaintained
python314Packages.evaluate 0.4.6 propagatedBuildInputs 49 single
python314Packages.jinja2 3.1.6 propagatedBuildInputs 43,380 single
python314Packages.more-itertools 11.1.0 propagatedBuildInputs
9,925 unmaintained outdated
python314Packages.pytablewriter 1.2.1 propagatedBuildInputs
9 unmaintained
python314Packages.rouge-score 0.1.2 propagatedBuildInputs 6 single
python314Packages.sacrebleu 2.6.0 propagatedBuildInputs 7 single
python314Packages.scikit-learn 1.9.1 propagatedBuildInputs 198 single
python314Packages.sqlitedict 2.1.0 propagatedBuildInputs
10 unmaintained
python314Packages.tqdm 4.70.0 propagatedBuildInputs 736 single outdated
python314Packages.typing-extensions 4.16.0 propagatedBuildInputs 41,905 single
python314Packages.word2number 1.1 propagatedBuildInputs 6 single
ensureNewerSourcesForZipFilesHook 26.05pre-git nativeBuildInputs
74,250 unmaintained setup hook
python313Packages.pythonOutputDistHook 26.05pre-git nativeBuildInputs
74,218 unmaintained setup hook
python313Packages.pythonRemoveBinBytecodeHook 26.05pre-git nativeBuildInputs
74,238 unmaintained setup hook
python314Packages.accelerate 1.14.0 nativeBuildInputs 47 single outdated
python314Packages.aiohttp 3.14.5 nativeBuildInputs 5,597 single
python314Packages.peft 0.18.1 nativeBuildInputs 18 single outdated
python314Packages.pillow 13.0.0 nativeBuildInputs 4,909 single
python314Packages.pypaBuildHook 26.05pre-git nativeBuildInputs
70,722 unmaintained setup hook
python314Packages.pypaInstallHook 26.05pre-git nativeBuildInputs
70,948 unmaintained setup hook
python314Packages.pytestCheckHook 26.05pre-git nativeBuildInputs
69,251 unmaintained setup hook
python314Packages.pythonCatchConflictsHook 26.05pre-git nativeBuildInputs
70,944 unmaintained setup hook
python314Packages.pythonImportsCheckHook 26.05pre-git nativeBuildInputs
70,969 unmaintained setup hook
python314Packages.pythonMetadataCheckHook 26.05pre-git nativeBuildInputs 70,710 single setup hook
python314Packages.pythonNamespacesHook 26.05pre-git nativeBuildInputs
70,967 unmaintained setup hook
python314Packages.pythonRelaxDepsHook 26.05pre-git nativeBuildInputs
70,725 unmaintained setup hook
python314Packages.pythonRemoveTestsDirHook 26.05pre-git nativeBuildInputs
70,967 unmaintained setup hook
python314Packages.pythonRuntimeDepsCheckHook 26.05pre-git nativeBuildInputs
70,916 unmaintained setup hook
python314Packages.requests 2.34.2 nativeBuildInputs 41,215 single
python314Packages.sentencepiece 0.2.1 nativeBuildInputs 59 single outdated
python314Packages.setuptools 83.0.0 nativeBuildInputs 70,580 team-only outdated
python314Packages.tenacity 9.2.0 nativeBuildInputs 623 single outdated
python314Packages.tiktoken 0.12.0 nativeBuildInputs 210 single outdated
python314Packages.torch 2.14.1 nativeBuildInputs 375 maintained outdated
python314Packages.transformers 5.22.1 nativeBuildInputs 114 maintained outdated
python314Packages.wrapPython 26.05pre-git nativeBuildInputs
70,973 unmaintained setup hook
writableTmpDirAsHomeHook 26.05pre-git nativeBuildInputs
64,758 unmaintained setup hook
bashNonInteractive 5.3p20 other input 102,212 maintained
stdenv 26.05pre-git other input
90,021 team-only

Used by 3 directly, 5 transitively

PackageAsMaintainersUsed by (transitive)Status
python314Packages.mlx-lm 0.32.2 nativeBuildInputs
2 unmaintained
heretic 1.4.0 propagatedBuildInputs 0 single
python314Packages.heretic-llm 1.4.0 propagatedBuildInputs 0 single outdated