staging · x86_64-linux · 8e1af4ab17b2 · generated 2026-11-10T01:02:05Z

python313Packages.lm-eval 0.4.13 single

Framework for few-shot evaluation of language models

Name
python3.13-lm-eval-0.4.13
Package set
python313Packages
Homepage
https://github.com/EleutherAI/lm-evaluation-harness
License
MIT
Source
pkgs/development/python-modules/lm-eval/default.nix:201
Derivation
/nix/store/2xqxrnv2vd7xyxbnl21m5qbh3ikagc1j-python3.13-lm-eval-0.4.13.drv
Repology
not reported as outdated · look up (as of 2026-11-10T01:00:17Z)

Maintainers 1

HandleNameContactVia
booxter Ihar Hrachyshka GitHub · ihar.hrachyshka@gmail.com listed on package

Dependencies 42

PackageAsMaintainersUsed by (transitive)Status
python313 3.13.18 propagatedBuildInputs 14,168 team-only
python313Packages.datasets 5.1.0 propagatedBuildInputs 149 single outdated
python313Packages.dill 0.4.1 propagatedBuildInputs
665 unmaintained
python313Packages.evaluate 0.4.6 propagatedBuildInputs 41 single
python313Packages.jinja2 3.1.6 propagatedBuildInputs 6,261 single
python313Packages.more-itertools 11.1.0 propagatedBuildInputs
4,258 unmaintained outdated
python313Packages.pytablewriter 1.2.1 propagatedBuildInputs
7 unmaintained
python313Packages.rouge-score 0.1.2 propagatedBuildInputs 4 single
python313Packages.sacrebleu 2.6.0 propagatedBuildInputs 5 single
python313Packages.scikit-learn 1.9.1 propagatedBuildInputs 213 single
python313Packages.sqlitedict 2.1.0 propagatedBuildInputs
7 unmaintained
python313Packages.tqdm 4.70.0 propagatedBuildInputs 542 single outdated
python313Packages.typing-extensions 4.16.0 propagatedBuildInputs 7,642 single
python313Packages.word2number 1.1 propagatedBuildInputs 4 single
ensureNewerSourcesForZipFilesHook 26.05pre-git nativeBuildInputs
74,250 unmaintained setup hook
python313Packages.accelerate 1.14.0 nativeBuildInputs 39 single outdated
python313Packages.aiohttp 3.14.5 nativeBuildInputs 3,441 single
python313Packages.peft 0.18.1 nativeBuildInputs 14 single outdated
python313Packages.pillow 13.0.0 nativeBuildInputs 2,626 single
python313Packages.pypaBuildHook 26.05pre-git nativeBuildInputs
11,689 unmaintained setup hook
python313Packages.pypaInstallHook 26.05pre-git nativeBuildInputs
11,717 unmaintained setup hook
python313Packages.pytestCheckHook 26.05pre-git nativeBuildInputs
10,197 unmaintained setup hook
python313Packages.pythonCatchConflictsHook 26.05pre-git nativeBuildInputs
11,701 unmaintained setup hook
python313Packages.pythonImportsCheckHook 26.05pre-git nativeBuildInputs
11,734 unmaintained setup hook
python313Packages.pythonMetadataCheckHook 26.05pre-git nativeBuildInputs 11,689 single setup hook
python313Packages.pythonNamespacesHook 26.05pre-git nativeBuildInputs
11,726 unmaintained setup hook
python313Packages.pythonOutputDistHook 26.05pre-git nativeBuildInputs
74,218 unmaintained setup hook
python313Packages.pythonRelaxDepsHook 26.05pre-git nativeBuildInputs
11,692 unmaintained setup hook
python313Packages.pythonRemoveBinBytecodeHook 26.05pre-git nativeBuildInputs
74,238 unmaintained setup hook
python313Packages.pythonRemoveTestsDirHook 26.05pre-git nativeBuildInputs
11,726 unmaintained setup hook
python313Packages.pythonRuntimeDepsCheckHook 26.05pre-git nativeBuildInputs
11,703 unmaintained setup hook
python313Packages.requests 2.34.2 nativeBuildInputs 6,780 single
python313Packages.sentencepiece 0.2.1 nativeBuildInputs 49 single outdated
python313Packages.setuptools 83.0.0 nativeBuildInputs 11,547 team-only outdated
python313Packages.tenacity 9.2.0 nativeBuildInputs 342 single outdated
python313Packages.tiktoken 0.12.0 nativeBuildInputs 162 single outdated
python313Packages.torch 2.14.1 nativeBuildInputs 371 maintained outdated
python313Packages.transformers 5.22.1 nativeBuildInputs 90 maintained outdated
python313Packages.wrapPython 26.05pre-git nativeBuildInputs
11,727 unmaintained setup hook
writableTmpDirAsHomeHook 26.05pre-git nativeBuildInputs
64,758 unmaintained setup hook
bashNonInteractive 5.3p20 other input 102,212 maintained
stdenv 26.05pre-git other input
90,021 team-only

Used by 2 directly, 3 transitively

PackageAsMaintainersUsed by (transitive)Status
python313Packages.mlx-lm 0.32.2 nativeBuildInputs
1 unmaintained
python313Packages.heretic-llm 1.4.0 propagatedBuildInputs 0 single outdated