staging · x86_64-linux · 8e1af4ab17b2 · generated 2026-11-10T01:02:05Z

python314Packages.toktok-rs 0.3.0 single

Fast, exact BPE tokenizer for OpenAI encodings, with a Rust core

Name
python3.14-toktok-rs-0.3.0
Package set
python314Packages
Homepage
https://github.com/vectorize-io/toktok
License
MIT
Source
pkgs/development/python-modules/toktok-rs/default.nix:59
Derivation
/nix/store/rfi5g5y4iidc3lfcjdk2nkpczrs5ypj7-python3.14-toktok-rs-0.3.0.drv
Repology
not reported as outdated · look up (as of 2026-11-10T01:00:17Z)

Maintainers 1

HandleNameContactVia
brudel Bruno Del Monde GitHub · me@brudel.dev · @brudel:beeper.com listed on package

Dependencies 17

PackageAsMaintainersUsed by (transitive)Status
python3 3.14.10 propagatedBuildInputs 71,771 team-only
ensureNewerSourcesForZipFilesHook 26.05pre-git nativeBuildInputs
74,250 unmaintained setup hook
python313Packages.pythonOutputDistHook 26.05pre-git nativeBuildInputs
74,218 unmaintained setup hook
python313Packages.pythonRemoveBinBytecodeHook 26.05pre-git nativeBuildInputs
74,238 unmaintained setup hook
python314Packages.numpy 2.5.4 nativeBuildInputs 11,879 single
python314Packages.pypaBuildHook 26.05pre-git nativeBuildInputs
70,722 unmaintained setup hook
python314Packages.pypaInstallHook 26.05pre-git nativeBuildInputs
70,948 unmaintained setup hook
python314Packages.pytestCheckHook 26.05pre-git nativeBuildInputs
69,251 unmaintained setup hook
python314Packages.pythonCatchConflictsHook 26.05pre-git nativeBuildInputs
70,944 unmaintained setup hook
python314Packages.pythonImportsCheckHook 26.05pre-git nativeBuildInputs
70,969 unmaintained setup hook
python314Packages.pythonMetadataCheckHook 26.05pre-git nativeBuildInputs 70,710 single setup hook
python314Packages.pythonNamespacesHook 26.05pre-git nativeBuildInputs
70,967 unmaintained setup hook
python314Packages.pythonRemoveTestsDirHook 26.05pre-git nativeBuildInputs
70,967 unmaintained setup hook
python314Packages.pythonRuntimeDepsCheckHook 26.05pre-git nativeBuildInputs
70,916 unmaintained setup hook
python314Packages.wrapPython 26.05pre-git nativeBuildInputs
70,973 unmaintained setup hook
bashNonInteractive 5.3p20 other input 102,212 maintained
stdenv 26.05pre-git other input
90,021 team-only

Used by 1 directly, 1 transitively

PackageAsMaintainersUsed by (transitive)Status
hindsight-api-slim 1.1.0 propagatedBuildInputs 0 single