源码包：tiktoken（0.9.0-1）

tiktoken 的相关链接

• Debian 源代码仓库 (Git)
• eLxr 补丁追踪网站

维护小组：

• Debian Deep Learning Team
• Petter Reinholdtsen
• Shengqi Chen

外部的资源：

• 主页 [github.com]

python3-tiktoken

fast BPE tokeniser for use with OpenAI's models

其他与 tiktoken 有关的软件包

• adep: debhelper-compat (= 13)

  软件包暂时不可用

• adep: pybuild-plugin-pyproject

  Debian helper tools for packaging Python libraries using PEP517

• adep: python3-setuptools

  Python3 Distutils Enhancements

• adep: python3-all

  package depending on all supported Python 3 runtime versions

• adep: python3-setuptools-rust

  Setuptools Rust extension plugin

• adep: python3-regex

  alternative regular expression module (Python 3)

• adep: python3-hypothesis

  advanced Quickcheck style testing library for Python 3

• adep: python3-pytest

  Simple, powerful testing in Python3

• adep: librust-bstr-dev (>= 0.0.1~)

  String type that is not required to be valid UTF-8 - Rust source code

• adep: librust-fancy-regex-dev

  Regexes, supporting a relatively rich set of features, including backreferences and look-around - Rust source code

• adep: librust-pyo3-dev

  Bindings to Python interpreter - Rust source code

• adep: librust-regex-automata-dev

  Automata construction and matching using regular expressions - Rust source code

• adep: librust-rustc-hash-dev

  Speed, non-cryptographic hash used in rustc - Rust source code

Download tiktoken

Debian 软件包源码仓库（VCS：Git）

https://salsa.debian.org/deeplearning-team/tiktoken.git

Debian 软件包源码仓库（可在线浏览）

https://salsa.debian.org/deeplearning-team/tiktoken