[ bianca ]
[ 源代码: tiktoken ]
软件包:python3-tiktoken(0.9.0-1 以及其他的)
fast BPE tokeniser for use with OpenAI's models
A fast Byte pair encoding tokeniser for use with OpenAI's models.
其他与 python3-tiktoken 有关的软件包
|
|
|
|
-
- dep: libc6 (>= 2.34)
- GNU C Library: Shared libraries
同时作为一个虚包由这些包填实: libc6-udeb
-
- dep: libgcc-s1 (>= 4.2)
- GCC support library
-
- dep: python3
- interactive high-level object-oriented language (default python3 version)
- dep: python3 (<< 3.14)
- dep: python3 (>= 3.13~)
-
- dep: python3-regex
- alternative regular expression module (Python 3)
-
- dep: python3-requests
- elegant and simple HTTP library for Python3, built for human beings