[ bianca ]
[ 源代码: sentencepiece ]
软件包:sentencepiece(0.2.0-1 以及其他的)
Unsupervised text tokenizer and detokenizer
SentencePiece is an unsupervised text tokenizer/detokenizer mainly designed for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
其他与 sentencepiece 有关的软件包
|
|
|
|
-
- dep: libc6 (>= 2.38)
- GNU C Library: Shared libraries
同时作为一个虚包由这些包填实: libc6-udeb
-
- dep: libgcc-s1 (>= 3.0)
- GCC support library
-
- dep: libsentencepiece0 (>= 0.2.0)
- Library files of SentencePiece
-
- dep: libstdc++6 (>= 13.1)
- GNU Standard C++ Library v3