[ bianca ]
[ ソース: sentencepiece ]
パッケージ: sentencepiece (0.2.0-1 など)
Unsupervised text tokenizer and detokenizer
SentencePiece is an unsupervised text tokenizer/detokenizer mainly designed for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
その他の sentencepiece 関連パッケージ
|
|
|
|
-
- dep: libc6 (>= 2.38)
- GNU C Library: Shared libraries
以下のパッケージによって提供される仮想パッケージでもあります: libc6-udeb
-
- dep: libgcc-s1 (>= 3.0)
- GCC support library
-
- dep: libsentencepiece0 (>= 0.2.0)
- Library files of SentencePiece
-
- dep: libstdc++6 (>= 13.1)
- GNU Standard C++ Library v3