全部搜索项
bianca  ]
[ 源代码: r-cran-tokenizers  ]

软件包:r-cran-tokenizers(0.3.0-1 以及其他的)

r-cran-tokenizers 的相关链接

Screenshot

下载源码包 r-cran-tokenizers

维护小组:

外部的资源:

相似软件包:

GNU R fast, consistent tokenization of natural language text

Convert natural language text into tokens. Includes tokenizers for shingled n-grams, skip n-grams, words, word stems, sentences, paragraphs, characters, shingled characters, lines, tweets, Penn Treebank, regular expressions, as well as functions for counting characters, words, and sentences, and a function for splitting longer texts into separate documents, each with the same number of words. The tokenizers have a consistent interface, and the package is built on the 'stringi' and 'Rcpp' packages for fast yet correct tokenization in 'UTF-8'.

其他与 r-cran-tokenizers 有关的软件包

  • 依赖
  • 推荐
  • 建议
  • 增强

下载 r-cran-tokenizers

下载可用于所有硬件架构的
硬件架构 版本 软件包大小 安装后大小 文件
amd64 0.3.0-1 641.6 kB845.0 kB [文件列表]
arm64 0.3.0-1+b1 637.5 kB861.0 kB [文件列表]