Alle Optionen
bianca  ]
[ Quellcode: r-cran-tokenizers  ]

Paket: r-cran-tokenizers (0.3.0-1 und andere)

Links für r-cran-tokenizers

Screenshot

Quellcode-Paket r-cran-tokenizers herunterladen:

Betreuer:

Externe Ressourcen:

Ähnliche Pakete:

GNU R fast, consistent tokenization of natural language text

Convert natural language text into tokens. Includes tokenizers for shingled n-grams, skip n-grams, words, word stems, sentences, paragraphs, characters, shingled characters, lines, tweets, Penn Treebank, regular expressions, as well as functions for counting characters, words, and sentences, and a function for splitting longer texts into separate documents, each with the same number of words. The tokenizers have a consistent interface, and the package is built on the 'stringi' and 'Rcpp' packages for fast yet correct tokenization in 'UTF-8'.

Andere Pakete mit Bezug zu r-cran-tokenizers

  • hängt ab von
  • empfiehlt
  • schlägt vor
  • erweitert

r-cran-tokenizers herunterladen

Download für alle verfügbaren Architekturen
Architektur Version Paketgröße Größe (installiert) Dateien
amd64 0.3.0-1 641,6 kB845,0 kB [Liste der Dateien]
arm64 0.3.0-1+b1 637,5 kB861,0 kB [Liste der Dateien]