sentencepiece 0.2.1

SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training

Used By

Not used by any other package

Features

No Features

Available Versions

  • 0.2.1#0
  • 0.2.0#2
  • 0.2.0#1
  • 0.2.0#0
  • 0.1.99#1
  • 0.1.99#0
  • 0.1.97#2
  • 0.1.97#0
  • 0.1.96#1
  • 0.1.96#0
  • 0.1.95#1
  • 0.1.95#0
  • 0.1.82#1
  • v0.1.82#0