sentencepiece 0.2.1
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training
Dependencies
Used By
Not used by any other package
Features
No Features
Available Versions
- 0.2.1#0
- 0.2.0#2
- 0.2.0#1
- 0.2.0#0
- 0.1.99#1
- 0.1.99#0
- 0.1.97#2
- 0.1.97#0
- 0.1.96#1
- 0.1.96#0
- 0.1.95#1
- 0.1.95#0
- 0.1.82#1
- v0.1.82#0