Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
MilindChawre
/
erav3-s11-hindi-tokenizer
like
0
Sleeping
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
main
erav3-s11-hindi-tokenizer
1 contributor
History:
2 commits
MilindChawre
Adding hindi BPE tokenizer
da971a5
about 2 months ago
output
Adding hindi BPE tokenizer
about 2 months ago
.gitattributes
Safe
1.52 kB
initial commit
about 2 months ago
README.md
Safe
13.2 kB
Adding hindi BPE tokenizer
about 2 months ago
app.py
Safe
6.12 kB
Adding hindi BPE tokenizer
about 2 months ago
hindi_tokenizer.py
Safe
21.7 kB
Adding hindi BPE tokenizer
about 2 months ago
requirements.txt
Safe
32 Bytes
Adding hindi BPE tokenizer
about 2 months ago
use_tokenizer.py
Safe
1.13 kB
Adding hindi BPE tokenizer
about 2 months ago
