package info (click to toggle)
tokenizers 0.20.3%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: experimental
  • size: 5,480 kB
  • sloc: python: 4,499; javascript: 419; makefile: 124

Folder: examples

d .. (parent)
- - rw-r--r-- 3,224 custom_components.py
- - rw-r--r-- 4,578 example.py
- - rw-r--r-- 1,192 train_bert_wordpiece.py
- - rw-r--r-- 1,369 train_bytelevel_bpe.py
- - rw-r--r-- 625 train_with_datasets.py
- - rw-r--r-- 76,310 using_the_visualizer.ipynb