package info (click to toggle)
tokenizers 0.20.3%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: experimental
  • size: 5,480 kB
  • sloc: python: 4,499; javascript: 419; makefile: 124

Folder: scripts

d .. (parent)
- - rw-r--r-- 12,970 convert.py
- - rw-r--r-- 4,852 sentencepiece_extractor.py
- - rw-r--r-- 8,373 spm_parity_check.py