package info (click to toggle)
pytorch-text 0.14.1-2
  • links: PTS, VCS
  • area: main
  • in suites: bookworm
  • size: 11,560 kB
  • sloc: python: 14,197; cpp: 2,404; sh: 214; makefile: 20

Folder: tokenizer

d .. (parent)
- - rw-r--r-- 165 CMakeLists.txt
- - rw-r--r-- 1,405 README.md
- - rw-r--r-- 852 create_tokenizer.py
- - rw-r--r-- 616 main.cpp