https://github.com/google/sentencepiece
Tip revision: 18c337f32d376b339f15a48c7ccc5c1c288345a1 authored by Taku Kudo on 10 January 2019, 08:16:53 UTC
remove control characters in the default nmt_* normalizers
remove control characters in the default nmt_* normalizers
Tip revision: 18c337f
| File | Mode | Size |
|---|---|---|
| data | ||
| doc | ||
| python | ||
| src | ||
| tensorflow | ||
| third_party | ||
| .gitignore | -rw-r--r-- | 630 bytes |
| .travis.yml | -rw-r--r-- | 4.2 KB |
| CMakeLists.txt | -rw-r--r-- | 3.7 KB |
| CONTRIBUTING.md | -rw-r--r-- | 1.4 KB |
| LICENSE | -rw-r--r-- | 11.1 KB |
| README.md | -rw-r--r-- | 14.4 KB |
| VERSION | -rw-r--r-- | 5 bytes |
| appveyor.yml | -rw-r--r-- | 543 bytes |
| config.h.in | -rw-r--r-- | 169 bytes |
| sentencepiece.pc.in | -rw-r--r-- | 363 bytes |
| test.bat | -rw-r--r-- | 1.0 KB |
| test.sh | -rwxr-xr-x | 3.5 KB |
