https://github.com/wilkeraziz/mosesdecoder
History
Tip revision: 2d7a9b7fe2c0451a645bda7704f7966dd4e2b256 authored by Lane Schwartz on 17 December 2015, 21:56:58 UTC
Reimplemented the current behavior in Stacks but with a priority queue instead of a vector of Stack objects
Tip revision: 2d7a9b7
File Mode Size
basic-protected-patterns -rw-r--r-- 178 bytes
deescape-special-chars-PTB.perl -rwxr-xr-x 662 bytes
deescape-special-chars.perl -rwxr-xr-x 631 bytes
detokenizer.perl -rwxr-xr-x 12.2 KB
escape-special-chars.perl -rwxr-xr-x 749 bytes
lowercase.perl -rwxr-xr-x 285 bytes
normalize-punctuation.perl -rwxr-xr-x 1.9 KB
pre-tok-clean.perl -rwxr-xr-x 1.4 KB
pre-tokenizer.perl -rwxr-xr-x 967 bytes
pre_tokenize_cleaning.py -rw-r--r-- 2.9 KB
remove-non-printing-char.perl -rwxr-xr-x 451 bytes
replace-unicode-punctuation.perl -rwxr-xr-x 774 bytes
tokenizer.perl -rwxr-xr-x 16.2 KB
tokenizer_PTB.perl -rwxr-xr-x 12.0 KB

back to top