https://github.com/google/sentencepiece

sort by:
Revision Author Date Message Commit Date
302b95e Remove the LICENSE export as there is no license file in src/ This breaks addlicensedeps.py for AGSA. PiperOrigin-RevId: 252439316 11 June 2019, 05:59:45 UTC
67967a0 Fixing the open source bazel build and updating the travis configuration to run with bazel. PiperOrigin-RevId: 252341557 11 June 2019, 05:59:18 UTC
38aa629 Fix typo in spm tool flag comments. PiperOrigin-RevId: 252341307 11 June 2019, 05:58:52 UTC
61d59db Project import generated by Copybara. PiperOrigin-RevId: 251772401 06 June 2019, 04:55:47 UTC
d4dd947 Merge pull request #333 from guillaumekln/patch-1 Declare C language in CMakeLists.txt 23 May 2019, 04:41:05 UTC
ae4dea4 Declare C language in CMakeLists.txt Some CMake version will fail during the configuration with 'Unknown extension ".c" for file' because C is not part of the language list. 21 May 2019, 14:33:39 UTC
b3f6f05 Update .travis.yml 13 May 2019, 07:20:41 UTC
f6bfabe Update test.sh 13 May 2019, 07:20:04 UTC
ffa2c82 fixed bug of is_unknown in Python module 13 April 2019, 16:21:50 UTC
53e5116 Update README.md 08 April 2019, 12:30:56 UTC
635752e Update README.md 27 March 2019, 22:42:49 UTC
bd0b105 made with colab 27 March 2019, 22:25:42 UTC
3ad1af3 Delete Sentencepiece_python_module_example.ipynb 27 March 2019, 22:24:39 UTC
5b87d97 Delete Sentencepiece_python_module_example.ipynb 27 March 2019, 22:20:09 UTC
f2c29da Colaboratory を使用して作成しました 27 March 2019, 22:19:18 UTC
0e260a0 Colaboratory を使用して作成しました 27 March 2019, 21:57:00 UTC
3be3f2e added sentencepiece_*py2 27 March 2019, 00:43:10 UTC
c58588f Update make_py_wheel_mac.sh 22 March 2019, 16:06:31 UTC
52c28d5 Update make_py_wheel_mac.sh 22 March 2019, 15:47:50 UTC
1336d89 Update make_py_wheel_mac.sh 22 March 2019, 15:40:42 UTC
d6be4e0 Update make_py_wheel_mac.sh 22 March 2019, 15:08:22 UTC
32e5bf0 Update make_py_wheel_mac.sh 22 March 2019, 14:52:33 UTC
179a1a0 Update make_py_wheel_mac.sh 22 March 2019, 10:04:17 UTC
c7cdef2 Updated the version 22 March 2019, 07:31:38 UTC
798eae2 Merge pull request #303 from google/sr support tf 1.13.1 21 March 2019, 15:25:22 UTC
8b22017 support tf 1.13.1 11 March 2019, 16:08:13 UTC
1ba7fd1 Merge pull request #301 from akshitj1/patch-1 change notebook link to avoid permission errors 11 March 2019, 00:52:06 UTC
25c6eb6 change link to avoid permission errors notebook link gives "Invalid Credentials" error if only one account is logged in. Works fine in incognito. 10 March 2019, 06:28:23 UTC
4e0bc0f Merge pull request #295 from ebuildy/patch-1 Fix Python sample typo (SampleEncodeAsPieces) 27 February 2019, 07:45:23 UTC
5c2a1e1 Fix Python sample typo (SampleEncodeAsPieces) Should fix #290, #221 according to code source https://github.com/google/sentencepiece/blob/master/python/sentencepiece.py#L153. 17 February 2019, 17:27:20 UTC
3d597a5 Update trainer_interface.cc 29 January 2019, 16:17:45 UTC
552937e Update trainer_interface.cc 18 January 2019, 15:29:44 UTC
535789c Update README.md 14 January 2019, 08:55:05 UTC
f019874 Update README.md 14 January 2019, 07:50:35 UTC
2a48081 added tensorflow/README.md 14 January 2019, 05:25:55 UTC
0848bbf Update VERSION 12 January 2019, 06:14:29 UTC
18c337f remove control characters in the default nmt_* normalizers 10 January 2019, 08:16:53 UTC
a938a66 updated the document 10 January 2019, 06:20:05 UTC
c59ec63 Merge pull request #278 from google/sr added --treat_whitespace_as_suffix option to make _ be a suffix of word. 09 January 2019, 16:04:54 UTC
59b48eb added --treat_whitespace_as_suffix option to make _ be a suffix of word. 09 January 2019, 15:39:26 UTC
a04c947 Update README.md 09 January 2019, 00:31:31 UTC
04683fc emit relative path of file in LOG(INFO) 08 January 2019, 16:01:47 UTC
a53ef92 Update README.md 08 January 2019, 13:11:48 UTC
c20f023 Update README.md 08 January 2019, 13:10:38 UTC
d50d69f Update README.md 08 January 2019, 13:09:08 UTC
c643ac3 Merge pull request #275 from google/sr Do not parse deprecated proto fileds 08 January 2019, 11:23:10 UTC
e4a93f8 Do not parse deprecated proto fileds 08 January 2019, 10:25:11 UTC
271431b Merge pull request #274 from google/sr added (Encode|Decode)AsSerializedProto interface so Python module can… 08 January 2019, 09:01:49 UTC
24bda0a added (Encode|Decode)AsSerializedProto interface so Python module can get full access to the proto. 08 January 2019, 08:47:19 UTC
c4b42e1 emits too-long-sentence error only once 08 January 2019, 05:36:44 UTC
cc3a7a6 updated tensorflow shared objects 08 January 2019, 05:20:48 UTC
64a0810 Merge pull request #273 from google/sr fixed build break on windows 08 January 2019, 05:07:55 UTC
d9ff72a fixed build break on windows 08 January 2019, 04:48:33 UTC
3daa7a2 Merge pull request #271 from google/sr use builtin protobuf-lite package in third_party 08 January 2019, 03:00:20 UTC
545b9a9 Merge branch 'master' into sr 08 January 2019, 03:00:10 UTC
7b19d68 use builtin protobuf-lite package in third_party 08 January 2019, 02:40:08 UTC
ecc9916 Update VERSION 25 December 2018, 02:38:07 UTC
29ace74 Update trainer_interface.cc 10 December 2018, 15:37:02 UTC
092a728 Merge pull request #261 from google/sr added third_party as a subdir of cmake 10 December 2018, 15:28:53 UTC
b4c185f added third_party as a subdir of cmake 10 December 2018, 15:24:18 UTC
69a0046 Fixed build break. 09 December 2018, 08:35:05 UTC
72fb713 Merge pull request #259 from google/sr deperecated mining_sentence_size and training_sentence_size. Load all… 09 December 2018, 08:30:11 UTC
904edfe deperecated mining_sentence_size and training_sentence_size. Load all sentences by default. 09 December 2018, 07:08:14 UTC
15f01d5 Merge pull request #257 from brettkoonce/minor_sp minor spelling tweaks 09 December 2018, 02:30:55 UTC
98e95fa Merge pull request #258 from PawanKartikS/master Fixed syntax highlighting 09 December 2018, 02:30:11 UTC
aaa43a4 Fixed syntax highlighting 08 December 2018, 17:33:44 UTC
0580acc minor spelling tweaks 08 December 2018, 15:15:02 UTC
5563a7c Merge pull request #256 from google/sr support to change the piece of unk/bos/eos/pad 08 December 2018, 14:46:50 UTC
5f635d0 support to change the piece of unk/bos/eos/pad 08 December 2018, 13:08:05 UTC
f6229bf remvoe the max size constraint for input sentence size etc. 18 November 2018, 06:54:21 UTC
3cf4923 added ubuntu/trusty LTS for testing 18 November 2018, 06:31:52 UTC
6f4fe28 Fixed minor bugs 13 November 2018, 15:54:20 UTC
e3d5942 Do not set UNUSED type to UNK/CONTROL/USER_DEFINED tokens 13 November 2018, 13:48:24 UTC
165fc09 Fixed build error on Ubutu trusty added #include <set> to normalizer.h 13 November 2018, 13:14:55 UTC
9959905 Merge pull request #242 from kant/patch-3 Typo on paragraph #44 12 November 2018, 04:30:59 UTC
1284d31 Typo on paragraph #44 12 November 2018, 04:16:59 UTC
d35413c Merge pull request #241 from google/sr load tf versioned so file to avoid abi incompatibility for mac 11 November 2018, 13:05:29 UTC
8850737 load tf versioned so file to avoid abi incompatibility for mac 11 November 2018, 12:49:54 UTC
49b54ed Merge pull request #240 from google/sr load tf versioned so file to avoid abi incompatibility 11 November 2018, 09:55:07 UTC
586ab34 load tf versioned so file to avoid abi incompatibility 11 November 2018, 09:53:53 UTC
74c3ca7 Update VERSION 11 November 2018, 08:25:14 UTC
7e5ef01 Merge pull request #239 from google/sr added --max_sentence_length flag 11 November 2018, 02:19:07 UTC
55e4da4 added --max_sentence_length flag 11 November 2018, 01:27:52 UTC
52870fe Merge pull request #238 from google/sr added --split_by_number flag 10 November 2018, 18:57:47 UTC
6d0fd75 added --split_by_number flag 10 November 2018, 18:08:44 UTC
c65e1aa Merge pull request #237 from google/sr bug fix around user-defined-symbols 09 November 2018, 17:47:57 UTC
875731e bug fix around user-defined-symbols 09 November 2018, 17:26:39 UTC
20a034b Merge pull request #235 from google/sr stop normalization for user_defined_symbols 08 November 2018, 09:17:41 UTC
c950219 stop normalization for user_defined_symbols 08 November 2018, 08:26:14 UTC
77f7611 Merge pull request #233 from google/sr updated _sentencepiece_processor_ops.so 07 November 2018, 00:59:48 UTC
b5b3ffc updated _sentencepiece_processor_ops.so 07 November 2018, 00:31:40 UTC
bcb1363 Merge pull request #232 from google/sr added --minloglevel flag 06 November 2018, 23:34:38 UTC
4b1d65c added --minloglevel flag 06 November 2018, 16:20:12 UTC
d55372c Merge pull request #225 from google/sr pushed new nfkc_cf.tsv 28 October 2018, 16:29:21 UTC
465a419 pushed new nfkc_cf.tsv 28 October 2018, 16:11:45 UTC
42ba256 Merge pull request #223 from google/sr fixed build error on tensorflow 28 October 2018, 08:20:56 UTC
20469aa fixed build error on tensorflow 27 October 2018, 17:22:24 UTC
24f7dfd Update README.md 24 October 2018, 05:19:08 UTC
3ee8639 Merge pull request #202 from google/sr performance tuning 16 September 2018, 13:29:15 UTC
778acc2 Update README.md 16 September 2018, 12:29:47 UTC
back to top