302b95e | Sentencepiece Team | 10 June 2019, 17:57:14 UTC | Remove the LICENSE export as there is no license file in src/ This breaks addlicensedeps.py for AGSA. PiperOrigin-RevId: 252439316 | 11 June 2019, 05:59:45 UTC |
67967a0 | kstevens | 10 June 2019, 04:27:14 UTC | Fixing the open source bazel build and updating the travis configuration to run with bazel. PiperOrigin-RevId: 252341557 | 11 June 2019, 05:59:18 UTC |
38aa629 | Sentencepiece Team | 10 June 2019, 04:22:54 UTC | Fix typo in spm tool flag comments. PiperOrigin-RevId: 252341307 | 11 June 2019, 05:58:52 UTC |
61d59db | Sentencepiece Team | 06 June 2019, 03:04:26 UTC | Project import generated by Copybara. PiperOrigin-RevId: 251772401 | 06 June 2019, 04:55:47 UTC |
d4dd947 | Taku Kudo | 23 May 2019, 04:41:05 UTC | Merge pull request #333 from guillaumekln/patch-1 Declare C language in CMakeLists.txt | 23 May 2019, 04:41:05 UTC |
ae4dea4 | Guillaume Klein | 21 May 2019, 14:33:39 UTC | Declare C language in CMakeLists.txt Some CMake version will fail during the configuration with 'Unknown extension ".c" for file' because C is not part of the language list. | 21 May 2019, 14:33:39 UTC |
b3f6f05 | Taku Kudo | 13 May 2019, 07:20:41 UTC | Update .travis.yml | 13 May 2019, 07:20:41 UTC |
f6bfabe | Taku Kudo | 13 May 2019, 07:20:04 UTC | Update test.sh | 13 May 2019, 07:20:04 UTC |
ffa2c82 | Taku Kudo | 13 April 2019, 16:21:50 UTC | fixed bug of is_unknown in Python module | 13 April 2019, 16:21:50 UTC |
53e5116 | Taku Kudo | 08 April 2019, 12:30:56 UTC | Update README.md | 08 April 2019, 12:30:56 UTC |
635752e | Taku Kudo | 27 March 2019, 22:42:49 UTC | Update README.md | 27 March 2019, 22:42:49 UTC |
bd0b105 | Taku Kudo | 27 March 2019, 22:25:42 UTC | made with colab | 27 March 2019, 22:25:42 UTC |
3ad1af3 | Taku Kudo | 27 March 2019, 22:24:39 UTC | Delete Sentencepiece_python_module_example.ipynb | 27 March 2019, 22:24:39 UTC |
5b87d97 | Taku Kudo | 27 March 2019, 22:20:09 UTC | Delete Sentencepiece_python_module_example.ipynb | 27 March 2019, 22:20:09 UTC |
f2c29da | Taku Kudo | 27 March 2019, 22:19:18 UTC | Colaboratory を使用して作成しました | 27 March 2019, 22:19:18 UTC |
0e260a0 | Taku Kudo | 27 March 2019, 21:57:00 UTC | Colaboratory を使用して作成しました | 27 March 2019, 21:57:00 UTC |
3be3f2e | Taku Kudo | 27 March 2019, 00:43:10 UTC | added sentencepiece_*py2 | 27 March 2019, 00:43:10 UTC |
c58588f | Taku Kudo | 22 March 2019, 16:06:31 UTC | Update make_py_wheel_mac.sh | 22 March 2019, 16:06:31 UTC |
52c28d5 | Taku Kudo | 22 March 2019, 15:47:50 UTC | Update make_py_wheel_mac.sh | 22 March 2019, 15:47:50 UTC |
1336d89 | Taku Kudo | 22 March 2019, 15:40:42 UTC | Update make_py_wheel_mac.sh | 22 March 2019, 15:40:42 UTC |
d6be4e0 | Taku Kudo | 22 March 2019, 15:08:22 UTC | Update make_py_wheel_mac.sh | 22 March 2019, 15:08:22 UTC |
32e5bf0 | Taku Kudo | 22 March 2019, 14:52:33 UTC | Update make_py_wheel_mac.sh | 22 March 2019, 14:52:33 UTC |
179a1a0 | Taku Kudo | 22 March 2019, 10:04:17 UTC | Update make_py_wheel_mac.sh | 22 March 2019, 10:04:17 UTC |
c7cdef2 | Taku Kudo | 22 March 2019, 07:31:38 UTC | Updated the version | 22 March 2019, 07:31:38 UTC |
798eae2 | Taku Kudo | 21 March 2019, 15:25:22 UTC | Merge pull request #303 from google/sr support tf 1.13.1 | 21 March 2019, 15:25:22 UTC |
8b22017 | Taku Kudo | 11 March 2019, 16:08:13 UTC | support tf 1.13.1 | 11 March 2019, 16:08:13 UTC |
1ba7fd1 | Taku Kudo | 11 March 2019, 00:52:06 UTC | Merge pull request #301 from akshitj1/patch-1 change notebook link to avoid permission errors | 11 March 2019, 00:52:06 UTC |
25c6eb6 | akshitj1 | 10 March 2019, 06:28:23 UTC | change link to avoid permission errors notebook link gives "Invalid Credentials" error if only one account is logged in. Works fine in incognito. | 10 March 2019, 06:28:23 UTC |
4e0bc0f | Taku Kudo | 27 February 2019, 07:45:23 UTC | Merge pull request #295 from ebuildy/patch-1 Fix Python sample typo (SampleEncodeAsPieces) | 27 February 2019, 07:45:23 UTC |
5c2a1e1 | Thomas Decaux | 17 February 2019, 17:27:20 UTC | Fix Python sample typo (SampleEncodeAsPieces) Should fix #290, #221 according to code source https://github.com/google/sentencepiece/blob/master/python/sentencepiece.py#L153. | 17 February 2019, 17:27:20 UTC |
3d597a5 | Taku Kudo | 29 January 2019, 16:17:45 UTC | Update trainer_interface.cc | 29 January 2019, 16:17:45 UTC |
552937e | Taku Kudo | 18 January 2019, 15:29:44 UTC | Update trainer_interface.cc | 18 January 2019, 15:29:44 UTC |
535789c | Taku Kudo | 14 January 2019, 08:55:05 UTC | Update README.md | 14 January 2019, 08:55:05 UTC |
f019874 | Taku Kudo | 14 January 2019, 07:50:35 UTC | Update README.md | 14 January 2019, 07:50:35 UTC |
2a48081 | Taku Kudo | 14 January 2019, 05:25:55 UTC | added tensorflow/README.md | 14 January 2019, 05:25:55 UTC |
0848bbf | Taku Kudo | 12 January 2019, 06:14:29 UTC | Update VERSION | 12 January 2019, 06:14:29 UTC |
18c337f | Taku Kudo | 10 January 2019, 08:16:53 UTC | remove control characters in the default nmt_* normalizers | 10 January 2019, 08:16:53 UTC |
a938a66 | Taku Kudo | 10 January 2019, 06:20:05 UTC | updated the document | 10 January 2019, 06:20:05 UTC |
c59ec63 | Taku Kudo | 09 January 2019, 16:04:54 UTC | Merge pull request #278 from google/sr added --treat_whitespace_as_suffix option to make _ be a suffix of word. | 09 January 2019, 16:04:54 UTC |
59b48eb | Taku Kudo | 09 January 2019, 15:39:26 UTC | added --treat_whitespace_as_suffix option to make _ be a suffix of word. | 09 January 2019, 15:39:26 UTC |
a04c947 | Taku Kudo | 09 January 2019, 00:31:31 UTC | Update README.md | 09 January 2019, 00:31:31 UTC |
04683fc | Taku Kudo | 08 January 2019, 16:01:47 UTC | emit relative path of file in LOG(INFO) | 08 January 2019, 16:01:47 UTC |
a53ef92 | Taku Kudo | 08 January 2019, 13:11:48 UTC | Update README.md | 08 January 2019, 13:11:48 UTC |
c20f023 | Taku Kudo | 08 January 2019, 13:10:38 UTC | Update README.md | 08 January 2019, 13:10:38 UTC |
d50d69f | Taku Kudo | 08 January 2019, 13:09:08 UTC | Update README.md | 08 January 2019, 13:09:08 UTC |
c643ac3 | Taku Kudo | 08 January 2019, 11:23:10 UTC | Merge pull request #275 from google/sr Do not parse deprecated proto fileds | 08 January 2019, 11:23:10 UTC |
e4a93f8 | Taku Kudo | 08 January 2019, 10:25:11 UTC | Do not parse deprecated proto fileds | 08 January 2019, 10:25:11 UTC |
271431b | Taku Kudo | 08 January 2019, 09:01:49 UTC | Merge pull request #274 from google/sr added (Encode|Decode)AsSerializedProto interface so Python module can… | 08 January 2019, 09:01:49 UTC |
24bda0a | Taku Kudo | 08 January 2019, 08:47:19 UTC | added (Encode|Decode)AsSerializedProto interface so Python module can get full access to the proto. | 08 January 2019, 08:47:19 UTC |
c4b42e1 | Taku Kudo | 08 January 2019, 05:36:44 UTC | emits too-long-sentence error only once | 08 January 2019, 05:36:44 UTC |
cc3a7a6 | Taku Kudo | 08 January 2019, 05:20:48 UTC | updated tensorflow shared objects | 08 January 2019, 05:20:48 UTC |
64a0810 | Taku Kudo | 08 January 2019, 05:07:55 UTC | Merge pull request #273 from google/sr fixed build break on windows | 08 January 2019, 05:07:55 UTC |
d9ff72a | Taku Kudo | 08 January 2019, 04:48:33 UTC | fixed build break on windows | 08 January 2019, 04:48:33 UTC |
3daa7a2 | Taku Kudo | 08 January 2019, 03:00:20 UTC | Merge pull request #271 from google/sr use builtin protobuf-lite package in third_party | 08 January 2019, 03:00:20 UTC |
545b9a9 | Taku Kudo | 08 January 2019, 03:00:10 UTC | Merge branch 'master' into sr | 08 January 2019, 03:00:10 UTC |
7b19d68 | Taku Kudo | 08 January 2019, 02:40:08 UTC | use builtin protobuf-lite package in third_party | 08 January 2019, 02:40:08 UTC |
ecc9916 | Taku Kudo | 25 December 2018, 02:38:07 UTC | Update VERSION | 25 December 2018, 02:38:07 UTC |
29ace74 | Taku Kudo | 10 December 2018, 15:37:02 UTC | Update trainer_interface.cc | 10 December 2018, 15:37:02 UTC |
092a728 | Taku Kudo | 10 December 2018, 15:28:53 UTC | Merge pull request #261 from google/sr added third_party as a subdir of cmake | 10 December 2018, 15:28:53 UTC |
b4c185f | Taku Kudo | 10 December 2018, 15:24:18 UTC | added third_party as a subdir of cmake | 10 December 2018, 15:24:18 UTC |
69a0046 | Taku Kudo | 09 December 2018, 08:35:05 UTC | Fixed build break. | 09 December 2018, 08:35:05 UTC |
72fb713 | Taku Kudo | 09 December 2018, 08:30:11 UTC | Merge pull request #259 from google/sr deperecated mining_sentence_size and training_sentence_size. Load all… | 09 December 2018, 08:30:11 UTC |
904edfe | Taku Kudo | 09 December 2018, 07:08:14 UTC | deperecated mining_sentence_size and training_sentence_size. Load all sentences by default. | 09 December 2018, 07:08:14 UTC |
15f01d5 | Taku Kudo | 09 December 2018, 02:30:55 UTC | Merge pull request #257 from brettkoonce/minor_sp minor spelling tweaks | 09 December 2018, 02:30:55 UTC |
98e95fa | Taku Kudo | 09 December 2018, 02:30:11 UTC | Merge pull request #258 from PawanKartikS/master Fixed syntax highlighting | 09 December 2018, 02:30:11 UTC |
aaa43a4 | Pawan Kartik | 08 December 2018, 17:33:44 UTC | Fixed syntax highlighting | 08 December 2018, 17:33:44 UTC |
0580acc | Brett Koonce | 08 December 2018, 15:14:20 UTC | minor spelling tweaks | 08 December 2018, 15:15:02 UTC |
5563a7c | Taku Kudo | 08 December 2018, 14:46:50 UTC | Merge pull request #256 from google/sr support to change the piece of unk/bos/eos/pad | 08 December 2018, 14:46:50 UTC |
5f635d0 | Taku Kudo | 08 December 2018, 13:08:05 UTC | support to change the piece of unk/bos/eos/pad | 08 December 2018, 13:08:05 UTC |
f6229bf | Taku Kudo | 18 November 2018, 06:54:21 UTC | remvoe the max size constraint for input sentence size etc. | 18 November 2018, 06:54:21 UTC |
3cf4923 | Taku Kudo | 18 November 2018, 06:31:52 UTC | added ubuntu/trusty LTS for testing | 18 November 2018, 06:31:52 UTC |
6f4fe28 | Taku Kudo | 13 November 2018, 15:54:20 UTC | Fixed minor bugs | 13 November 2018, 15:54:20 UTC |
e3d5942 | Taku Kudo | 13 November 2018, 13:48:24 UTC | Do not set UNUSED type to UNK/CONTROL/USER_DEFINED tokens | 13 November 2018, 13:48:24 UTC |
165fc09 | Taku Kudo | 13 November 2018, 13:14:55 UTC | Fixed build error on Ubutu trusty added #include <set> to normalizer.h | 13 November 2018, 13:14:55 UTC |
9959905 | Taku Kudo | 12 November 2018, 04:30:59 UTC | Merge pull request #242 from kant/patch-3 Typo on paragraph #44 | 12 November 2018, 04:30:59 UTC |
1284d31 | Darío Hereñú | 12 November 2018, 04:16:59 UTC | Typo on paragraph #44 | 12 November 2018, 04:16:59 UTC |
d35413c | Taku Kudo | 11 November 2018, 13:05:29 UTC | Merge pull request #241 from google/sr load tf versioned so file to avoid abi incompatibility for mac | 11 November 2018, 13:05:29 UTC |
8850737 | Taku Kudo | 11 November 2018, 12:49:54 UTC | load tf versioned so file to avoid abi incompatibility for mac | 11 November 2018, 12:49:54 UTC |
49b54ed | Taku Kudo | 11 November 2018, 09:55:07 UTC | Merge pull request #240 from google/sr load tf versioned so file to avoid abi incompatibility | 11 November 2018, 09:55:07 UTC |
586ab34 | Taku Kudo | 11 November 2018, 09:53:53 UTC | load tf versioned so file to avoid abi incompatibility | 11 November 2018, 09:53:53 UTC |
74c3ca7 | Taku Kudo | 11 November 2018, 08:25:14 UTC | Update VERSION | 11 November 2018, 08:25:14 UTC |
7e5ef01 | Taku Kudo | 11 November 2018, 02:19:07 UTC | Merge pull request #239 from google/sr added --max_sentence_length flag | 11 November 2018, 02:19:07 UTC |
55e4da4 | Taku Kudo | 11 November 2018, 01:27:52 UTC | added --max_sentence_length flag | 11 November 2018, 01:27:52 UTC |
52870fe | Taku Kudo | 10 November 2018, 18:57:47 UTC | Merge pull request #238 from google/sr added --split_by_number flag | 10 November 2018, 18:57:47 UTC |
6d0fd75 | Taku Kudo | 10 November 2018, 18:08:44 UTC | added --split_by_number flag | 10 November 2018, 18:08:44 UTC |
c65e1aa | Taku Kudo | 09 November 2018, 17:47:57 UTC | Merge pull request #237 from google/sr bug fix around user-defined-symbols | 09 November 2018, 17:47:57 UTC |
875731e | Taku Kudo | 09 November 2018, 17:26:39 UTC | bug fix around user-defined-symbols | 09 November 2018, 17:26:39 UTC |
20a034b | Taku Kudo | 08 November 2018, 09:17:41 UTC | Merge pull request #235 from google/sr stop normalization for user_defined_symbols | 08 November 2018, 09:17:41 UTC |
c950219 | Taku Kudo | 08 November 2018, 08:26:14 UTC | stop normalization for user_defined_symbols | 08 November 2018, 08:26:14 UTC |
77f7611 | Taku Kudo | 07 November 2018, 00:59:48 UTC | Merge pull request #233 from google/sr updated _sentencepiece_processor_ops.so | 07 November 2018, 00:59:48 UTC |
b5b3ffc | Taku Kudo | 07 November 2018, 00:31:40 UTC | updated _sentencepiece_processor_ops.so | 07 November 2018, 00:31:40 UTC |
bcb1363 | Taku Kudo | 06 November 2018, 23:34:38 UTC | Merge pull request #232 from google/sr added --minloglevel flag | 06 November 2018, 23:34:38 UTC |
4b1d65c | Taku Kudo | 06 November 2018, 16:20:12 UTC | added --minloglevel flag | 06 November 2018, 16:20:12 UTC |
d55372c | Taku Kudo | 28 October 2018, 16:29:21 UTC | Merge pull request #225 from google/sr pushed new nfkc_cf.tsv | 28 October 2018, 16:29:21 UTC |
465a419 | Taku Kudo | 28 October 2018, 16:11:45 UTC | pushed new nfkc_cf.tsv | 28 October 2018, 16:11:45 UTC |
42ba256 | Taku Kudo | 28 October 2018, 08:20:56 UTC | Merge pull request #223 from google/sr fixed build error on tensorflow | 28 October 2018, 08:20:56 UTC |
20469aa | Taku Kudo | 27 October 2018, 17:22:24 UTC | fixed build error on tensorflow | 27 October 2018, 17:22:24 UTC |
24f7dfd | Taku Kudo | 24 October 2018, 05:19:08 UTC | Update README.md | 24 October 2018, 05:19:08 UTC |
3ee8639 | Taku Kudo | 16 September 2018, 13:29:15 UTC | Merge pull request #202 from google/sr performance tuning | 16 September 2018, 13:29:15 UTC |
778acc2 | Taku Kudo | 16 September 2018, 12:29:47 UTC | Update README.md | 16 September 2018, 12:29:47 UTC |