Alan Guo Xiang Tan
930f51e175
FEATURE: Split up text segmentation for Chinese and Japanese.
...
* Chinese segmenetation will continue to rely on cppjieba
* Japanese segmentation will use our port of TinySegmenter
* Korean currently does not rely on segmentation which was dropped in c677877e4fe5381f613279901f36ae255c909573
* SiteSetting.search_tokenize_chinese_japanese_korean has been split
into SiteSetting.search_tokenize_chinese and
SiteSetting.search_tokenize_japanese respectively
2022-02-07 09:21:14 +08:00
..
2022-01-06 16:50:18 +00:00
2022-01-13 16:02:07 -05:00
2022-01-05 18:45:08 +01:00
2019-12-03 10:05:53 +01:00
2020-01-09 15:11:31 +01:00
2021-07-07 09:43:48 -04:00
2022-02-04 16:28:20 +00:00
2022-01-05 18:45:08 +01:00
2022-02-03 10:36:32 +10:00
2022-01-14 17:51:13 -03:00
2022-01-05 18:45:08 +01:00
2022-01-05 18:45:08 +01:00
2022-02-03 10:00:28 +00:00
2021-08-20 11:29:06 +02:00
2022-01-05 10:23:36 +08:00
2022-01-05 18:45:08 +01:00
2021-12-06 10:34:39 +10:00
2021-10-22 10:02:56 -07:00
2021-06-08 16:46:07 +01:00
2021-11-17 23:27:30 +03:00
2021-06-22 16:02:24 +01:00
2022-02-03 13:39:21 -03:00
2022-01-05 18:45:08 +01:00
2021-04-22 08:43:06 +02:00
2021-11-17 23:27:30 +03:00
2021-03-02 10:28:27 -06:00
2022-02-07 09:21:14 +08:00
2021-10-05 11:25:00 -04:00
2019-12-03 10:05:53 +01:00
2022-02-07 09:21:14 +08:00
2022-01-05 18:45:08 +01:00
2021-10-22 12:03:58 -04:00
2022-02-04 18:28:18 +00:00
2021-11-23 13:54:51 +02:00
2021-11-16 12:10:50 +05:30
2021-12-07 13:07:45 -06:00
2022-02-07 09:21:14 +08:00
2020-01-15 11:27:12 +01:00
2021-09-02 14:55:38 -04:00
2020-06-15 10:05:22 +08:00
2021-11-17 23:27:30 +03:00
2021-11-12 08:52:59 -06:00
2021-12-09 12:30:27 +00:00
2021-04-21 12:36:32 +03:00
2020-04-30 16:48:53 +10:00
2021-07-27 16:32:59 +10:00
2021-05-21 11:43:47 +10:00
2022-01-04 11:19:27 +10:00
2021-09-21 13:49:56 +10:00
2021-09-16 09:56:54 +10:00
2019-08-09 11:58:15 +03:00
2021-10-27 11:39:28 +03:00
2021-11-25 16:58:39 -03:00
2021-06-21 13:28:48 +10:00
2021-08-24 10:46:28 +03:00
2020-10-09 12:51:24 +01:00
2021-06-21 11:06:58 +08:00
2021-11-25 15:22:43 +11:00
2021-11-25 15:22:43 +11:00
2021-03-22 19:41:42 +02:00
2019-08-13 01:13:08 +01:00
2021-04-21 12:36:32 +03:00
2022-01-06 16:28:46 +04:00
2022-01-06 16:28:46 +04:00
2021-06-14 20:34:44 +05:30
2021-08-10 10:25:15 -04:00
2021-12-02 09:33:03 -06:00
2019-12-03 10:05:53 +01:00
2020-01-05 22:08:13 +11:00
2021-05-27 16:13:14 -04:00
2020-02-18 13:37:39 +02:00
2021-11-30 13:36:14 -03:00
2021-12-10 14:25:26 -06:00
2021-12-01 09:18:56 +11:00
2021-11-09 17:20:09 +11:00
2022-02-04 19:41:08 +00:00
2020-02-20 15:15:53 +11:00
2021-06-04 09:13:18 +08:00
2020-03-09 17:37:49 +01:00
2020-02-03 14:54:50 +00:00
2021-05-19 13:57:21 +04:00
2019-12-03 10:05:53 +01:00
2021-02-02 17:34:00 +01:00
2022-02-04 23:43:53 +00:00
2021-12-06 10:34:39 +10:00
2021-05-31 10:22:50 +08:00
2021-11-18 09:17:23 +10:00
2022-01-21 17:54:18 +02:00
2021-11-22 10:16:35 -07:00
2022-01-31 15:35:12 +08:00
2021-11-11 12:21:25 -06:00
2022-01-04 10:14:33 +10:00
2021-11-29 10:26:33 +01:00
2020-10-22 12:50:22 +08:00
2021-11-17 23:27:30 +03:00
2020-04-30 16:48:53 +10:00
2021-09-17 10:41:34 +02:00
2020-07-22 18:00:07 +01:00
2020-04-17 14:59:54 -07:00
2022-01-31 15:35:12 +08:00
2020-04-01 15:42:45 -04:00
2021-12-17 14:03:35 +01:00
2022-01-05 18:45:08 +01:00
2020-02-18 15:13:19 +11:00
2021-03-19 17:48:30 +10:00
2022-02-03 10:00:28 +00:00
2021-09-24 11:55:15 +03:00
2021-11-12 08:52:59 -06:00
2021-05-26 15:11:35 +05:30
2022-01-31 15:35:12 +08:00
2019-10-11 03:50:37 -04:00
2022-02-03 16:19:30 +11:00
2020-04-30 16:48:53 +10:00
2022-01-05 18:45:08 +01:00
2020-06-09 10:25:43 +08:00
2021-12-27 11:25:37 -03:00
2020-08-19 09:21:02 -06:00
2021-09-10 09:20:50 +08:00
2022-01-05 12:37:15 -06:00
2021-08-26 15:16:35 +10:00
2021-04-27 18:24:27 +02:00
2021-11-09 16:29:37 +02:00
2022-01-13 14:11:07 +08:00
2022-01-28 13:02:02 +10:00
2021-08-11 08:39:25 +10:00
2020-05-05 13:46:57 +10:00
2020-02-18 15:08:58 +10:00
2022-02-03 13:07:40 -06:00
2021-12-10 14:25:26 -06:00
2022-01-31 15:35:12 +08:00
2020-10-19 10:40:55 +01:00
2019-11-26 15:01:37 -05:00
2021-11-16 18:01:48 +03:00
2021-11-11 08:25:31 +10:00
2022-01-05 18:45:08 +01:00
2022-02-07 09:21:14 +08:00
2019-12-03 10:05:53 +01:00
2021-06-24 00:09:40 +02:00
2021-06-04 09:13:18 +08:00
2021-11-22 16:43:12 +01:00
2021-01-12 17:28:33 +02:00
2020-07-27 10:23:54 +10:00
2021-11-12 08:52:59 -06:00
2021-11-17 23:27:30 +03:00
2019-10-02 14:01:53 +10:00
2021-03-02 18:51:50 +01:00
2022-01-05 18:45:08 +01:00
2021-06-23 07:38:43 +03:00
2021-05-24 18:13:30 +10:00
2021-05-21 11:43:47 +10:00
2021-04-28 23:12:08 +03:00
2021-06-21 11:06:58 +08:00
2021-11-22 13:16:56 +01:00
2021-11-22 13:16:56 +01:00
2021-01-25 11:30:59 +01:00
2022-02-07 09:21:14 +08:00
2021-10-28 11:59:46 +05:30
2020-07-24 10:11:30 +08:00
2020-03-05 11:13:43 -08:00
2020-12-11 14:20:48 +02:00
2021-11-16 12:10:50 +05:30
2021-03-15 11:58:53 -03:00
2021-01-29 09:03:44 +10:00
2021-12-07 10:14:45 +01:00
2021-09-10 09:20:50 +08:00
2021-06-01 22:11:48 +02:00
2021-12-07 13:07:45 -06:00
2020-10-30 15:04:29 +01:00
2020-07-21 15:55:03 +08:00
2021-07-05 14:17:31 +08:00
2021-12-10 12:25:50 -07:00
2019-10-02 14:01:53 +10:00
2021-10-05 11:25:00 -04:00
2021-05-28 12:35:52 +10:00
2021-08-06 20:07:42 +04:00
2021-08-10 17:25:11 +05:30
2021-12-21 21:13:05 +04:00
2021-10-25 12:53:50 +01:00
2022-01-27 10:53:21 -05:00
2020-04-30 16:48:53 +10:00
2020-04-01 08:36:50 -05:00
2021-07-23 14:24:44 -04:00