266 Commits

Author SHA1 Message Date
Miwa / Ensan
73ed9c02d4 [Fix] 学習データの更新ロジックを修正 (#86)
* base value should be updated here

* fix logic

* chore: 処理順の変更

* fix: だいぶ怪しい処理を修正

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* fix: use memory stride, not size

* implement: migration from wrong impl

* implement: migration from wrong impl

* cleanup: remove debug codes
2024-04-30 23:06:36 +09:00
Miwa / Ensan
4f2750ef3e [Tools] 辞書データ解析用のサブコマンドをancoに追加 (#85)
* base value should be updated here

* feature: implement cli tool for reading louds data

* Update document
2024-04-29 19:26:28 +09:00
Miwa / Ensan
f17958af47 change max depth (#84) 2024-04-29 17:09:52 +09:00
Miwa / Ensan
ecfb23c780 base value should be updated here (#83) 2024-04-29 17:06:25 +09:00
Miwa / Ensan
b5f634f45e fix: temporary memoryの更新ロジックのバグを修正 (#81)
* fix: temporary memoryの更新ロジックのバグを修正

* unnecessary diff
2024-04-22 00:30:51 +09:00
Miwa / Ensan
5e96958577 Remove unused API 2024-03-30 02:01:11 +09:00
Miwa / Ensan
85c3bd3d02 Merge branch 'develop' into feature/improve_convert_graph_impls 2024-03-16 11:56:56 +09:00
Miwa / Ensan
2c4af95885 fix build error in swift 5.10 2024-03-06 23:29:41 +09:00
k-taro56
fb7119a148 Refactor dropping "ネン" from string in CalendarCandidate.swift 2024-03-03 02:17:05 +09:00
Miwa / Ensan
f593a17d0a Rename osUserDict to dynamicUserDict, indicating more flexibility 2024-02-29 14:15:12 +09:00
Miwa / Ensan
bf1cb13631 Simplify prediction candidate search 2024-02-29 01:32:20 +09:00
Miwa / Ensan
f30bfcf298 Introduce anco cli tool 2024-02-27 23:44:01 +09:00
Miwa / Ensan
cda10cc87e add more test cases 2024-02-27 01:48:14 +09:00
Miwa / Ensan
0795b8cf84 [Experimental] ConvertGraphを実装し、その上での完全一致変換を実装 (#47)
* ConvertGraphを実装し、その上での完全一致変換を実装

* 名前空間を汚染していたので修正

* Implementation completed (without test)

* move directory to use default dictionary

* fix implementations to enable conversion

* add test cases

* Backward searchで発見された候補を明示的に削除

* fix tests

* simplify
2024-02-24 23:21:44 +09:00
Miwa / Ensan
52fc9ae4c2 [Experimental] InputGraphの構造を変更し、LookupGraphによる辞書引きを実装 (#46)
* implement byfix lookup

* find failing test

* implement backward search

* add more test cases

* add new file

* split files

* Improve InputGraph Architecture

* implement dictionary search
2024-02-23 17:51:27 +09:00
Miwa / Ensan
784a80c46a [Experimental] InputGraphベースの辞書ルックアップ (#45) 2024-02-23 02:37:59 +09:00
Miwa / Ensan
6f2a5218a2 add submodule and add conversion tests 2024-02-20 00:34:47 +09:00
Miwa / Ensan
a6b5fec881 Add #else to enable compile in non-Apple platforms 2024-02-19 14:12:25 +00:00
Miwa / Ensan
b02f6eb899 make text replacer customizable (#35) 2024-02-17 22:32:19 +09:00
Miwa / Ensan
a7269fbbbe Update SpellChecker.swift (#34) 2024-02-06 23:41:35 +09:00
Miwa / Ensan
9dab49d60b Update SpellChecker.swift (#33) 2024-02-04 01:34:17 +09:00
Miwa / Ensan
ff1d3282c8 Update SpellChecker.swift to support VisionOS (#32) 2024-02-04 01:32:50 +09:00
Miwa / Ensan
365e32e7bf [Refactoring] 二分探索を単純化 (#31)
* simplify calculation

* cleanup

* add code fro debug

* fix bug

* cleanup

* cleanup

* add binary search

* cleanup binary search

* cleanup binary search

* cleanup init

* cleanup init

* debugging: flatten indices

* flatten indices

* calc range with SIMD2

* add assertion

* Simplify binary search

* cleanup
2024-01-13 01:52:36 +09:00
Miwa / Ensan
f2c5c3c58d [Performance] LOUDSのinit処理を高速化 (#30)
* simplify calculation

* cleanup

* add code fro debug

* fix bug

* cleanup

* cleanup

* add binary search

* cleanup binary search

* cleanup binary search

* cleanup init

* cleanup init

* debugging: flatten indices

* flatten indices
2024-01-07 15:48:19 +09:00
ensan-hcl
505c0af13f improve uniquing 2024-01-07 15:19:29 +09:00
Miwa / Ensan
a36b0e0049 [Performance] LOUDSのlookupを高速化 (#28)
* simplify calculation

* cleanup

* add code fro debug

* fix bug

* cleanup

* cleanup

* cleanup
2024-01-07 02:19:39 +09:00
ensan-hcl
808dcf4a0b fix typo 2023-09-23 19:09:19 +09:00
ensan-hcl
0e52b2333c Add more mid and cid data 2023-09-23 18:59:13 +09:00
ensan-hcl
1e5624db47 Fix an issue that dicdata from temproary learning manager are not applied penalty 2023-09-23 18:16:33 +09:00
ensan-hcl
f624affc43 apply lint 2023-09-23 15:19:30 +09:00
ensan-hcl
5a7bd0c149 Rename for merge 2023-09-23 14:25:56 +09:00
ensan-hcl
b38e6b6fa4 lint 2023-09-23 01:52:22 +09:00
ensan-hcl
958593dccb Include prediction into learning 2023-09-23 00:19:42 +09:00
ensan-hcl
a1dbbbab3b remove swift 5.9 syntax 2023-09-22 23:08:04 +09:00
ensan-hcl
ae2c193177 Update Prediction logic 2023-09-22 23:00:14 +09:00
ensan-hcl
6c2a93a26c Avoid displaying emoji variations 2023-09-22 19:15:08 +09:00
ensan-hcl
326806e558 add predictionUsable check 2023-09-21 01:28:20 +09:00
ensan-hcl
5ec176c215 fix sort 2023-09-19 23:50:07 +09:00
ensan-hcl
7b63c1c8c9 Reorder candidates 2023-09-19 23:47:15 +09:00
ensan-hcl
920e37797c Update valuation 2023-09-19 23:16:59 +09:00
ensan-hcl
a2c522feac fix minor issue 2023-09-19 23:16:33 +09:00
ensan-hcl
7665e4e375 Add Emoji 2023-09-19 23:12:19 +09:00
ensan-hcl
5ec51132ff Uniquify candidates 2023-09-19 22:30:48 +09:00
ensan-hcl
f5cfe1cf11 Add text property 2023-09-19 22:10:54 +09:00
ensan-hcl
abd896f649 add prediction candidate 2023-09-19 22:08:10 +09:00
ensan-hcl
f163350c0b WIP: implementing zero query prediction 2023-09-19 01:18:36 +09:00
ensan
4e6fbe17e3 feat: promote uppercased characters and refine document 2023-09-15 13:19:04 +09:00
ensan-hcl
eda5c78e44 Add 仮定形 and 連用ヌ接続 2023-09-08 02:00:35 +09:00
ensan-hcl
085b15dc59 add 命令yo and 体現接続特殊 2023-09-08 01:53:55 +09:00
ensan-hcl
4111fa1b25 Add 未然特殊 & 未然ウ接続 cid to supress 2023-09-08 01:48:31 +09:00