Commit Graph

39 Commits

Author SHA1 Message Date
96e8f37a01 CI: Androidのビルドサポートを追加 (#142)
* ci: change swift version to stable

* ci: change trigger for test

* revert changes

* ci: fix version

* ci: change display text from branch to tag

* a

* ci

* fix trigger

* fix

* fix for android (use float func)

* ci: heckout with submodules

* ci: remove unneccesary files

* ふぃふぃふぃ

* ci: copy neccesary files

* ci: fix for arm build

* ci: arm

* nn>

* a

* tree

* cp -r

* haaa?

* ci: 大文字と小文字

* ci: re

* ci: copy resource folder

* ci: change path

* ci: default dictionary

* ci: こうか?

* ci: revert changes

* ci: clean workflow

* fix

* n

* a

* ci: incorporate jobs

* fix variable

* fix path

* ci: incorporate android actions to swift.yml

* fix

* ci: fix yaml syntax error

* ci: fix syntax error?

* ci: format

* ci: use valid yml

* ci: use release tag instead of latest tag

* ci: cache

* ci: build llama on android?

* ci: add header include path

* a

* a

* hensu

* fix: llama mock

* uninclude llama

* change os(android) to canimport(andoid)

* a

* remove linux

* a

* n

* ci: check with env value

* fix LLAMA_MOCK

* Update .gitignore
2024-09-30 22:13:01 +09:00
378c9eb2f3 refactor: ファイルが読み込めなかった際のエラーメッセージを改善し、深刻であるのかをわかりやすくした 2024-09-29 15:58:57 +09:00
d32b90581e fix: dynamic user dictionaryがgetLOUDSDataで効かない問題を修正 2024-09-28 18:14:29 +09:00
0f488d987c fix: Zenzaiが無い状態でもユーザ辞書を有効化 2024-09-28 16:57:47 +09:00
8cf7aabf63 feat: Zenzaiでユーザ辞書を有効化 (#132)
* feat: add 'isFromUserDictionary' attribute

* fix: support dynamic user dict

* feat: ユーザ辞書機能を有効化

* feat: evaluate commandを修正

* fix: avoid using 'consume'

* fix: logic error which damages accuracy

* chore: minor prompt engineering
2024-09-22 01:31:35 +09:00
9f8735a1ae fix: 条件が逆だった問題を修正 2024-09-15 00:53:11 +09:00
971faed131 feat: Zenzaiの利用時にtypo correctionを無効化 2024-09-14 23:58:35 +09:00
18aab0e6f8 dicdataのところを修正
consume外すだけでも普通に通った
swiftわからない
2024-08-04 10:06:29 +09:00
5aa0f52674 Merge branch 'ensan-hcl:develop' into develop 2024-08-04 06:22:54 +09:00
854fb4b1cf fix: 学習の優先度の調整を実装し、実装のミスを修正 2024-07-04 23:17:00 +09:00
846ca0aef9 Merge branch 'develop' of https://github.com/ensan-hcl/AzooKeyKanaKanjiConverter into develop 2024-06-27 07:01:51 +09:00
569d8adc10 for windows 2024-06-27 07:01:46 +09:00
1b5cc8b68e fix: minor fixes 2024-06-27 01:35:29 +09:00
493943d379 fix: support isLearned metadata in LearningManager 2024-06-27 00:41:12 +09:00
f58f1603d4 feat: Zenzaiで学習機能を有効化する (#108)
* feat: add metadata for DicdataElement

* feat: ignore learned word in zenz evaluation

* feat: improve session command to support temporal memory
2024-06-27 00:32:44 +09:00
fbf09a76eb feat: エスケープされた辞書名をサポート(v2.3.b2) (#106)
* feat: support v2.3.b2 dictionary (https://github.com/ensan-hcl/azooKey_dictionary_storage/pull/3)

* update to v2.3.b2
2024-06-23 17:53:13 +09:00
c2e88ae720 [Fix] 漢数字周りのエラーを修正 (#104)
* fix: 漢数字変換が正しくない問題を修正

* test: add check for long number inptu
2024-06-20 23:55:50 +09:00
55ffe3c708 [Experimental] Zenzai (#92)
* experimental rinna integration

* Update impl

* update

* Bump swift-actions/setup-swift from 1 to 2

Bumps [swift-actions/setup-swift](https://github.com/swift-actions/setup-swift) from 1 to 2.
- [Release notes](https://github.com/swift-actions/setup-swift/releases)
- [Commits](https://github.com/swift-actions/setup-swift/compare/v1...v2)

---
updated-dependencies:
- dependency-name: swift-actions/setup-swift
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* change test

* change impl

* take gpt2 weight as option

* don't use async

* support status check

* enhance error

* avoid percent encode

* update

* GPT-2 based kana-kanji conversion is now perfectly workinggit statusgit status

* fix a bug

* Rename gpt2/llama -> zenz

* cleanup

* internal apiを綺麗にした

* cleanup experimental commands

* update

* partially support incremental input using cache

* fix names

* fix bug

* support roman2kana

* cleanup

* fix minor bugs

* improve logic

* fix minor bug

* fix minor bug

* fix minor bug

* optimize

* optimize performance

* Optimize cache hit

* cli: add anco session command

* fix cache hit bugs

* improve session commands

* maybe this will work better for incremental input environment

* speed up zenzai by using n_best alternatives

* update zenz context

* adding no_typo api

* add inference limit

* fix bug

* reset install_cli

* make package buildable -- but llama.cpp features just do not work at this point because metal is not preprocessed

* add proper availability checks

* change macOS minimum version

* fix several problems

* code cleanup

* enable ubuntu build

* fix build error

* fix ubuntu build

* fix borrowing

* update install_cli.sh

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-15 01:36:45 +09:00
73ed9c02d4 [Fix] 学習データの更新ロジックを修正 (#86)
* base value should be updated here

* fix logic

* chore: 処理順の変更

* fix: だいぶ怪しい処理を修正

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* fix: use memory stride, not size

* implement: migration from wrong impl

* implement: migration from wrong impl

* cleanup: remove debug codes
2024-04-30 23:06:36 +09:00
4f2750ef3e [Tools] 辞書データ解析用のサブコマンドをancoに追加 (#85)
* base value should be updated here

* feature: implement cli tool for reading louds data

* Update document
2024-04-29 19:26:28 +09:00
f17958af47 change max depth (#84) 2024-04-29 17:09:52 +09:00
ecfb23c780 base value should be updated here (#83) 2024-04-29 17:06:25 +09:00
b5f634f45e fix: temporary memoryの更新ロジックのバグを修正 (#81)
* fix: temporary memoryの更新ロジックのバグを修正

* unnecessary diff
2024-04-22 00:30:51 +09:00
f593a17d0a Rename osUserDict to dynamicUserDict, indicating more flexibility 2024-02-29 14:15:12 +09:00
bf1cb13631 Simplify prediction candidate search 2024-02-29 01:32:20 +09:00
0795b8cf84 [Experimental] ConvertGraphを実装し、その上での完全一致変換を実装 (#47)
* ConvertGraphを実装し、その上での完全一致変換を実装

* 名前空間を汚染していたので修正

* Implementation completed (without test)

* move directory to use default dictionary

* fix implementations to enable conversion

* add test cases

* Backward searchで発見された候補を明示的に削除

* fix tests

* simplify
2024-02-24 23:21:44 +09:00
784a80c46a [Experimental] InputGraphベースの辞書ルックアップ (#45) 2024-02-23 02:37:59 +09:00
1e5624db47 Fix an issue that dicdata from temproary learning manager are not applied penalty 2023-09-23 18:16:33 +09:00
5a7bd0c149 Rename for merge 2023-09-23 14:25:56 +09:00
958593dccb Include prediction into learning 2023-09-23 00:19:42 +09:00
f163350c0b WIP: implementing zero query prediction 2023-09-19 01:18:36 +09:00
eda5c78e44 Add 仮定形 and 連用ヌ接続 2023-09-08 02:00:35 +09:00
085b15dc59 add 命令yo and 体現接続特殊 2023-09-08 01:53:55 +09:00
4111fa1b25 Add 未然特殊 & 未然ウ接続 cid to supress 2023-09-08 01:48:31 +09:00
131ee846a2 Add the notion of 'prediction usable' 2023-09-08 01:39:59 +09:00
20a602266c Add @inlinable to more cases 2023-08-31 18:29:37 +09:00
fb0c73d519 Add Sendable Conformances 2023-08-02 18:29:33 +09:00
aad755da6f Support Strict concurrency 2023-07-23 18:48:20 +09:00
98bc180c17 Move to root 2023-07-23 00:34:27 +09:00