mii/AzooKeyKanaKanjiConverter
1
0
Fork 0
mirror of https://github.com/mii443/AzooKeyKanaKanjiConverter.git synced 2025-12-03 02:58:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
368 Commits 1 Branch 0 Tags
2cde22d3e2dd67244f7b095e092f23892dd4d566
Commit Graph

368 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Miwa / Ensan
c81f02d6a3 fix: use UTF-8 constraint instead of String 2024-07-04 22:15:25 +09:00
Miwa / Ensan
a50464304c feat: 実装を改善し、単語の途中に非argmaxな文字が出現した場合の処理を安定化 2024-07-04 22:00:35 +09:00
Miwa
d130b8168f Merge pull request #111 from ensan-hcl/feat/fix_learning_application 
fix: zenz-v1の出力を学習の適用時に考慮するよう変更
 2024-07-04 11:01:44 +09:00
Miwa / Ensan
33339216c4 fix: zenz-v1の出力を学習の適用次に考慮するよう変更 2024-07-03 01:21:59 +09:00
Miwa
c6cde79e5c Merge pull request #109 from ensan-hcl/fix/memory 
[Fix] 細かい修正を追加
 2024-06-27 22:57:47 +09:00
Miwa / Ensan
ca74aaae86 fix: 逐次変換時に学習した辞書エントリは素通しするように変更 2024-06-27 22:50:44 +09:00
Miwa / Ensan
a58397b5a6 fix: add save memory trigger 2024-06-27 21:49:06 +09:00
fkunn1326
44c64aabd8 a 2024-06-27 17:53:13 +09:00
fkunn1326
04e80c0e55 env? 2024-06-27 17:51:40 +09:00
fkunn1326
44504bc9e4 gh 2024-06-27 07:08:56 +09:00
fkunn1326
d80a97de28 use nightly build on windows 2024-06-27 07:06:39 +09:00
fkunn1326
1ae832ad2e Merge branch 'develop' of https://github.com/fkunn1326/AzooKeyKanaKanjiConverter into develop 2024-06-27 07:02:30 +09:00
fkunn1326
846ca0aef9 Merge branch 'develop' of https://github.com/ensan-hcl/AzooKeyKanaKanjiConverter into develop 2024-06-27 07:01:51 +09:00
fkunn1326
569d8adc10 for windows 2024-06-27 07:01:46 +09:00
Miwa / Ensan
1b5cc8b68e fix: minor fixes 2024-06-27 01:35:29 +09:00
Miwa / Ensan
493943d379 fix: support isLearned metadata in LearningManager 2024-06-27 00:41:12 +09:00
Miwa
f58f1603d4 feat: Zenzaiで学習機能を有効化する (#108) 
* feat: add metadata for DicdataElement

* feat: ignore learned word in zenz evaluation

* feat: improve session command to support temporal memory
 2024-06-27 00:32:44 +09:00
fkunn1326
bc21a69f58 Merge branch 'ensan-hcl:develop' into develop 2024-06-23 21:00:21 +09:00
Miwa
fbf09a76eb feat: エスケープされた辞書名をサポート（v2.3.b2） (#106) 
* feat: support v2.3.b2 dictionary (https://github.com/ensan-hcl/azooKey_dictionary_storage/pull/3)

* update to v2.3.b2
 2024-06-23 17:53:13 +09:00
Miwa
c2e88ae720 [Fix] 漢数字周りのエラーを修正 (#104) 
* fix: 漢数字変換が正しくない問題を修正

* test: add check for long number inptu
 2024-06-20 23:55:50 +09:00
fkunn1326
d9c8e5098e Update swift.yml 2024-06-18 06:19:45 +09:00
fkunn1326
ea67f84a0c Update swift.yml 2024-06-18 06:18:13 +09:00
Miwa
cce5a634a6 fix link (#100) 2024-05-19 21:39:21 +09:00
Miwa
9b0f5a0987 バージョン表記を変更 (#99) 2024-05-19 21:37:34 +09:00
Miwa
60f724818e [Update] バージョンを更新 (#98) 
* adding zenzai docs

* reversion
 2024-05-19 21:36:26 +09:00
Miwa
545ba4b633 adding zenzai docs (#97) 2024-05-19 20:38:28 +09:00
Miwa
c8ca5b54c0 [Fix] 制約の適用を調整した (#96) 
* zenz-v1側は制約をコードポイントレベルで喋るので、grapheme clusterに非依存の処理に書き換えた

* EOSを考慮するように変更
 2024-05-19 19:35:28 +09:00
Miwa
dfef9631a9 不必要に指定していたlowerを削除 (#95) 2024-05-19 17:43:20 +09:00
Miwa
e3d29f045b Fix Zenz.swift (#94) 2024-05-16 00:02:38 +09:00
Miwa
55ffe3c708 [Experimental] Zenzai (#92) 
* experimental rinna integration

* Update impl

* update

* Bump swift-actions/setup-swift from 1 to 2

Bumps [swift-actions/setup-swift](https://github.com/swift-actions/setup-swift) from 1 to 2.
- [Release notes](https://github.com/swift-actions/setup-swift/releases)
- [Commits](https://github.com/swift-actions/setup-swift/compare/v1...v2)

---
updated-dependencies:
- dependency-name: swift-actions/setup-swift
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* change test

* change impl

* take gpt2 weight as option

* don't use async

* support status check

* enhance error

* avoid percent encode

* update

* GPT-2 based kana-kanji conversion is now perfectly workinggit statusgit status

* fix a bug

* Rename gpt2/llama -> zenz

* cleanup

* internal apiを綺麗にした

* cleanup experimental commands

* update

* partially support incremental input using cache

* fix names

* fix bug

* support roman2kana

* cleanup

* fix minor bugs

* improve logic

* fix minor bug

* fix minor bug

* fix minor bug

* optimize

* optimize performance

* Optimize cache hit

* cli: add anco session command

* fix cache hit bugs

* improve session commands

* maybe this will work better for incremental input environment

* speed up zenzai by using n_best alternatives

* update zenz context

* adding no_typo api

* add inference limit

* fix bug

* reset install_cli

* make package buildable -- but llama.cpp features just do not work at this point because metal is not preprocessed

* add proper availability checks

* change macOS minimum version

* fix several problems

* code cleanup

* enable ubuntu build

* fix build error

* fix ubuntu build

* fix borrowing

* update install_cli.sh

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-15 01:36:45 +09:00
Miwa / Ensan
c4aa3eee76 [cli] 複数の不具合を修正 (#91) 
* stabilize json outpug

* enable entropy calculation for smaller values

* chmod +x
 2024-05-09 00:47:07 +09:00
Miwa / Ensan
5ed0ddb45e cli: add evaluate command (#90) 2024-05-04 16:54:44 +09:00
Miwa / Ensan
861ac7a026 feat: MetadataのAPIをより柔軟にした (#89) 2024-05-04 11:56:09 +09:00
Miwa / Ensan
c211bc36cd [cli] 完全一致変換のみを出力するモードを追加 (#88) 
* cli: add option to report score

* cli: 完全一致変換をサポート
 2024-05-04 11:39:20 +09:00
Miwa / Ensan
3cf83bc05b cli: add option to report score (#87) 2024-05-03 21:56:01 +09:00
Miwa / Ensan
73ed9c02d4 [Fix] 学習データの更新ロジックを修正 (#86) 
* base value should be updated here

* fix logic

* chore: 処理順の変更

* fix: だいぶ怪しい処理を修正

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* debug: add debug print

* fix: use memory stride, not size

* implement: migration from wrong impl

* implement: migration from wrong impl

* cleanup: remove debug codes
 2024-04-30 23:06:36 +09:00
Miwa / Ensan
4f2750ef3e [Tools] 辞書データ解析用のサブコマンドをancoに追加 (#85) 
* base value should be updated here

* feature: implement cli tool for reading louds data

* Update document
 2024-04-29 19:26:28 +09:00
Miwa / Ensan
f17958af47 change max depth (#84) 2024-04-29 17:09:52 +09:00
Miwa / Ensan
ecfb23c780 base value should be updated here (#83) 2024-04-29 17:06:25 +09:00
Miwa / Ensan
d404508bc4 [docs] minor version in README.md (#82) 2024-04-27 23:51:20 +09:00
Miwa / Ensan
b5f634f45e fix: temporary memoryの更新ロジックのバグを修正 (#81) 
* fix: temporary memoryの更新ロジックのバグを修正

* unnecessary diff
 2024-04-22 00:30:51 +09:00
Miwa / Ensan
a5e794d858 [Experimental] 削除操作についてもグラフベースに変更 (#79) 
* switch to ComposingTextV2

* delete操作を実装
 2024-04-09 01:01:12 +09:00
Miwa / Ensan
afabe8a734 implement ComposingTextV2 for practical use (#78) 2024-04-09 00:16:37 +09:00
Miwa / Ensan
7a3f1d3c3c [Experimental] ConvertGraphの差分ベース構築を実装 (#77) 
* 差分ビルドを実装

* テストケース追加
 2024-04-07 23:51:58 +09:00
Miwa / Ensan
5713548f4d Merge pull request #74 from ensan-hcl/experimental/lookupgraph_diff 
[Experimental] LookupGraphの差分ベース構築を実装
 2024-03-31 01:44:45 +09:00
Miwa / Ensan
2e341ea40c format 2024-03-31 01:35:52 +09:00
Miwa / Ensan
ac3b8cd4bf _experimental_additionalの実装にも反映 2024-03-31 01:35:32 +09:00
Miwa / Ensan
199129fd68 lint 2024-03-31 00:11:37 +09:00
Miwa / Ensan
35675207a3 split files 2024-03-31 00:10:38 +09:00
Miwa / Ensan
5714b320da LookupGraphの差分構築を実装 2024-03-31 00:08:54 +09:00