Commit Graph

18 Commits

Author SHA1 Message Date
96e8f37a01 CI: Androidのビルドサポートを追加 (#142)
* ci: change swift version to stable

* ci: change trigger for test

* revert changes

* ci: fix version

* ci: change display text from branch to tag

* a

* ci

* fix trigger

* fix

* fix for android (use float func)

* ci: heckout with submodules

* ci: remove unneccesary files

* ふぃふぃふぃ

* ci: copy neccesary files

* ci: fix for arm build

* ci: arm

* nn>

* a

* tree

* cp -r

* haaa?

* ci: 大文字と小文字

* ci: re

* ci: copy resource folder

* ci: change path

* ci: default dictionary

* ci: こうか?

* ci: revert changes

* ci: clean workflow

* fix

* n

* a

* ci: incorporate jobs

* fix variable

* fix path

* ci: incorporate android actions to swift.yml

* fix

* ci: fix yaml syntax error

* ci: fix syntax error?

* ci: format

* ci: use valid yml

* ci: use release tag instead of latest tag

* ci: cache

* ci: build llama on android?

* ci: add header include path

* a

* a

* hensu

* fix: llama mock

* uninclude llama

* change os(android) to canimport(andoid)

* a

* remove linux

* a

* n

* ci: check with env value

* fix LLAMA_MOCK

* Update .gitignore
2024-09-30 22:13:01 +09:00
8cf7aabf63 feat: Zenzaiでユーザ辞書を有効化 (#132)
* feat: add 'isFromUserDictionary' attribute

* fix: support dynamic user dict

* feat: ユーザ辞書機能を有効化

* feat: evaluate commandを修正

* fix: avoid using 'consume'

* fix: logic error which damages accuracy

* chore: minor prompt engineering
2024-09-22 01:31:35 +09:00
ca8da67f73 fix: プロフィール付き変換で半角コロンを使うように変更、トークナイザの苦手な文字を削除 2024-09-14 23:14:02 +09:00
4f7bf71908 fix: zenzaiのエラーを修正 2024-08-11 00:52:42 +09:00
20fe93c21d perf: avoid useless calculation 2024-08-07 23:38:59 +09:00
9d31eeee66 chore: swiftlint 2024-08-07 23:10:51 +09:00
1971f6382b feat: enable rich n-best calculation 2024-08-07 01:23:03 +09:00
445361d6dc feat: add next character prediction API and add it to session cli 2024-08-01 15:57:56 +09:00
3770633c44 feat: zenz-v2の文脈による条件づけ機能を活かしたAPIを追加 2024-07-31 00:46:39 +09:00
854fb4b1cf fix: 学習の優先度の調整を実装し、実装のミスを修正 2024-07-04 23:17:00 +09:00
c81f02d6a3 fix: use UTF-8 constraint instead of String 2024-07-04 22:15:25 +09:00
a50464304c feat: 実装を改善し、単語の途中に非argmaxな文字が出現した場合の処理を安定化 2024-07-04 22:00:35 +09:00
33339216c4 fix: zenz-v1の出力を学習の適用次に考慮するよう変更 2024-07-03 01:21:59 +09:00
1b5cc8b68e fix: minor fixes 2024-06-27 01:35:29 +09:00
f58f1603d4 feat: Zenzaiで学習機能を有効化する (#108)
* feat: add metadata for DicdataElement

* feat: ignore learned word in zenz evaluation

* feat: improve session command to support temporal memory
2024-06-27 00:32:44 +09:00
c8ca5b54c0 [Fix] 制約の適用を調整した (#96)
* zenz-v1側は制約をコードポイントレベルで喋るので、grapheme clusterに非依存の処理に書き換えた

* EOSを考慮するように変更
2024-05-19 19:35:28 +09:00
dfef9631a9 不必要に指定していたlowerを削除 (#95) 2024-05-19 17:43:20 +09:00
55ffe3c708 [Experimental] Zenzai (#92)
* experimental rinna integration

* Update impl

* update

* Bump swift-actions/setup-swift from 1 to 2

Bumps [swift-actions/setup-swift](https://github.com/swift-actions/setup-swift) from 1 to 2.
- [Release notes](https://github.com/swift-actions/setup-swift/releases)
- [Commits](https://github.com/swift-actions/setup-swift/compare/v1...v2)

---
updated-dependencies:
- dependency-name: swift-actions/setup-swift
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* change test

* change impl

* take gpt2 weight as option

* don't use async

* support status check

* enhance error

* avoid percent encode

* update

* GPT-2 based kana-kanji conversion is now perfectly workinggit statusgit status

* fix a bug

* Rename gpt2/llama -> zenz

* cleanup

* internal apiを綺麗にした

* cleanup experimental commands

* update

* partially support incremental input using cache

* fix names

* fix bug

* support roman2kana

* cleanup

* fix minor bugs

* improve logic

* fix minor bug

* fix minor bug

* fix minor bug

* optimize

* optimize performance

* Optimize cache hit

* cli: add anco session command

* fix cache hit bugs

* improve session commands

* maybe this will work better for incremental input environment

* speed up zenzai by using n_best alternatives

* update zenz context

* adding no_typo api

* add inference limit

* fix bug

* reset install_cli

* make package buildable -- but llama.cpp features just do not work at this point because metal is not preprocessed

* add proper availability checks

* change macOS minimum version

* fix several problems

* code cleanup

* enable ubuntu build

* fix build error

* fix ubuntu build

* fix borrowing

* update install_cli.sh

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-15 01:36:45 +09:00