opensource/WrenAI
3
0
Fork 0
mirror of https://github.com/Canner/WrenAI.git synced 2026-10-24 02:25:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
580 Commits 175 Branches 503 Tags
0d41e8858df458309641b016b8071d8b571ba335
Commit Graph
580 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Chih-Yu Yeh 0d41e8858d chore(wren-ai-service): fix view candidate indexing and retrieval (#635) 
* fix conflict

* fix test
 2024-09-03 11:51:16 +08:00
Chih-Yu Yeh 01e82dc1b5 chore(wren-ai-service): fix document meta (#637) 
* debug

* debug

* debug

* debug

* remove print
 2024-09-03 11:39:10 +08:00
Freda Lai 41e307390f chore(wren-ai-service): update doc links (#634) 
* chore(wren-ui): update Wren AI oss doc link

* chore(wren-ai): update README doc link

* chore(launcher): update link

* chore(wren-ai-service): update README doc link
 2024-09-02 16:04:38 +08:00
Andy Yen 2e25e69a15 release 0.8.0-rc.1 (#633) 0.8.0-rc.1 2024-08-30 16:15:25 +08:00
wren-ai[bot] 7135979b65 Upgrade AI Service version to 0.8.6 release/ai-service/0.8.6 2024-08-30 07:01:48 +00:00
Chih-Yu Yeh 4e0acc908f chore(wren-ai-service): retrieval improvement (#599) 
* refactor

* add table description to indexing

* remove print

* rename

* fix conflict

* refine indexing to have columns per batch

* update

* fix

* fix but

* fix bug

* fix

* fix

* update

* update

* fix bug

* update top k

* fix eval

* fix bug

* update

* update

* update

* skip if 0 documents

* fix top k

* delete documents by filters instead of ids

* fix bug

* update

* update

* update

* fix test

* add COLUMN_INDEXING_BATCH_SIZE

* update

* fix bug

* update

* fix bug
 2024-08-30 14:35:26 +08:00
Pao Sheng 19e47f7c4e feat(wren-ai-service): optional attribute user_id for Langfuse metadata (#625) 2024-08-30 10:01:45 +08:00
Andy Yen 41b08b7ad6 add ws resolution (#628) 2024-08-29 17:50:22 +08:00
dependabot[bot] e0b51a49ca chore(deps): bump the npm_and_yarn group across 1 directory with 2 updates (#626) 
Bumps the npm_and_yarn group with 2 updates in the /wren-ui directory: [axios](https://github.com/axios/axios) and [micromatch](https://github.com/micromatch/micromatch).


Updates `axios` from 0.28.1 to 1.7.4
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.28.1...v1.7.4)

Updates `micromatch` from 4.0.5 to 4.0.8
- [Release notes](https://github.com/micromatch/micromatch/releases)
- [Changelog](https://github.com/micromatch/micromatch/blob/master/CHANGELOG.md)
- [Commits](https://github.com/micromatch/micromatch/compare/4.0.5...4.0.8)

---
updated-dependencies:
- dependency-name: axios
  dependency-type: direct:production
  dependency-group: npm_and_yarn
- dependency-name: micromatch
  dependency-type: indirect
  dependency-group: npm_and_yarn
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-29 17:00:35 +08:00
dependabot[bot] 5e48ae004f chore(deps): bump the npm_and_yarn group across 1 directory with 2 updates (#612) 
Bumps the npm_and_yarn group with 2 updates in the /wren-ui directory: [axios](https://github.com/axios/axios) and [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser).


Updates `axios` from 0.28.0 to 0.28.1
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v0.28.1/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.28.0...v0.28.1)

Updates `fast-xml-parser` from 4.3.5 to 4.4.1
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v4.3.5...v4.4.1)

---
updated-dependencies:
- dependency-name: axios
  dependency-type: direct:production
  dependency-group: npm_and_yarn
- dependency-name: fast-xml-parser
  dependency-type: indirect
  dependency-group: npm_and_yarn
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-29 16:36:39 +08:00
wren-ai[bot] f78070b5f4 Upgrade AI Service version to 0.8.5 release/ai-service/0.8.5 2024-08-28 02:54:08 +00:00
Chih-Yu Yeh 8fd86d4185 handle models and columns not found in csv (#621) 2024-08-26 15:18:52 +08:00
Chih-Yu Yeh bbddff3368 chore(wren-ai-service): sql generation improvement (#618) 
* add dspy

* fix typo

* update

* separate sql-summary generation to two pipelines

* add langfuse settings

* disable langfuse by default

* remove dspy
 2024-08-26 14:29:20 +08:00
Howard Chi fee709f0eb Update README.md (#619) 
Update with new blog links
 2024-08-22 22:14:10 +08:00
Himanshu Mendapara 147bcaf274 Feature(wren-ui): Trino data source 
* feat: triono integration support added till graphql

* feat: added testcases for trino integratioin client apis.

* fix: added ui part of trino

* fix: console removed

* fix: connection url changed to adapt ibis server

* fix: enabled trino

* fix: open issues resolved
 2024-08-22 11:49:12 +08:00
wren-ai[bot] 794515969b Upgrade AI Service version to 0.8.4 release/ai-service/0.8.4 2024-08-21 03:03:17 +00:00
Chih-Yu Yeh b5f2dfbeb3 chore(wren-ai-service): fix eval (#614) 
* small refactor

* refactor and show langfuse url for better ux

* refactor

* fix accuracy metric

* refactor

* refactor

* fix conflict

* update

* fix

* remove redundant code
 2024-08-20 18:23:48 +08:00
Chih-Yu Yeh 7a04977fb8 chore(wren-ai-service): update deps (#615) 
* update deps

* upgrade qdrant version to 1.11.0
 2024-08-20 17:53:50 +08:00
wren-ai[bot] 766f65bde8 Upgrade AI Service version to 0.8.3 release/ai-service/0.8.3 2024-08-19 04:39:37 +00:00
Freda Lai f2b7491f2f fix(wren-ui): UI layout is broken when selecting a sample dataset (#609) 2024-08-19 11:07:17 +08:00
Chih-Yu Yeh 315f6dfaf9 chore(wren-ai-service): fix historical question pipeline (#611) 2024-08-19 10:48:32 +08:00
Chih-Yu Yeh 6eef7aefe3 chore(wren-ai-service): fix wrong ask candidate number (#610) 2024-08-19 10:46:19 +08:00
Chih-Yu Yeh aa8ff445c3 remove wren-ui (#608) 2024-08-19 10:20:16 +08:00
Pao Sheng 99e9424423 chore(wren-ai-service): custom dependabot commit message and labels (#604) 2024-08-19 09:25:50 +08:00
imAsterSun f4f85a8d36 chore(wren-ai-service): Refine mdl preparation script (#602) 
* deal with csv files

* fix format
 2024-08-15 14:52:21 +08:00
Chih-Yu Yeh f493519459 disable SHOULD_FORCE_DEPLOY by default and enabled only using launcher (#600) 2024-08-14 16:34:15 +08:00
Pao Sheng 778030a6a4 fix(wren-ai-service): expend the timeout and move the waiting check mechanism when force deploying (#601) 
* fix: move the waiting mechanism when force deploy enable

* chore: expend the timeout to 60s
 2024-08-14 16:17:20 +08:00
Chih-Yu Yeh 49333c1b33 chore(wren-ai-service): handle add_quotes error (#595) 2024-08-14 13:09:07 +08:00
Pao Sheng 3a5f62a315 fix(wren-ai-service): error handling for accuracy metric to avoid the select all query failed (#596) 
* chore: add pipe type in session id

* fix: make sure provide the score no matter the metric computing error
 2024-08-14 10:20:54 +08:00
Howard Chi e82fe1590e Update README.md (#598) 
Add preview video
 2024-08-13 23:01:55 +08:00
Chih-Yu Yeh e5f552b4a4 chore(wren-ai-service): minor update (#592) 
* adjust

* update

* add env

* fix bug

* add qdrant_host

* update kustomizations configs

* change AI_SERVICE_ENV to SHOULD_FORCE_DEPLOY

* remove

* update

* update.gitignore

* remove file

* adjust entrypoint
 2024-08-13 14:27:44 +08:00
dependabot[bot] 423e447269 chore(deps-dev): bump streamlit (#594) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [streamlit](https://github.com/streamlit/streamlit).


Updates `streamlit` from 1.34.0 to 1.37.0
- [Release notes](https://github.com/streamlit/streamlit/releases)
- [Commits](https://github.com/streamlit/streamlit/compare/1.34.0...1.37.0)

---
updated-dependencies:
- dependency-name: streamlit
  dependency-type: direct:development
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-13 13:53:24 +08:00
Howard Chi 5dd0a172a7 update readme (#593) 2024-08-12 20:59:04 +08:00
Chih-Yu Yeh 38c34f59b1 chore(wren-ai-service): add script for mdl properties preparation (#589) 2024-08-12 19:20:26 +08:00
dependabot[bot]andChih-Yu Yeh ec0c2b4d72 chore(deps): bump aiohttp (#590) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [aiohttp](https://github.com/aio-libs/aiohttp).


Updates `aiohttp` from 3.9.5 to 3.10.2
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.5...v3.10.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-10 05:17:43 +08:00
dependabot[bot] e4c146ea4a chore(deps): bump github.com/docker/docker (#591) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.1.4+incompatible to 26.1.5+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.1.4...v26.1.5)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-10 04:55:54 +08:00
wren-ai[bot] 805f7aaef1 Upgrade AI Service version to 0.8.2 release/ai-service/0.8.2 2024-08-09 03:44:24 +00:00
Pao ShengandChihYu Yeh 92fb3d173a feat(wren-ai-service): question based accuracy metric (#585) 
* chore: update the eval readme

* chore: add faithfulness into generation metrics

* fix: the expression to compute the binary weight

* feat: batch size to avoid the engine connection time out

* feat: add question based accuracy metric

* update default BATCH_INTERVAL

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-09 10:13:23 +08:00
Chih-Yu Yeh d6aae60546 chore(wren-ai-service): refine langfuse (#580) 
* fix LANGFUSE_ENABLE

* refine langfuse metadata and output

* fix bug

* refactor

* refactor
 2024-08-08 11:14:37 +08:00
Chih-Yu Yeh 7bec65b625 chore(wren-ai-service): update dry run api parameter (#584) 2024-08-08 11:09:23 +08:00
Pao Sheng 929fefd240 feat(wren-ai-service): support sub-pipeline evaluation (#582) 
* feat: trace type in metadata

* feat: modify the summary trace information

* chore: correct the log and observe name for indexing pipe

* fix: exclude foreign key from unit

* chore: remove ignored files

* chore: ignore all files in dataset folder

* feat: sub pipe prediction

* feat: sub pipe metrics

* chore: update the sub-pipe evaluation readme

* feat: specify the candidate size in pipeline initialization

* chore: disable package mode

* feat: add the choices to pipeline command
 2024-08-07 16:39:24 +08:00
dependabot[bot]andChih-Yu Yeh 899153be42 chore(deps): bump github.com/docker/docker (#567) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.0.2+incompatible to 26.1.4+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.0.2...v26.1.4)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-06 08:48:57 +08:00
Chih-Yu Yeh 190c85c337 fix(wren-ai-service): disable pass embedding model dim to embedders (#579) 
* allow empty embedding model dim if value < 0

* update dep

* fix embedding model dimension

* add pyproject.toml
 2024-08-05 18:05:19 +08:00
Chih-Yu Yeh af556b0261 feat(wren-ai-service): optimize qdrant for multi users setting (#558) 
* add binary quantization

* allow multi users setting

* user_id backward compatible

* fix test

* fix conflict

* add user_id to indexing

* remove print

* rename user_id to id

* upgrade qdrant to v1.10.1

* update

* allow using qdrant cloud

* update

* enable binary quantization only if embedding model dim >= 1024

* fix tests

* fix test

* revert

* fix mkdir

* simple refactor

* fix
 2024-08-05 13:43:01 +08:00
Pao Sheng 882d71c37d chore(wren-ai-service): pr title validation (#560) 
* feat: pr title validation

* feat: try adding a scope

* feat: upgrade the version to support scopes

* fix: typo in workflow

* chore: add wren-ui into scopes

* chore: upgrade the action version

* chore: add path patterns
 2024-08-02 17:42:36 +08:00
Pao Sheng 4372d0bbea feat(wren-ai-service): add metadata into Langfuse trace (#566) 
* feat: flush the context when service shutdown

* feat: tracing when asking, breaking sql down, and deploying mdl

* feat: define metadata that need to be collected

* docs: update the function document

* feat(api)!: add deploy id, project id, and thread id

* feat: extract the metadata from requests

* feat: get dimension of embedding model and kwargs for generation model

* feat: service metadata on traces

* fix: support the alias choice for deploy id

* feat(api): rename variables in the APIs

* feat: add project id when calling the wren-ui engine dry-run endpoint

* test: unit test for service metadata function

* chore: update poetry lock

* test: trace metadata util

* test: fix a wrong key of ask request

* chore: add type hint for the init global function
 2024-08-02 11:42:01 +08:00
Chih-Yu Yeh efe90ff183 chore(wren-ai-service): eval data curation app updates (#565) 
* fix contexts

* save documents based on contexts

* fix test

* remove deepcopy
0.7.5 		2024-08-01 17:14:54 +08:00
Andy Yen d14a17d025 release 0.7.5 (#573) 2024-08-01 15:47:38 +08:00
dependabot[bot]andChih-Yu Yeh e0ba856654 chore(deps): bump haystack-ai (#572) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [haystack-ai](https://github.com/deepset-ai/haystack).


Updates `haystack-ai` from 2.1.2 to 2.3.1
- [Release notes](https://github.com/deepset-ai/haystack/releases)
- [Commits](https://github.com/deepset-ai/haystack/compare/v2.1.2...v2.3.1)

---
updated-dependencies:
- dependency-name: haystack-ai
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-01 14:39:37 +08:00
wren-ai[bot] 47f918497a Upgrade AI Service version to 0.8.1 release/ai-service/0.8.1 2024-08-01 03:56:58 +00:00