opensource/WrenAI
3
0
Fork 0
mirror of https://github.com/Canner/WrenAI.git synced 2026-10-24 02:25:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
562 Commits 175 Branches 503 Tags
766f65bde8efb89aeb0a27e4dc67fe21226224aa
Commit Graph
562 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
wren-ai[bot] 766f65bde8 Upgrade AI Service version to 0.8.3 release/ai-service/0.8.3 2024-08-19 04:39:37 +00:00
Freda Lai f2b7491f2f fix(wren-ui): UI layout is broken when selecting a sample dataset (#609) 2024-08-19 11:07:17 +08:00
Chih-Yu Yeh 315f6dfaf9 chore(wren-ai-service): fix historical question pipeline (#611) 2024-08-19 10:48:32 +08:00
Chih-Yu Yeh 6eef7aefe3 chore(wren-ai-service): fix wrong ask candidate number (#610) 2024-08-19 10:46:19 +08:00
Chih-Yu Yeh aa8ff445c3 remove wren-ui (#608) 2024-08-19 10:20:16 +08:00
Pao Sheng 99e9424423 chore(wren-ai-service): custom dependabot commit message and labels (#604) 2024-08-19 09:25:50 +08:00
imAsterSun f4f85a8d36 chore(wren-ai-service): Refine mdl preparation script (#602) 
* deal with csv files

* fix format
 2024-08-15 14:52:21 +08:00
Chih-Yu Yeh f493519459 disable SHOULD_FORCE_DEPLOY by default and enabled only using launcher (#600) 2024-08-14 16:34:15 +08:00
Pao Sheng 778030a6a4 fix(wren-ai-service): expend the timeout and move the waiting check mechanism when force deploying (#601) 
* fix: move the waiting mechanism when force deploy enable

* chore: expend the timeout to 60s
 2024-08-14 16:17:20 +08:00
Chih-Yu Yeh 49333c1b33 chore(wren-ai-service): handle add_quotes error (#595) 2024-08-14 13:09:07 +08:00
Pao Sheng 3a5f62a315 fix(wren-ai-service): error handling for accuracy metric to avoid the select all query failed (#596) 
* chore: add pipe type in session id

* fix: make sure provide the score no matter the metric computing error
 2024-08-14 10:20:54 +08:00
Howard Chi e82fe1590e Update README.md (#598) 
Add preview video
 2024-08-13 23:01:55 +08:00
Chih-Yu Yeh e5f552b4a4 chore(wren-ai-service): minor update (#592) 
* adjust

* update

* add env

* fix bug

* add qdrant_host

* update kustomizations configs

* change AI_SERVICE_ENV to SHOULD_FORCE_DEPLOY

* remove

* update

* update.gitignore

* remove file

* adjust entrypoint
 2024-08-13 14:27:44 +08:00
dependabot[bot] 423e447269 chore(deps-dev): bump streamlit (#594) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [streamlit](https://github.com/streamlit/streamlit).


Updates `streamlit` from 1.34.0 to 1.37.0
- [Release notes](https://github.com/streamlit/streamlit/releases)
- [Commits](https://github.com/streamlit/streamlit/compare/1.34.0...1.37.0)

---
updated-dependencies:
- dependency-name: streamlit
  dependency-type: direct:development
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-13 13:53:24 +08:00
Howard Chi 5dd0a172a7 update readme (#593) 2024-08-12 20:59:04 +08:00
Chih-Yu Yeh 38c34f59b1 chore(wren-ai-service): add script for mdl properties preparation (#589) 2024-08-12 19:20:26 +08:00
dependabot[bot]andChih-Yu Yeh ec0c2b4d72 chore(deps): bump aiohttp (#590) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [aiohttp](https://github.com/aio-libs/aiohttp).


Updates `aiohttp` from 3.9.5 to 3.10.2
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.5...v3.10.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-10 05:17:43 +08:00
dependabot[bot] e4c146ea4a chore(deps): bump github.com/docker/docker (#591) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.1.4+incompatible to 26.1.5+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.1.4...v26.1.5)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-10 04:55:54 +08:00
wren-ai[bot] 805f7aaef1 Upgrade AI Service version to 0.8.2 release/ai-service/0.8.2 2024-08-09 03:44:24 +00:00
Pao ShengandChihYu Yeh 92fb3d173a feat(wren-ai-service): question based accuracy metric (#585) 
* chore: update the eval readme

* chore: add faithfulness into generation metrics

* fix: the expression to compute the binary weight

* feat: batch size to avoid the engine connection time out

* feat: add question based accuracy metric

* update default BATCH_INTERVAL

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-09 10:13:23 +08:00
Chih-Yu Yeh d6aae60546 chore(wren-ai-service): refine langfuse (#580) 
* fix LANGFUSE_ENABLE

* refine langfuse metadata and output

* fix bug

* refactor

* refactor
 2024-08-08 11:14:37 +08:00
Chih-Yu Yeh 7bec65b625 chore(wren-ai-service): update dry run api parameter (#584) 2024-08-08 11:09:23 +08:00
Pao Sheng 929fefd240 feat(wren-ai-service): support sub-pipeline evaluation (#582) 
* feat: trace type in metadata

* feat: modify the summary trace information

* chore: correct the log and observe name for indexing pipe

* fix: exclude foreign key from unit

* chore: remove ignored files

* chore: ignore all files in dataset folder

* feat: sub pipe prediction

* feat: sub pipe metrics

* chore: update the sub-pipe evaluation readme

* feat: specify the candidate size in pipeline initialization

* chore: disable package mode

* feat: add the choices to pipeline command
 2024-08-07 16:39:24 +08:00
dependabot[bot]andChih-Yu Yeh 899153be42 chore(deps): bump github.com/docker/docker (#567) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.0.2+incompatible to 26.1.4+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.0.2...v26.1.4)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-06 08:48:57 +08:00
Chih-Yu Yeh 190c85c337 fix(wren-ai-service): disable pass embedding model dim to embedders (#579) 
* allow empty embedding model dim if value < 0

* update dep

* fix embedding model dimension

* add pyproject.toml
 2024-08-05 18:05:19 +08:00
Chih-Yu Yeh af556b0261 feat(wren-ai-service): optimize qdrant for multi users setting (#558) 
* add binary quantization

* allow multi users setting

* user_id backward compatible

* fix test

* fix conflict

* add user_id to indexing

* remove print

* rename user_id to id

* upgrade qdrant to v1.10.1

* update

* allow using qdrant cloud

* update

* enable binary quantization only if embedding model dim >= 1024

* fix tests

* fix test

* revert

* fix mkdir

* simple refactor

* fix
 2024-08-05 13:43:01 +08:00
Pao Sheng 882d71c37d chore(wren-ai-service): pr title validation (#560) 
* feat: pr title validation

* feat: try adding a scope

* feat: upgrade the version to support scopes

* fix: typo in workflow

* chore: add wren-ui into scopes

* chore: upgrade the action version

* chore: add path patterns
 2024-08-02 17:42:36 +08:00
Pao Sheng 4372d0bbea feat(wren-ai-service): add metadata into Langfuse trace (#566) 
* feat: flush the context when service shutdown

* feat: tracing when asking, breaking sql down, and deploying mdl

* feat: define metadata that need to be collected

* docs: update the function document

* feat(api)!: add deploy id, project id, and thread id

* feat: extract the metadata from requests

* feat: get dimension of embedding model and kwargs for generation model

* feat: service metadata on traces

* fix: support the alias choice for deploy id

* feat(api): rename variables in the APIs

* feat: add project id when calling the wren-ui engine dry-run endpoint

* test: unit test for service metadata function

* chore: update poetry lock

* test: trace metadata util

* test: fix a wrong key of ask request

* chore: add type hint for the init global function
 2024-08-02 11:42:01 +08:00
Chih-Yu Yeh efe90ff183 chore(wren-ai-service): eval data curation app updates (#565) 
* fix contexts

* save documents based on contexts

* fix test

* remove deepcopy
0.7.5 		2024-08-01 17:14:54 +08:00
Andy Yen d14a17d025 release 0.7.5 (#573) 2024-08-01 15:47:38 +08:00
dependabot[bot]andChih-Yu Yeh e0ba856654 chore(deps): bump haystack-ai (#572) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [haystack-ai](https://github.com/deepset-ai/haystack).


Updates `haystack-ai` from 2.1.2 to 2.3.1
- [Release notes](https://github.com/deepset-ai/haystack/releases)
- [Commits](https://github.com/deepset-ai/haystack/compare/v2.1.2...v2.3.1)

---
updated-dependencies:
- dependency-name: haystack-ai
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-01 14:39:37 +08:00
wren-ai[bot] 47f918497a Upgrade AI Service version to 0.8.1 release/ai-service/0.8.1 2024-08-01 03:56:58 +00:00
Andy Yen d8a16033dd release 0.7.5-rc.2 (#570) 0.7.5-rc.2 2024-07-31 16:50:46 +08:00
Chih-Yu Yeh 679e610c2f chore(wren-ai-service): fix entrypoint (#568) 
* fix entrypoint

* add timeout

* fix

* update

* fix
 2024-07-31 16:40:35 +08:00
Andy Yen 04955bb488 release 0.7.5-rc.1 (#564) 0.7.5-rc.1 2024-07-30 16:04:26 +08:00
Freda Lai 6de58371bb chore(wren-ui): remove unused code (#555) 
* chore(wren-ui): remove dead CSS style

* chore(wren-ui): remove unused component

* chore(wren-ui): remove connection info GraphQL API

* chore(wren-ui): update bootstrap and launcher
 2024-07-29 22:04:01 +08:00
Andy Yen 6ddb1cce4f Chore: adjust telemetry and logger (#556) 
* adjust telemetry and logger

* fix lint issue

* only send message of error and prevent adding large object into event
 2024-07-29 18:30:16 +08:00
Andy Yen 03b41f6e75 Chore(wren-launcher): support passing api key with arg and helper function (#559) 
* support passing api key with arg and helper method

* extends available args when starting launcher

* refactor launch function
 2024-07-29 18:30:02 +08:00
wren-ai[bot] e3fb06dcde Upgrade AI Service version to 0.8.0 release/ai-service/0.8.0 2024-07-29 02:43:27 +00:00
Pao Sheng b59e3d29ee fix(wren-ai-service): error handling for evaluation process (#561) 
* chore: failed count metadata

* feat: handle the error

* fix: avoid the common columns is empty causes list out of range error
 2024-07-29 09:59:42 +08:00
Chih-Yu Yeh 4c848f105b chore(wren-ai-service): small refactoring (#554) 
* refactor indexing service and remove semantics descriptions

* fix preview data

* fix conflicts

* fix ci

* fix test

* fix ci

* remove semantics descriptions

* fix bug

* update
 2024-07-26 15:06:50 +08:00
Chih-Yu Yeh 6604998df6 chore(wren-ai-service): add CONTRIBUTING guide (#552) 
* add CONTRIBUTING guide

* update

* update
 2024-07-26 14:15:02 +08:00
Pao Sheng e76b667e9e feat(wren-ai-service): Implement evaluation metrics (#544) 2024-07-26 10:08:04 +08:00
Shimin 895d3f873a fix(wren-ui): Fix select models duplicated keys issue (#551) 2024-07-24 15:56:57 +08:00
Andy Yen 2d48304ce8 use ibis server to do dry-plan when data source is not duckdb (#550) 2024-07-24 15:54:35 +08:00
Chih-Yu Yeh ca8bd543a6 chore(wren-ai-service): update indexing async components and update tests to async version (#549) 
* update

* fix conflict

* fix conflict

* update

* fix conflict

* remove unused code

* fix bug

* fix conflict

* fix conflict

* fix demo ui

* update

* add sql regenerations api boilerplate

* fix conflicts

* update

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* update sql explanation api and pipeline

* update

* update sql explanation api

* refine sql explanation pipeline

* fix pipeline

* fix conflict

* fix sql formatting

* resolve conflict

* fix bug

* resolve conflict

* fix conflict

* rebase

* make sql_regeneration async

* fix broken import

* fix async await

* use logger.exception instead of logger.error

* fix bugs

* simplify pipeline

* refine prompt

* update sql_explanation api by allowing passing multiple steps of sqls

* remove redundant code

* fix bug

* update ui

* update

* update ui

* update

* fix conflict

* orjson dump and formatting for debug messages

* fix tests

* fix conflict

* fix bugs

* fix bug

* fix conflict

* update

* fix conflict

* update sql explanation results

* fix groupByKeys bug

* update

* update

* update groupByKeys

* update engine configs

* add OTHERS error code

* refine ui: use sidebar

* fix conflict

* fix conflict

* fix bug

* fix imports

* allow users to choose openai llm

* update

* update prompt

* fix bug

* fix tests

* fix bug

* fix conflicts

* update prompt and fix bugs

* update

* fix bug

* fix

* fix engine as wren_ui

* remove unused dataset

* fix sql explanation

* fix groupByKey id

* update

* change EngineConfig location and update .env.dev.example

* give defaults to EngineConfig

* update

* fix

* add async

* add async document writer

* add pytest-asyncio and update tests

* update

* revert

* fix

* fix
 2024-07-24 10:26:48 +08:00
Chih-Yu Yeh 5ab1a4de58 feat(ai-service): feedback loop (#261) 
* update

* fix conflict

* fix conflict

* update

* fix conflict

* remove unused code

* fix bug

* fix conflict

* fix conflict

* fix demo ui

* update

* add sql regenerations api boilerplate

* fix conflicts

* update

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* update sql explanation api and pipeline

* update

* update sql explanation api

* refine sql explanation pipeline

* fix pipeline

* fix conflict

* fix sql formatting

* resolve conflict

* fix bug

* resolve conflict

* fix conflict

* rebase

* make sql_regeneration async

* fix broken import

* fix async await

* use logger.exception instead of logger.error

* fix bugs

* simplify pipeline

* refine prompt

* update sql_explanation api by allowing passing multiple steps of sqls

* remove redundant code

* fix bug

* update ui

* update

* update ui

* update

* fix conflict

* orjson dump and formatting for debug messages

* fix tests

* fix conflict

* fix bugs

* fix bug

* fix conflict

* update

* fix conflict

* update sql explanation results

* fix groupByKeys bug

* update

* update

* update groupByKeys

* update engine configs

* add OTHERS error code

* refine ui: use sidebar

* fix conflict

* fix conflict

* fix bug

* fix imports

* allow users to choose openai llm

* update

* update prompt

* fix bug

* fix tests

* fix bug

* fix conflicts

* update prompt and fix bugs

* update

* fix bug

* fix

* fix engine as wren_ui

* remove unused dataset

* fix sql explanation

* fix groupByKey id

* update

* change EngineConfig location and update .env.dev.example

* give defaults to EngineConfig

* update

* fix
 2024-07-23 18:38:05 +08:00
Shimin 3205d73a04 feat(wren-ui): modify step's preview data empty state (#547) 2024-07-22 12:07:43 +08:00
Andy Yen d023b75735 release 0.8.0-rc.1 (#545) 2024-07-19 18:03:56 +08:00
Andy Yen 970232dff7 release 0.7.4 (#542) 0.7.4 2024-07-19 14:54:16 +08:00