opensource/WrenAI
3
0
Fork 0
mirror of https://github.com/Canner/WrenAI.git synced 2026-10-24 02:25:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
561 Commits 175 Branches 503 Tags
f2b7491f2f06ea7afa146f52c8f607a4e3e34bd3
Commit Graph
561 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Freda Lai f2b7491f2f fix(wren-ui): UI layout is broken when selecting a sample dataset (#609) 2024-08-19 11:07:17 +08:00
Chih-Yu Yeh 315f6dfaf9 chore(wren-ai-service): fix historical question pipeline (#611) 2024-08-19 10:48:32 +08:00
Chih-Yu Yeh 6eef7aefe3 chore(wren-ai-service): fix wrong ask candidate number (#610) 2024-08-19 10:46:19 +08:00
Chih-Yu Yeh aa8ff445c3 remove wren-ui (#608) 2024-08-19 10:20:16 +08:00
Pao Sheng 99e9424423 chore(wren-ai-service): custom dependabot commit message and labels (#604) 2024-08-19 09:25:50 +08:00
imAsterSun f4f85a8d36 chore(wren-ai-service): Refine mdl preparation script (#602) 
* deal with csv files

* fix format
 2024-08-15 14:52:21 +08:00
Chih-Yu Yeh f493519459 disable SHOULD_FORCE_DEPLOY by default and enabled only using launcher (#600) 2024-08-14 16:34:15 +08:00
Pao Sheng 778030a6a4 fix(wren-ai-service): expend the timeout and move the waiting check mechanism when force deploying (#601) 
* fix: move the waiting mechanism when force deploy enable

* chore: expend the timeout to 60s
 2024-08-14 16:17:20 +08:00
Chih-Yu Yeh 49333c1b33 chore(wren-ai-service): handle add_quotes error (#595) 2024-08-14 13:09:07 +08:00
Pao Sheng 3a5f62a315 fix(wren-ai-service): error handling for accuracy metric to avoid the select all query failed (#596) 
* chore: add pipe type in session id

* fix: make sure provide the score no matter the metric computing error
 2024-08-14 10:20:54 +08:00
Howard Chi e82fe1590e Update README.md (#598) 
Add preview video
 2024-08-13 23:01:55 +08:00
Chih-Yu Yeh e5f552b4a4 chore(wren-ai-service): minor update (#592) 
* adjust

* update

* add env

* fix bug

* add qdrant_host

* update kustomizations configs

* change AI_SERVICE_ENV to SHOULD_FORCE_DEPLOY

* remove

* update

* update.gitignore

* remove file

* adjust entrypoint
 2024-08-13 14:27:44 +08:00
dependabot[bot] 423e447269 chore(deps-dev): bump streamlit (#594) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [streamlit](https://github.com/streamlit/streamlit).


Updates `streamlit` from 1.34.0 to 1.37.0
- [Release notes](https://github.com/streamlit/streamlit/releases)
- [Commits](https://github.com/streamlit/streamlit/compare/1.34.0...1.37.0)

---
updated-dependencies:
- dependency-name: streamlit
  dependency-type: direct:development
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-13 13:53:24 +08:00
Howard Chi 5dd0a172a7 update readme (#593) 2024-08-12 20:59:04 +08:00
Chih-Yu Yeh 38c34f59b1 chore(wren-ai-service): add script for mdl properties preparation (#589) 2024-08-12 19:20:26 +08:00
dependabot[bot]andChih-Yu Yeh ec0c2b4d72 chore(deps): bump aiohttp (#590) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [aiohttp](https://github.com/aio-libs/aiohttp).


Updates `aiohttp` from 3.9.5 to 3.10.2
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.5...v3.10.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-10 05:17:43 +08:00
dependabot[bot] e4c146ea4a chore(deps): bump github.com/docker/docker (#591) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.1.4+incompatible to 26.1.5+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.1.4...v26.1.5)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-10 04:55:54 +08:00
wren-ai[bot] 805f7aaef1 Upgrade AI Service version to 0.8.2 release/ai-service/0.8.2 2024-08-09 03:44:24 +00:00
Pao ShengandChihYu Yeh 92fb3d173a feat(wren-ai-service): question based accuracy metric (#585) 
* chore: update the eval readme

* chore: add faithfulness into generation metrics

* fix: the expression to compute the binary weight

* feat: batch size to avoid the engine connection time out

* feat: add question based accuracy metric

* update default BATCH_INTERVAL

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-09 10:13:23 +08:00
Chih-Yu Yeh d6aae60546 chore(wren-ai-service): refine langfuse (#580) 
* fix LANGFUSE_ENABLE

* refine langfuse metadata and output

* fix bug

* refactor

* refactor
 2024-08-08 11:14:37 +08:00
Chih-Yu Yeh 7bec65b625 chore(wren-ai-service): update dry run api parameter (#584) 2024-08-08 11:09:23 +08:00
Pao Sheng 929fefd240 feat(wren-ai-service): support sub-pipeline evaluation (#582) 
* feat: trace type in metadata

* feat: modify the summary trace information

* chore: correct the log and observe name for indexing pipe

* fix: exclude foreign key from unit

* chore: remove ignored files

* chore: ignore all files in dataset folder

* feat: sub pipe prediction

* feat: sub pipe metrics

* chore: update the sub-pipe evaluation readme

* feat: specify the candidate size in pipeline initialization

* chore: disable package mode

* feat: add the choices to pipeline command
 2024-08-07 16:39:24 +08:00
dependabot[bot]andChih-Yu Yeh 899153be42 chore(deps): bump github.com/docker/docker (#567) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.0.2+incompatible to 26.1.4+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.0.2...v26.1.4)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-06 08:48:57 +08:00
Chih-Yu Yeh 190c85c337 fix(wren-ai-service): disable pass embedding model dim to embedders (#579) 
* allow empty embedding model dim if value < 0

* update dep

* fix embedding model dimension

* add pyproject.toml
 2024-08-05 18:05:19 +08:00
Chih-Yu Yeh af556b0261 feat(wren-ai-service): optimize qdrant for multi users setting (#558) 
* add binary quantization

* allow multi users setting

* user_id backward compatible

* fix test

* fix conflict

* add user_id to indexing

* remove print

* rename user_id to id

* upgrade qdrant to v1.10.1

* update

* allow using qdrant cloud

* update

* enable binary quantization only if embedding model dim >= 1024

* fix tests

* fix test

* revert

* fix mkdir

* simple refactor

* fix
 2024-08-05 13:43:01 +08:00
Pao Sheng 882d71c37d chore(wren-ai-service): pr title validation (#560) 
* feat: pr title validation

* feat: try adding a scope

* feat: upgrade the version to support scopes

* fix: typo in workflow

* chore: add wren-ui into scopes

* chore: upgrade the action version

* chore: add path patterns
 2024-08-02 17:42:36 +08:00
Pao Sheng 4372d0bbea feat(wren-ai-service): add metadata into Langfuse trace (#566) 
* feat: flush the context when service shutdown

* feat: tracing when asking, breaking sql down, and deploying mdl

* feat: define metadata that need to be collected

* docs: update the function document

* feat(api)!: add deploy id, project id, and thread id

* feat: extract the metadata from requests

* feat: get dimension of embedding model and kwargs for generation model

* feat: service metadata on traces

* fix: support the alias choice for deploy id

* feat(api): rename variables in the APIs

* feat: add project id when calling the wren-ui engine dry-run endpoint

* test: unit test for service metadata function

* chore: update poetry lock

* test: trace metadata util

* test: fix a wrong key of ask request

* chore: add type hint for the init global function
 2024-08-02 11:42:01 +08:00
Chih-Yu Yeh efe90ff183 chore(wren-ai-service): eval data curation app updates (#565) 
* fix contexts

* save documents based on contexts

* fix test

* remove deepcopy
0.7.5 		2024-08-01 17:14:54 +08:00
Andy Yen d14a17d025 release 0.7.5 (#573) 2024-08-01 15:47:38 +08:00
dependabot[bot]andChih-Yu Yeh e0ba856654 chore(deps): bump haystack-ai (#572) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [haystack-ai](https://github.com/deepset-ai/haystack).


Updates `haystack-ai` from 2.1.2 to 2.3.1
- [Release notes](https://github.com/deepset-ai/haystack/releases)
- [Commits](https://github.com/deepset-ai/haystack/compare/v2.1.2...v2.3.1)

---
updated-dependencies:
- dependency-name: haystack-ai
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-01 14:39:37 +08:00
wren-ai[bot] 47f918497a Upgrade AI Service version to 0.8.1 release/ai-service/0.8.1 2024-08-01 03:56:58 +00:00
Andy Yen d8a16033dd release 0.7.5-rc.2 (#570) 0.7.5-rc.2 2024-07-31 16:50:46 +08:00
Chih-Yu Yeh 679e610c2f chore(wren-ai-service): fix entrypoint (#568) 
* fix entrypoint

* add timeout

* fix

* update

* fix
 2024-07-31 16:40:35 +08:00
Andy Yen 04955bb488 release 0.7.5-rc.1 (#564) 0.7.5-rc.1 2024-07-30 16:04:26 +08:00
Freda Lai 6de58371bb chore(wren-ui): remove unused code (#555) 
* chore(wren-ui): remove dead CSS style

* chore(wren-ui): remove unused component

* chore(wren-ui): remove connection info GraphQL API

* chore(wren-ui): update bootstrap and launcher
 2024-07-29 22:04:01 +08:00
Andy Yen 6ddb1cce4f Chore: adjust telemetry and logger (#556) 
* adjust telemetry and logger

* fix lint issue

* only send message of error and prevent adding large object into event
 2024-07-29 18:30:16 +08:00
Andy Yen 03b41f6e75 Chore(wren-launcher): support passing api key with arg and helper function (#559) 
* support passing api key with arg and helper method

* extends available args when starting launcher

* refactor launch function
 2024-07-29 18:30:02 +08:00
wren-ai[bot] e3fb06dcde Upgrade AI Service version to 0.8.0 release/ai-service/0.8.0 2024-07-29 02:43:27 +00:00
Pao Sheng b59e3d29ee fix(wren-ai-service): error handling for evaluation process (#561) 
* chore: failed count metadata

* feat: handle the error

* fix: avoid the common columns is empty causes list out of range error
 2024-07-29 09:59:42 +08:00
Chih-Yu Yeh 4c848f105b chore(wren-ai-service): small refactoring (#554) 
* refactor indexing service and remove semantics descriptions

* fix preview data

* fix conflicts

* fix ci

* fix test

* fix ci

* remove semantics descriptions

* fix bug

* update
 2024-07-26 15:06:50 +08:00
Chih-Yu Yeh 6604998df6 chore(wren-ai-service): add CONTRIBUTING guide (#552) 
* add CONTRIBUTING guide

* update

* update
 2024-07-26 14:15:02 +08:00
Pao Sheng e76b667e9e feat(wren-ai-service): Implement evaluation metrics (#544) 2024-07-26 10:08:04 +08:00
Shimin 895d3f873a fix(wren-ui): Fix select models duplicated keys issue (#551) 2024-07-24 15:56:57 +08:00
Andy Yen 2d48304ce8 use ibis server to do dry-plan when data source is not duckdb (#550) 2024-07-24 15:54:35 +08:00
Chih-Yu Yeh ca8bd543a6 chore(wren-ai-service): update indexing async components and update tests to async version (#549) 
* update

* fix conflict

* fix conflict

* update

* fix conflict

* remove unused code

* fix bug

* fix conflict

* fix conflict

* fix demo ui

* update

* add sql regenerations api boilerplate

* fix conflicts

* update

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* update sql explanation api and pipeline

* update

* update sql explanation api

* refine sql explanation pipeline

* fix pipeline

* fix conflict

* fix sql formatting

* resolve conflict

* fix bug

* resolve conflict

* fix conflict

* rebase

* make sql_regeneration async

* fix broken import

* fix async await

* use logger.exception instead of logger.error

* fix bugs

* simplify pipeline

* refine prompt

* update sql_explanation api by allowing passing multiple steps of sqls

* remove redundant code

* fix bug

* update ui

* update

* update ui

* update

* fix conflict

* orjson dump and formatting for debug messages

* fix tests

* fix conflict

* fix bugs

* fix bug

* fix conflict

* update

* fix conflict

* update sql explanation results

* fix groupByKeys bug

* update

* update

* update groupByKeys

* update engine configs

* add OTHERS error code

* refine ui: use sidebar

* fix conflict

* fix conflict

* fix bug

* fix imports

* allow users to choose openai llm

* update

* update prompt

* fix bug

* fix tests

* fix bug

* fix conflicts

* update prompt and fix bugs

* update

* fix bug

* fix

* fix engine as wren_ui

* remove unused dataset

* fix sql explanation

* fix groupByKey id

* update

* change EngineConfig location and update .env.dev.example

* give defaults to EngineConfig

* update

* fix

* add async

* add async document writer

* add pytest-asyncio and update tests

* update

* revert

* fix

* fix
 2024-07-24 10:26:48 +08:00
Chih-Yu Yeh 5ab1a4de58 feat(ai-service): feedback loop (#261) 
* update

* fix conflict

* fix conflict

* update

* fix conflict

* remove unused code

* fix bug

* fix conflict

* fix conflict

* fix demo ui

* update

* add sql regenerations api boilerplate

* fix conflicts

* update

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* update sql explanation api and pipeline

* update

* update sql explanation api

* refine sql explanation pipeline

* fix pipeline

* fix conflict

* fix sql formatting

* resolve conflict

* fix bug

* resolve conflict

* fix conflict

* rebase

* make sql_regeneration async

* fix broken import

* fix async await

* use logger.exception instead of logger.error

* fix bugs

* simplify pipeline

* refine prompt

* update sql_explanation api by allowing passing multiple steps of sqls

* remove redundant code

* fix bug

* update ui

* update

* update ui

* update

* fix conflict

* orjson dump and formatting for debug messages

* fix tests

* fix conflict

* fix bugs

* fix bug

* fix conflict

* update

* fix conflict

* update sql explanation results

* fix groupByKeys bug

* update

* update

* update groupByKeys

* update engine configs

* add OTHERS error code

* refine ui: use sidebar

* fix conflict

* fix conflict

* fix bug

* fix imports

* allow users to choose openai llm

* update

* update prompt

* fix bug

* fix tests

* fix bug

* fix conflicts

* update prompt and fix bugs

* update

* fix bug

* fix

* fix engine as wren_ui

* remove unused dataset

* fix sql explanation

* fix groupByKey id

* update

* change EngineConfig location and update .env.dev.example

* give defaults to EngineConfig

* update

* fix
 2024-07-23 18:38:05 +08:00
Shimin 3205d73a04 feat(wren-ui): modify step's preview data empty state (#547) 2024-07-22 12:07:43 +08:00
Andy Yen d023b75735 release 0.8.0-rc.1 (#545) 2024-07-19 18:03:56 +08:00
Andy Yen 970232dff7 release 0.7.4 (#542) 0.7.4 2024-07-19 14:54:16 +08:00
Pao ShengandChihYu Yeh e4dfbb6044 feat(wren-ai-service): Implement the process for the evaluation framework (#525) 
* feat: implement prediction process

* feat: implement evaluation process

* feat: add args to specify the eval dataset path

* feat: add args to specify the path of prediction file

* feat: CLI to trigger prediction and evaluation

* chore: ignore deepeval cache

* feat: flushing langfuse before process done

* feat: support average score as a trace

* chore: add readme for the evaluation framework

* fix: append sys path to eval processes to avoid the import error

* chore: upgrade the deepeval version

* chore: rename the command option

* chore: add terms into README

* enhance: using with open instead open file directly

* feat: specify the config to init providers

* feat: current commit hash and branch into metadata

* feat: async to run prediction task

* feat: unify retrieval context and expected context format in the prediction result file

* feat: current commit hash and branch into metadata for average trace

* reorder import

* update method parameter types

* reorder imports

* chore: add date into the prediction file name

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-07-19 11:03:46 +08:00