opensource/WrenAI
3
0
Fork 0
mirror of https://github.com/Canner/WrenAI.git synced 2026-10-24 02:25:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
546 Commits 175 Branches 503 Tags
ec0c2b4d72f4cb535e65a1db768c81e8360ec1e2
Commit Graph
546 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
dependabot[bot]andChih-Yu Yeh ec0c2b4d72 chore(deps): bump aiohttp (#590) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [aiohttp](https://github.com/aio-libs/aiohttp).


Updates `aiohttp` from 3.9.5 to 3.10.2
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.5...v3.10.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-10 05:17:43 +08:00
dependabot[bot] e4c146ea4a chore(deps): bump github.com/docker/docker (#591) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.1.4+incompatible to 26.1.5+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.1.4...v26.1.5)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-08-10 04:55:54 +08:00
wren-ai[bot] 805f7aaef1 Upgrade AI Service version to 0.8.2 release/ai-service/0.8.2 2024-08-09 03:44:24 +00:00
Pao ShengandChihYu Yeh 92fb3d173a feat(wren-ai-service): question based accuracy metric (#585) 
* chore: update the eval readme

* chore: add faithfulness into generation metrics

* fix: the expression to compute the binary weight

* feat: batch size to avoid the engine connection time out

* feat: add question based accuracy metric

* update default BATCH_INTERVAL

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-09 10:13:23 +08:00
Chih-Yu Yeh d6aae60546 chore(wren-ai-service): refine langfuse (#580) 
* fix LANGFUSE_ENABLE

* refine langfuse metadata and output

* fix bug

* refactor

* refactor
 2024-08-08 11:14:37 +08:00
Chih-Yu Yeh 7bec65b625 chore(wren-ai-service): update dry run api parameter (#584) 2024-08-08 11:09:23 +08:00
Pao Sheng 929fefd240 feat(wren-ai-service): support sub-pipeline evaluation (#582) 
* feat: trace type in metadata

* feat: modify the summary trace information

* chore: correct the log and observe name for indexing pipe

* fix: exclude foreign key from unit

* chore: remove ignored files

* chore: ignore all files in dataset folder

* feat: sub pipe prediction

* feat: sub pipe metrics

* chore: update the sub-pipe evaluation readme

* feat: specify the candidate size in pipeline initialization

* chore: disable package mode

* feat: add the choices to pipeline command
 2024-08-07 16:39:24 +08:00
dependabot[bot]andChih-Yu Yeh 899153be42 chore(deps): bump github.com/docker/docker (#567) 
Bumps the go_modules group with 1 update in the /wren-launcher directory: [github.com/docker/docker](https://github.com/docker/docker).


Updates `github.com/docker/docker` from 26.0.2+incompatible to 26.1.4+incompatible
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.0.2...v26.1.4)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: direct:production
  dependency-group: go_modules
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-06 08:48:57 +08:00
Chih-Yu Yeh 190c85c337 fix(wren-ai-service): disable pass embedding model dim to embedders (#579) 
* allow empty embedding model dim if value < 0

* update dep

* fix embedding model dimension

* add pyproject.toml
 2024-08-05 18:05:19 +08:00
Chih-Yu Yeh af556b0261 feat(wren-ai-service): optimize qdrant for multi users setting (#558) 
* add binary quantization

* allow multi users setting

* user_id backward compatible

* fix test

* fix conflict

* add user_id to indexing

* remove print

* rename user_id to id

* upgrade qdrant to v1.10.1

* update

* allow using qdrant cloud

* update

* enable binary quantization only if embedding model dim >= 1024

* fix tests

* fix test

* revert

* fix mkdir

* simple refactor

* fix
 2024-08-05 13:43:01 +08:00
Pao Sheng 882d71c37d chore(wren-ai-service): pr title validation (#560) 
* feat: pr title validation

* feat: try adding a scope

* feat: upgrade the version to support scopes

* fix: typo in workflow

* chore: add wren-ui into scopes

* chore: upgrade the action version

* chore: add path patterns
 2024-08-02 17:42:36 +08:00
Pao Sheng 4372d0bbea feat(wren-ai-service): add metadata into Langfuse trace (#566) 
* feat: flush the context when service shutdown

* feat: tracing when asking, breaking sql down, and deploying mdl

* feat: define metadata that need to be collected

* docs: update the function document

* feat(api)!: add deploy id, project id, and thread id

* feat: extract the metadata from requests

* feat: get dimension of embedding model and kwargs for generation model

* feat: service metadata on traces

* fix: support the alias choice for deploy id

* feat(api): rename variables in the APIs

* feat: add project id when calling the wren-ui engine dry-run endpoint

* test: unit test for service metadata function

* chore: update poetry lock

* test: trace metadata util

* test: fix a wrong key of ask request

* chore: add type hint for the init global function
 2024-08-02 11:42:01 +08:00
Chih-Yu Yeh efe90ff183 chore(wren-ai-service): eval data curation app updates (#565) 
* fix contexts

* save documents based on contexts

* fix test

* remove deepcopy
0.7.5 		2024-08-01 17:14:54 +08:00
Andy Yen d14a17d025 release 0.7.5 (#573) 2024-08-01 15:47:38 +08:00
dependabot[bot]andChih-Yu Yeh e0ba856654 chore(deps): bump haystack-ai (#572) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [haystack-ai](https://github.com/deepset-ai/haystack).


Updates `haystack-ai` from 2.1.2 to 2.3.1
- [Release notes](https://github.com/deepset-ai/haystack/releases)
- [Commits](https://github.com/deepset-ai/haystack/compare/v2.1.2...v2.3.1)

---
updated-dependencies:
- dependency-name: haystack-ai
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-08-01 14:39:37 +08:00
wren-ai[bot] 47f918497a Upgrade AI Service version to 0.8.1 release/ai-service/0.8.1 2024-08-01 03:56:58 +00:00
Andy Yen d8a16033dd release 0.7.5-rc.2 (#570) 0.7.5-rc.2 2024-07-31 16:50:46 +08:00
Chih-Yu Yeh 679e610c2f chore(wren-ai-service): fix entrypoint (#568) 
* fix entrypoint

* add timeout

* fix

* update

* fix
 2024-07-31 16:40:35 +08:00
Andy Yen 04955bb488 release 0.7.5-rc.1 (#564) 0.7.5-rc.1 2024-07-30 16:04:26 +08:00
Freda Lai 6de58371bb chore(wren-ui): remove unused code (#555) 
* chore(wren-ui): remove dead CSS style

* chore(wren-ui): remove unused component

* chore(wren-ui): remove connection info GraphQL API

* chore(wren-ui): update bootstrap and launcher
 2024-07-29 22:04:01 +08:00
Andy Yen 6ddb1cce4f Chore: adjust telemetry and logger (#556) 
* adjust telemetry and logger

* fix lint issue

* only send message of error and prevent adding large object into event
 2024-07-29 18:30:16 +08:00
Andy Yen 03b41f6e75 Chore(wren-launcher): support passing api key with arg and helper function (#559) 
* support passing api key with arg and helper method

* extends available args when starting launcher

* refactor launch function
 2024-07-29 18:30:02 +08:00
wren-ai[bot] e3fb06dcde Upgrade AI Service version to 0.8.0 release/ai-service/0.8.0 2024-07-29 02:43:27 +00:00
Pao Sheng b59e3d29ee fix(wren-ai-service): error handling for evaluation process (#561) 
* chore: failed count metadata

* feat: handle the error

* fix: avoid the common columns is empty causes list out of range error
 2024-07-29 09:59:42 +08:00
Chih-Yu Yeh 4c848f105b chore(wren-ai-service): small refactoring (#554) 
* refactor indexing service and remove semantics descriptions

* fix preview data

* fix conflicts

* fix ci

* fix test

* fix ci

* remove semantics descriptions

* fix bug

* update
 2024-07-26 15:06:50 +08:00
Chih-Yu Yeh 6604998df6 chore(wren-ai-service): add CONTRIBUTING guide (#552) 
* add CONTRIBUTING guide

* update

* update
 2024-07-26 14:15:02 +08:00
Pao Sheng e76b667e9e feat(wren-ai-service): Implement evaluation metrics (#544) 2024-07-26 10:08:04 +08:00
Shimin 895d3f873a fix(wren-ui): Fix select models duplicated keys issue (#551) 2024-07-24 15:56:57 +08:00
Andy Yen 2d48304ce8 use ibis server to do dry-plan when data source is not duckdb (#550) 2024-07-24 15:54:35 +08:00
Chih-Yu Yeh ca8bd543a6 chore(wren-ai-service): update indexing async components and update tests to async version (#549) 
* update

* fix conflict

* fix conflict

* update

* fix conflict

* remove unused code

* fix bug

* fix conflict

* fix conflict

* fix demo ui

* update

* add sql regenerations api boilerplate

* fix conflicts

* update

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* update sql explanation api and pipeline

* update

* update sql explanation api

* refine sql explanation pipeline

* fix pipeline

* fix conflict

* fix sql formatting

* resolve conflict

* fix bug

* resolve conflict

* fix conflict

* rebase

* make sql_regeneration async

* fix broken import

* fix async await

* use logger.exception instead of logger.error

* fix bugs

* simplify pipeline

* refine prompt

* update sql_explanation api by allowing passing multiple steps of sqls

* remove redundant code

* fix bug

* update ui

* update

* update ui

* update

* fix conflict

* orjson dump and formatting for debug messages

* fix tests

* fix conflict

* fix bugs

* fix bug

* fix conflict

* update

* fix conflict

* update sql explanation results

* fix groupByKeys bug

* update

* update

* update groupByKeys

* update engine configs

* add OTHERS error code

* refine ui: use sidebar

* fix conflict

* fix conflict

* fix bug

* fix imports

* allow users to choose openai llm

* update

* update prompt

* fix bug

* fix tests

* fix bug

* fix conflicts

* update prompt and fix bugs

* update

* fix bug

* fix

* fix engine as wren_ui

* remove unused dataset

* fix sql explanation

* fix groupByKey id

* update

* change EngineConfig location and update .env.dev.example

* give defaults to EngineConfig

* update

* fix

* add async

* add async document writer

* add pytest-asyncio and update tests

* update

* revert

* fix

* fix
 2024-07-24 10:26:48 +08:00
Chih-Yu Yeh 5ab1a4de58 feat(ai-service): feedback loop (#261) 
* update

* fix conflict

* fix conflict

* update

* fix conflict

* remove unused code

* fix bug

* fix conflict

* fix conflict

* fix demo ui

* update

* add sql regenerations api boilerplate

* fix conflicts

* update

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* update sql explanation api and pipeline

* update

* update sql explanation api

* refine sql explanation pipeline

* fix pipeline

* fix conflict

* fix sql formatting

* resolve conflict

* fix bug

* resolve conflict

* fix conflict

* rebase

* make sql_regeneration async

* fix broken import

* fix async await

* use logger.exception instead of logger.error

* fix bugs

* simplify pipeline

* refine prompt

* update sql_explanation api by allowing passing multiple steps of sqls

* remove redundant code

* fix bug

* update ui

* update

* update ui

* update

* fix conflict

* orjson dump and formatting for debug messages

* fix tests

* fix conflict

* fix bugs

* fix bug

* fix conflict

* update

* fix conflict

* update sql explanation results

* fix groupByKeys bug

* update

* update

* update groupByKeys

* update engine configs

* add OTHERS error code

* refine ui: use sidebar

* fix conflict

* fix conflict

* fix bug

* fix imports

* allow users to choose openai llm

* update

* update prompt

* fix bug

* fix tests

* fix bug

* fix conflicts

* update prompt and fix bugs

* update

* fix bug

* fix

* fix engine as wren_ui

* remove unused dataset

* fix sql explanation

* fix groupByKey id

* update

* change EngineConfig location and update .env.dev.example

* give defaults to EngineConfig

* update

* fix
 2024-07-23 18:38:05 +08:00
Shimin 3205d73a04 feat(wren-ui): modify step's preview data empty state (#547) 2024-07-22 12:07:43 +08:00
Andy Yen d023b75735 release 0.8.0-rc.1 (#545) 2024-07-19 18:03:56 +08:00
Andy Yen 970232dff7 release 0.7.4 (#542) 0.7.4 2024-07-19 14:54:16 +08:00
Pao ShengandChihYu Yeh e4dfbb6044 feat(wren-ai-service): Implement the process for the evaluation framework (#525) 
* feat: implement prediction process

* feat: implement evaluation process

* feat: add args to specify the eval dataset path

* feat: add args to specify the path of prediction file

* feat: CLI to trigger prediction and evaluation

* chore: ignore deepeval cache

* feat: flushing langfuse before process done

* feat: support average score as a trace

* chore: add readme for the evaluation framework

* fix: append sys path to eval processes to avoid the import error

* chore: upgrade the deepeval version

* chore: rename the command option

* chore: add terms into README

* enhance: using with open instead open file directly

* feat: specify the config to init providers

* feat: current commit hash and branch into metadata

* feat: async to run prediction task

* feat: unify retrieval context and expected context format in the prediction result file

* feat: current commit hash and branch into metadata for average trace

* reorder import

* update method parameter types

* reorder imports

* chore: add date into the prediction file name

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-07-19 11:03:46 +08:00
wren-ai[bot] 7f22cf862f Upgrade AI Service version to 0.7.4 release/ai-service/0.7.4 2024-07-19 03:01:29 +00:00
Chih-Yu Yeh 0fa6f625a0 feat(wren-ai-service): add gpt-4o-mini (#541) 
* add gpt-4o-mini

* fix docker setup
 2024-07-19 10:20:37 +08:00
Chih-Yu Yeh fee167ac9d Chore/update kustomizations based on new version of wren-ai-service (#514) 
* fix based on default image versions

* remove sqlite

* update kustomizations to the latest version of ai-service, without custom llms

* update instructions

* fix typo
 2024-07-18 15:48:17 +08:00
Chih-Yu Yeh 0a953d482f chore(wren-ai-service): eval refactor for common functions (#536) 
* refactor get_data_from_wren_engine

* add limit

* move common functions for eval to eval/utils.py

* update env
 2024-07-18 13:57:10 +08:00
dependabot[bot] c9d0251a1d chore(deps-dev): bump requests (#530) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [requests](https://github.com/psf/requests).


Updates `requests` from 2.31.0 to 2.32.2
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.31.0...v2.32.2)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:development
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-07-18 13:02:25 +08:00
Chih-Yu Yeh b50bbd2e14 feat(wren-ai-service): evaluation dataset curation app (#398) 
* fix

* fix conflict

* add data curation app boilerplate

* update

* update

* update

* WIP: update

* reoslve conflict

* add context for question sql pairs

* resolve conflict

* fix widget callback issue

* add candidate dataset

* fix bug and add generate_by_user

* update

* resolve conflicts

* update

* update

* WIP: add modify dataset

* finish modify eval dataset

* refine wording

* refine failure output

* fix sql validation

* update usage guide

* add categories to curation app

* allow edit context

* fix conflicts

* sleep for waiting wren-ai-service to restart

* fix wording

* update

* fix

* fix unchoose file error

* update

* fix

* fix dry run endpoint

* fix version

* use wren-engine sql analysis for contexts generation

* add LOG_LEVEL: DEBUG to ibis

* update

* allow users to choose which openai llm to use

* allow users to enter custom instructions for llm

* add data preview for data curation app

* add preview data for user generated sqls and add timeout for openai client

* refactor

* remove unused

* fix imports

* refactor functions

* refactor

* fix bug

* skip installing unneeded packages

* update
0.7.3 		2024-07-17 17:16:30 +08:00
Andy Yen 021c0873c5 release 0.7.3 (#529) 2024-07-17 17:14:57 +08:00
wren-ai[bot] 1211233d75 Upgrade AI Service version to 0.7.3 release/ai-service/0.7.3 2024-07-17 01:50:50 +00:00
Andy Yen 6e52c2a6df Release 0.7.2 (#524) 
* release 0.7.2

* update env.example
0.7.2 		2024-07-16 16:03:36 +08:00
Grieve b89e552838 Add wren eninge as a submodule (#507) 2024-07-16 16:02:54 +08:00
Andy Yen c1d455fbc2 rm instruction (#523) 2024-07-16 13:19:48 +08:00
Andy Yen fe9524c613 remove logs (#521) 2024-07-16 11:42:39 +08:00
Pao Sheng 569dc1a230 fix(wren-ai-service): modify the env ibis service in the dev env example (#517) 
* fix(wren-ai-service): modify the dev env example value for ibis service

* chore: disable langfuse by default and set logging level to debug
 2024-07-16 10:42:02 +08:00
dependabot[bot] e13e8f7308 chore(deps-dev): bump setuptools (#519) 
Bumps the pip group with 1 update in the /wren-ai-service directory: [setuptools](https://github.com/pypa/setuptools).


Updates `setuptools` from 69.5.1 to 70.0.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v69.5.1...v70.0.0)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:development
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-07-16 10:00:13 +08:00
Pao ShengandChih-Yu Yeh 0a1a47d790 chore(wren-ai-service): optimize the PyTest and Image release CI (#508) 
* feat: reduce the time to install poetry and python

* fix(wren-ai-service): remove the duplicate version

* feat: using actions poetry to install poetry

* chore: upgrade the poetry version for CI

* chore: modify the trigger option to reduce the cose

* chore: refactor the github action for release an image

* chore(wren-ai-service): tag for producing changelogs

* feat(wren-ai-service): produce change log in github action

---------

Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
 2024-07-15 15:15:27 +08:00