Commit Graph
415 Commits
Author SHA1 Message Date
wren-ai[bot] d737726598 Upgrade AI Service version to 0.5.5 2024-06-14 13:03:01 +00:00
Chih-Yu Yeh cd8de6b3b7 fix saved as view number (#420) 2024-06-14 21:02:03 +08:00
william chang(張仲威) 9738e7ad1f release 0.4.1 (#419) 0.4.1 2024-06-14 20:05:39 +08:00
william chang(張仲威) 38a0d0e255 fix(docker): remove redis (#418) 2024-06-14 20:02:38 +08:00
Andy Yen 291e374580 release 0.4.0 (#416) 0.4.0 2024-06-14 19:07:08 +08:00
Andy Yen b652515de6 release 0.4.0-rc.4 (#415) 0.4.0-rc.4 2024-06-14 17:07:19 +08:00
wren-ai[bot] 8a41a357d3 Upgrade AI Service version to 0.5.4 2024-06-14 08:33:27 +00:00
Chih-Yu Yeh 7a169942a5 fix view id issue (#413) 2024-06-14 16:32:34 +08:00
Andy Yen 97d515a215 fix createMany with too much input value issue (#412) 2024-06-14 15:57:21 +08:00
Howard Chi 9d73942fa3 Update README.md 2024-06-14 12:58:41 +08:00
Howard Chi d64238c728 Update README.md 2024-06-14 12:22:52 +08:00
Howard Chi d13cb59e58 Update README.md (#410) 2024-06-14 12:22:07 +08:00
Andy Yen b014e686e3 release 0.4.0-rc.3 (#409) 0.4.0-rc.3 2024-06-14 11:14:45 +08:00
wren-ai[bot] aa55b2941c Upgrade AI Service version to 0.5.3 2024-06-13 15:43:04 +00:00
Pao ShengandChihYu Yeh be0c6412fc feature(wren-ai-service): Enhance the response for Dry-run API to Wren UI and development support (#407)
* enhance: clear the status and error

* chore: docker-compose to start all depends

* update

* remove config.properties

* chore: 10 mins timeout for the ci

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-06-13 23:42:03 +08:00
Andy Yen e5e80845c3 Fix(wren-ui): fix previewSql mutation for doing dry run (#406)
* fix previewSql mutation(doing dry run)
- throw graphql error  back to client  instead of return false
- graphql error contains error code DRY_RUN_ERROR and the error message from ibis/wren-engine back to client

* log info
2024-06-13 18:03:51 +08:00
Howard Chi 38f1dbb696 Update README.md 2024-06-13 15:01:57 +08:00
LiJung Chi 8e0c045991 chore: add vision diagram in the readme 2024-06-13 11:42:28 +08:00
Andy Yen 3c8741f200 release 0.4.0-rc-2 (#405) 0.4.0-rc.2 2024-06-13 07:56:59 +08:00
Andy YenandShimin f4e4551498 Epic: integrate with ibis-server (#403)
* Chore: integrate with ibis server (#306)

* feat: Add ibis adaptor for querying supported data sources

* feat: Add testIbis resolver for querying supported data sources

* feat: use queryService for preview and describe statement

* feat: Refactor ibisAdaptor to use DataSourceName enum consistently

* test ibis using tpch query

* rm test ibis

* feat: Add previewSql resolver for SQL preview

* rm debug log

* use projectId and manifest to generate hash
Implement getMDL api

* pass mdl to ibis server to preview

* transform manifest data type to json object when retrieved from database

* better error message from Ibis server, rewrite host when development and using docker

* use base64 str to transfer mdl

* update README

* change env name to fit naming style.
update docker-compose.x.yaml and .env.example file

* fix yarn build issue

* update docker-compose file: fix incorrent ibis server endpoint

* port forward to ibis server

* fix incorrect migration rollback function

* update engine version

* Chore: refactor database schema to reflect how we use them. (#341)

* add connectionInfo column and do data migration

* drop deprecated columns that store connection info, use connectionInfo column instead

* do data migration to store tableReference in model's properties

* fix incorrect migration rollback function

* use tableReference in mdl instead of refSql

* chore: Update variable names in ibisAdaptor and queryService

* chore: Update variable names in ibisAdaptor and queryService

* fix lint

* rename variable in ibis adaptor

* - remove duplicate logic to parse string
- add comment

* release 0.4.0-rc.1 (#378)

* fix: fix nested resolver to format sql (#379)

* feat(wren-ui): Provide limit property in preview data API for excel-add-in used (#373)

* fix(wren-ui): add displayName to all view API which share ViewInfo type in graphQL

* feat(wren-ui): provide limit property of preview API for usage in excel-add-in

* Chore: minimized the diversity of data sources from wren-ui  (#384)

* chore: Update ibisAdaptor to include methods for getting tables and constraints

* remove strategies and connectors from codebase, use ibis server and wrenEngine to fetch metadata of data source

* add validation rule api in ibisAdapter

* replace invalid char when generating referenceName

* fix comments

* Feature: support dry run in preview API (#402)

* can dry-run  with previewSql

* update env.example and docker-compose-dev.yaml

---------

Co-authored-by: Shimin <andreashimin@gmail.com>
2024-06-12 21:19:05 +08:00
wren-ai[bot] cbb07103e6 Upgrade AI Service version to 0.5.2 2024-06-12 12:23:53 +00:00
Pao Sheng b86cd6f3e2 feature(ai-service): wren-ui dry-run SQL API instead of wren-engine API (#400)
* feat(ai-service): change dryrun api

* feat: change the docker env
2024-06-12 20:20:43 +08:00
a362757431 azure openai provider implementation (#390)
Co-authored-by: Siddharth Kumar <ybsid@Siddharths-MacBook-Pro.local>
Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-06-12 19:49:04 +08:00
wren-ai[bot] d344534a3b Upgrade AI Service version to 0.5.1 2024-06-12 08:19:01 +00:00
Pao Sheng 30746c005e fix: phony demo folder (#394) 2024-06-11 17:31:38 +08:00
Chih-Yu Yeh 0c82002a2f refine readme (#392)
* update readme

* update poetry version to 1.8.3

* explicitly use uvloop

* explicitly using httptools

* use ORJSON

* refine readme
2024-06-11 13:58:28 +08:00
qdrddrandwilliam chang e5483d1c0d fix WrenAI kustomization manifests: add workers env for AI service & fix wren-engine-svc (#389)
fix WrenAI kustomization manifests: add workers env for AI service & fix wren-engine-svc 

---------

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>
2024-06-11 05:20:20 +08:00
qdrddr ff08fc76e8 fix incorrect WREN_ENGINE_ENDPOINT in WrenAI kustomization manifests for k8s (#388) 2024-06-08 01:05:35 +08:00
qdrddr 04f0158866 Fix some bugs & update versions on WrenAI kustomization manifests for k8s (#385)
Fix some bugs & update versions on WrenAI kustomization manifests for k8s
2024-06-07 23:57:23 +08:00
Chih-Yu Yeh d2c5e0cd18 small refactor and upgrade uvicorn version to allow process manager (#386) 2024-06-07 13:59:53 +08:00
wren-ai[bot] 0f51594274 Upgrade AI Service version to 0.5.0 2024-06-06 10:43:30 +00:00
Chih-Yu Yeh 8d8bccfbd7 Chore/ai service/minor update (#382)
* update

* use redis

* update

* fix document store duplicate collection issue

* update timer setting

* fix pre_run and comment out qurey_understanding pipeline

* add redis container

* update redis config

* update redis config

* update redis config

* fix bug

* update dummy api

* add DummyAskUser

* update

* add load test observation notes

* refine wording

* update

* fix missing env

* fix bug
2024-06-06 18:29:30 +08:00
Freda Lai 45a3c828dc feat(wren-ui/e2e): add E2E basic check (#346) 2024-06-06 16:06:23 +08:00
Pao Sheng 3a656dcc99 chore(wren-ai-service): move the development purpose API to the development router (#381) 2024-06-05 15:13:04 +08:00
Chih-Yu Yeh e96c928b36 Chore/ai service/minor updates (#377)
* restructure test folder

* fix WREN_ENGINE_ENDPOINT issue

* add async timer

* update

* use logger.info

* use asyncio.sleep

* use asyncio.sleep

* fix timer to async_timer

* add dummy endpoint

* fix time.sleep

* add WORKER

* add timer

* add LOGGING_LEVEL env

* simplify code

* change to async text/document embedder

* simplify code

* update configs and fix timer
2024-06-05 14:40:35 +08:00
qdrddrandwilliam chang d5dff765c5 WrenAI kustomization manifests for k8s (#318)
* v0.0.1 WrenAI kustomization manifests for k8s by Damien Berezenko https://medium.com/@qdrddr

* Update deployment/README.md

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>

* Update deployment/kustomizations/base/deploy-wren-engine.yaml

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>

* 318

* Update deployment/kustomizations/base/cm.yaml

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>

* Update deployment/kustomizations/README.md

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>

* Update deployment/kustomizations/README.md

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>

* PR v0.0.2 WrenAI kustomization manifests for k8s by Damien Berezenko https://medium.com/@qdrddr

* PR v0.0.2 WrenAI kustomization manifests for k8s by Damien Berezenko https://medium.com/@qdrddr

* PR v0.0.2 WrenAI kustomization manifests for k8s by Damien Berezenko https://medium.com/@qdrddr

* PR v0.0.2 WrenAI kustomization manifests for k8s by Damien Berezenko https://medium.com/@qdrddr

* PR v0.0.2 WrenAI kustomization manifests for k8s by Damien Berezenko https://medium.com/@qdrddr

* PR v0.0.3 WrenAI kustomization manifests for k8s by Damien Berezenko https://medium.com/@qdrddr

---------

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>
2024-06-04 22:06:06 +08:00
HoupusandChih-Yu Yeh 7decf5fbc4 Support 3rd party openai api (#365)
* Support for specifying third-party OPENAI proxy services

* Remove unnecessary changes

* Support for specifying third-party OPENAI proxy services

* update get_generator method

---------

Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-06-04 21:38:23 +08:00
Pao Sheng 963f3c2423 feature(wren-ai-service): support async SQL dry-run and async Qdrant component (#374)
* feature: install aiohttp

* chore: move all related function into the engine module

* feature: validate the sql via aiohttp to communicate with engine

* feature: support qdrant component to async

* chore: using `==` to specify the version for packages
2024-06-04 21:30:16 +08:00
Andy Yen 2c085d37a3 fix lint after upgrade axios (#375) 2024-06-04 19:18:18 +08:00
imAsterSunandAster Sun 4811b8917a Chore(wren-ai-service): adjust locust test (#371)
* update locust file

* remove timer

---------

Co-authored-by: Aster Sun <aster.sun@cannerdata.com>
2024-06-04 16:55:04 +08:00
dependabot[bot] 2e1bfe571f chore(deps): bump google.golang.org/protobuf in /wren-launcher (#350)
Bumps google.golang.org/protobuf from 1.32.0 to 1.33.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-04 15:55:36 +08:00
dependabot[bot] df409feec9 chore(deps): bump github.com/docker/docker in /wren-launcher (#352)
Bumps [github.com/docker/docker](https://github.com/docker/docker) from 26.0.0+incompatible to 26.0.2+incompatible.
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v26.0.0...v26.0.2)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-04 15:14:37 +08:00
dependabot[bot] 33da6206a1 chore(deps): bump golang.org/x/net in /wren-launcher (#353)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.20.0 to 0.23.0.
- [Commits](https://github.com/golang/net/compare/v0.20.0...v0.23.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-04 14:56:09 +08:00
dependabot[bot] 8a1b98dcb4 chore(deps): bump undici from 5.28.3 to 5.28.4 in /wren-ui (#349)
Bumps [undici](https://github.com/nodejs/undici) from 5.28.3 to 5.28.4.
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v5.28.3...v5.28.4)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-04 14:00:38 +08:00
dependabot[bot] d903ef62fb chore(deps): bump axios from 0.27.2 to 0.28.0 in /wren-ui (#351)
Bumps [axios](https://github.com/axios/axios) from 0.27.2 to 0.28.0.
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v0.28.0/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.27.2...v0.28.0)

---
updated-dependencies:
- dependency-name: axios
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-04 13:56:57 +08:00
dependabot[bot] 90a64dce56 chore(deps): bump follow-redirects from 1.15.5 to 1.15.6 in /wren-ui (#348)
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.15.5 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.5...v1.15.6)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-04 13:46:57 +08:00
Pao Sheng 0b05aaa474 feature(wren-ai-service): refactor pipelines of retrieval and historical question (#367)
* chore: update the poetry lock file

* feat: refactor the retrieval pipeline

* feat: add await to start the coroutine

* feat: modify the test case

* feat: refactor the historical question for view pipeline

* fix: correct the test cases

* chore: comment out the generate description test case
2024-06-04 11:17:25 +08:00
Chih-Yu YehandPao-Sheng Wang 047b362aaa Feature/ai service/refactor pipeline using hamilton (#363)
* feat: refactor the indexing pipline with Hamilton

* chore: shorten the pipe name and correct the test cases

* fix: correct the test cases

* make hamilton pipeline cleaner

* simplify pipeline file name

* remove redundant init_post_processor function and refine indexing and followup_generation

* refine ask generation pipeline

* refine ask sql_correction pipeline

* add TODO comment

* refine ask_details generation pipeline

* update tests

---------

Co-authored-by: Pao-Sheng Wang <paooap.oappao@gmail.com>
2024-06-04 11:17:25 +08:00
Pao Sheng 830ebe40b7 feature(wren-ai-service): refactor the query understanding pipe with async (#316)
* feat: add an experiment query understanding pipeline

* exper: add sync pipe for comparison

* exper: using async generator instead

* chore: remove the testing setting and fix the hamilton version

* chore: removing the experiment pipeline

* feat: impl openai async generator

* feat: refactor the pipeline

* feat: change the driver output type

* feat: modify the behavior for ask service

* chore: remove the testing code

* fix: test cases

* fix: ignore timer decorator and fix a key error
2024-06-04 11:17:25 +08:00
2ffa1ebfb6 Feature(wren-ai-service): Ask pipeline load test (#335)
* add ask locust test

* update case

* add logfile setting

* update locustfile

* add sucessful query counter

* adjust mdl path

* update README

* update README

* update README

* add missing env: OPENAI_GENERATION_MODEL

* change locust output folder and simple refactor

* update readme

* update readme

* move files to tests/locust folder

* update test config & readme

* add ask details case

* update readme

---------

Co-authored-by: Aster Sun <aster.sun@cannerdata.com>
Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-06-04 10:22:29 +08:00