285 Commits
Author SHA1 Message Date
william chang(張仲威) b55b3e17bc feat(wren-ui/api): add view to manifest 2024-04-12 14:33:35 +08:00
Andy Yen e7a69f0042 prevent duplicated workflow triggered (#109) 2024-04-12 14:05:08 +08:00
Pao ShengandChih-Yu Yeh 78775d6631 fix(ai-service): correct the breaking change for ask details evaluation process (#102)
* correct the parameter name

* remove unused attributes in eval process

---------

Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-04-11 23:54:14 +08:00
Howard Chi f6adbf43be Add readme (#105)
* fix conflict

* chore: add why wrenai

* fix: conflict
2024-04-11 22:18:26 +08:00
imAsterSunandAster Sun 0b4b5e7c1a update ask evaluation outputs path in streamlit app (#101)
Co-authored-by: Aster Sun <aster.sun@cannerdata.com>
2024-04-11 16:18:56 +08:00
Chih-Yu Yeh b720d0d9ee Add aster into the author list (#98) 2024-04-10 13:29:40 +08:00
william chang(張仲威) b76402d7d6 Update issue templates (#97)
Update issue templates
2024-04-10 13:14:37 +08:00
william chang(張仲威) 76d4a5bd2d release 0.1.1 (#93)
Release 0.1.1
0.1.1
2024-04-10 10:07:04 +08:00
Andy Yen 7e69acbd21 [DRAFT] Chore(Wren-ui): add github action script for CI (#72)
GitHub action to release image
2024-04-09 20:49:09 +08:00
wren-ai[bot] 70c8141ebc Upgrade AI Service version to 0.2.1 2024-04-09 12:38:04 +00:00
Pao Sheng 0d2dcba3c6 feature(ai-service): push on protected branch that required PR before merging via GitHub APP as the bot (#88)
* upgrade the project version via GitHub APP

* demo github app as the committer

* demo github app as the committer v0.2.0-rc.1

* demo github app as the committer 0.2.0-rc.2

* demo github app as the committer 0.2.0-rc.3

* try to checkout repo with GitHub APP installation token

* failed case

* remove testing code
2024-04-09 19:27:41 +08:00
Chih-Yu Yeh d24cdc1090 Feature(ai-service): refine ask pipeline v2 (#86)
* allow visualization using one file

* remove default argparse option value

* update setup instructions

* add anthropic model pricing

* add container:ubuntu

* undo

* update

* remove unused files

* add logging for ask api results

* fix postprocessor for ask details

* fix bugs for tests and eval and restructure eval-ask

* remove unused code

* update setup instructions

* resolve conflict

* WIP: add eval for sample data

* remove unused env var

* remove unused code

* allow evalaute sample data

* refine eval sample data output

* update ask eval for sampledata output

* fix bug

* remove duplicates of ask generation results and return original sql instead of no sql in sql details pipeline
2024-04-09 19:04:38 +08:00
Howard Chiandwilliam chang f8f82caaf7 Add readme (#92)
fix docs

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>
2024-04-09 18:32:26 +08:00
Howard Chi 55f72fd2e3 add readme (#89)
add readme
2024-04-09 18:10:29 +08:00
Shiminandshimin 13d77c5b09 chore(wren-ui): remove getServerSideProps to prevent slow when page initial load (#90)
Co-authored-by: shimin <shimin@shimins-MacBook-Pro.local>
2024-04-09 16:38:22 +08:00
Andy Yen fd98c18fc2 add inprogress status when check deploy status (#87) 2024-04-09 15:52:36 +08:00
Shimin ea6e1a5d21 chore(wren-ui): add persist dir in config & ignore it (#85) 2024-04-08 17:06:21 +08:00
william chang(張仲威) ea9c793694 release 0.1.0 (#84) 0.1.0 2024-04-08 16:37:43 +08:00
stable-release-bot 24bfeee659 Upgrade AI Service version to 0.2.0 2024-04-08 07:53:30 +00:00
9507838991 Feature(ai service): refine ask/ask details pipelines (#64)
* allow visualization using one file

* remove default argparse option value

* resolve conflict

* resolve conflict

* resolve conflict

* update setup instructions

* resolve conflict

* resolve conflicts

* resolve conflict

* resolve conflict

* resolve conflict

* add anthropic model pricing

* allow change model for anthropic

* resolve conflict

* resolve conflict

* resovle conflict

* resovle conflict

* resolve conflict

* resolve conflict

* add container:ubuntu

* undo

* resolve conflict

* resolve conflict

* resolve conflict

* resolve conflict

* resolve conflict

* update

* resolve conflict

* resolve conflicts

* resolve conflicts

* resolve conflicts

* resolve conflicts

* resolve conflicts

* resolve conflicts

* resolve conflicts

* resolve conflicts

* remove unused files

* resolve conflict

* resolve conflict

* generate ddl from mdl for indexing

* resolve conflict

* resolve conflicts

* eval ask with semantic description (#45)

* update make eval-ask

* add semantic description to mdl before eval

* refine

* add model semantic generation

* simplify make command

* print timestamp

* minor update

---------

Co-authored-by: qa <qa@qadeMacBook-Pro.local>
Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
Co-authored-by: Aster Sun <aster.sun@cannerdata.com>

* remove ;

* simplify prompt

* revert topk

* update prompt

* make default top_k for retriever 10

* generate multiple results for ask pipeline

* resolve conflict

* add followup_generation_pipeline

* add logging for ask api results

* fix generate_mdl issue

* fix ask_details error message

* add extra standard package for uvicorn

* refine ask

* fix postprocessor for ask details

* fix preview data

* fix test

* update prompts

* refine prompts for ask and ask details

* fix prompt

* refine prompt

* remove slash at the end of api endpoints

* refine prompt

* add custom semantic run option

* resolve conflict

* fix bugs for tests and eval and restructure eval-ask

* fix trainling slash and add logging

* remove unused code

* restructure eval ask pipeline outputs

* add comments to the eval command

* change generation component argument name

* add try/except to handle other errors that might happen

* change WREN_AI_SERVICE_VERSION to nightly

* fix eval ask_details errors

* add error message to indexing

---------

Co-authored-by: imAsterSun <61279528+imAsterSun@users.noreply.github.com>
Co-authored-by: qa <qa@qadeMacBook-Pro.local>
Co-authored-by: Aster Sun <aster.sun@cannerdata.com>
Co-authored-by: Pao Sheng <paooap.oappao@gmail.com>
release/ui/0.2.0
2024-04-08 15:44:15 +08:00
william chang(張仲威) b677dd1f77 fix(wren-ui): add memory limit option to yarn build (#83) 2024-04-08 15:43:24 +08:00
william chang(張仲威) 2428c2d2fa fix(wren-launcher): fix checking port used (#82) 2024-04-08 14:25:33 +08:00
william chang(張仲威) efc7a2f675 Feature/cli enhancement (#81)
* feat(wren-launcher): makefile

* feat(wren-launcher): detect os

* fix(wren-launcher): fix panic error recovery and windows open docker

* fix(wren-launcher): use exe extension

* feat(wren-launcher): find available port

* feat(wren-launcher): testing list process of docker API

* feat(wren-launcher): check port not used and if it's used, check if wren-ui is using it
2024-04-08 14:12:56 +08:00
Freda Lai eb8c2cb73d fixup! Chore/docker compose update (#69) (#80) 2024-04-08 14:00:20 +08:00
Freda Lai e5e0eb9fbe chore(wren-ui): remove unnecessary code and files (#75) 2024-04-08 12:21:09 +08:00
Freda Lai 3a3b23682a fix(wren-ui): Update relationship selector validation logic and UI (#77)
* fix(wren-ui): fix to field model list

* fix(wren-ui): fix field validate logic

* feat(wren-ui): update relation modal UI
2024-04-08 12:17:50 +08:00
Shimin 9aaec73e6e chore(wren-ui): add links to UI (#78) 2024-04-08 12:17:32 +08:00
Shiminandshimin c93502031b chore(wren-ui): UI improvement (#76)
* chore(wren-ui): adjust relation wording to relationship

* chore(wren-ui): adjust header color & button style

* chore(wren-ui): adjust styles of home/:id page's answer result

* fix(wren-ui): relationship path enum

---------

Co-authored-by: shimin <shimin@shimins-MacBook-Pro.local>
2024-04-08 12:15:53 +08:00
Freda Lai b84e3655f8 feat(wren-ui): UI integrating API - preview data (#63)
* feat(wren-ui): add home preview data API schema

* feat(wren-ui): support preview data
2024-04-03 17:02:15 +08:00
shimin 157aa8960e chore(wren-ui): add check-types to linting, align lint with build 2024-04-03 16:18:09 +08:00
shimin 463f5ac7a8 chore(wren-ui): add favicon & remove nextjs related svgs 2024-04-03 16:18:09 +08:00
Shiminandshimin 3e47c645a8 feat(wren-ui): Integrating suggested questios API (#73)
* feat(wren-ui): integrating suggested questios API

* fix(wren-ui): fix suggested questions types in resolver

---------

Co-authored-by: shimin <shimin@shimins-MacBook-Pro.local>
2024-04-03 16:17:42 +08:00
Jia-Xuan Liu 9bc20250a4 provide json schema for mdl (#66) 2024-04-03 15:58:01 +08:00
Chih-Yu Yeh 69263e6dd9 Chore/docker compose update (#69)
* update docker related settings

* change WREN_AI_SERVICE_PORT default 5555

* add pull_policy, restart condition and update wren-ai-service port

* fix default port for wren-ai-service
2024-04-03 15:57:09 +08:00
william chang(張仲威) c1c4241c1a Fix preview data issue & making sql formatted in askingTask API (#74)
* fix(wren-ui/askingService): fix sql cte construction issue

* fix(wren-ui/askingResolver): add resovler to ResultCandidate, to sql will be formated as well in askingTask query
2024-04-03 15:51:40 +08:00
Pao Sheng ff7b54e5ba feature(ai-service): fix a wrong input name in the release image workflow (#70) 2024-04-03 11:02:23 +08:00
Pao ShengandChih-Yu Yeh 342f87647d feature(ai-service): automatically create docker image when pr merged (#59)
* support the workflow to build nightly image

* remove the testing branch

* remove the deprecated workflow

* release nightly image workflow

* remove the testing branch

* rename the workflows

* manual release image workflow

* remove the testing branch

* release stable image

* remove the testing code

---------

Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-04-02 23:33:12 +08:00
Andy Yen e03123515e fix suggestedQuestions API (#68) 2024-04-02 19:10:10 +08:00
Freda Lai 4eb49cf5c5 feat(wren-ui): Support sample data UI (#53)
* feat(wren-ui): Support sample data UI

* feat(wren-ui): Use SampleDatasetName enum instead of

* fixup! feat(wren-ui): Support sample data UI
2024-04-02 18:35:25 +08:00
Andy Yen c30cfe05c6 fix lint issue (#65) 2024-04-02 17:53:26 +08:00
Shiminandshimin 8d69cbbe67 feat(wren-ui): Integrating home & home sidebar (#55)
* feat(wren-ui): add home API schema

* feat(wren-ui): integrating query thread to sidebar

* feat(wren-ui): integrating asking task & thread response to home & home/:id

* feat(wren-ui): refine home flow & add thread rename, delete

* fix(wren-ui): response detail steps null error in nested resolver

* style(wren-ui): refine home components style

* style(wren-ui): change no result icon color to gold-6

* refactor(wren-ui): extract asking task to hook & refine thread components arrangement & add error alert to thread response

* feat(wren-ui): add error handlers to askingTask & thread mutation

* fix(wren-ui): fix effect issue when router redirect after thread delete

* fix(wren-ui): fix enum to uppercase & remove unused after rebase conflict

* fix(wren-ui): add status to cancel ask API body & fix 422 error

* chore(wren-ui): extract AI service error detail to logger

---------

Co-authored-by: shimin <shimin@shimins-MacBook-Pro.local>
2024-04-02 15:49:55 +08:00
Andy Yen 3ae0f88de9 avoid deploy multiple time when onboarding with sample dataset (#62) 2024-04-02 15:42:50 +08:00
Pao ShengandChih-Yu Yeh 946f727a4f Implement Ask details pipeline evaluation process (#42)
* add missing prompt builder

* remove the traced component

* todo comment to mention the eval process

* run the example for the ragas evaluator

* update the ignoring pattern for the spider dataset and output folder

* produce the eval context

* refactor the function to produce the eval context

* check whether the evaluation context exists

* test ragas evaluator

* implement a collector to execute the evaluation process

* cost, latency analysis

* modify the structure and todo comment

* modify the result structure

* implement LLM as a Judge

* implement a class to collect all result and summarize the evaluation

* adjust minor details

* support eval different pipeline via make

* remove duplicated pattern in gitignore file

* restructure the eval package

* extract the functions and classes to the utils module

* add streamlit app to present the result

* adjust the structure

* remove the testing suffix for evaluation context

* update the makefile and fix the wrong parameter name in ask details pipeline

* rename the init parameter to make them simplify

* add the original response in post_processor

* modify the report file name format

* use post_process_result to evaluate the sql execution correctness

* use entire CTE query to engine for validating the SQL

* modify the output name

---------

Co-authored-by: Chih-Yu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-04-02 14:31:07 +08:00
Pao Sheng 93da460149 feature(ai-service): automatically re-run the CI after pushing the new commits (#61)
* Path filter detect the files to trigger CI when pushing

* demo

* demo not tirgger

* remove demo files
2024-04-02 14:22:36 +08:00
Freda Lai d8cb45a193 chore(wren-ui): fix warning about sqlite does not support inserting default values (#60) 2024-04-02 10:44:16 +08:00
6834e1c2de feat(wren-ui): UI integrating API to model diagram (#47)
* feat(wren-ui): add diagram API for modeling

* feat(wren-ui): integrating modeling diagram with diagram API

* chore(wren-ui): remove unused adapter, types & model files

* Chore(Wren-ui): remove mock resolver (#48)

* chore: remove mock resolver

* rm empty file

* fix(wren-ui): fix all build error after rebase conflict

* chore(wren-ui): remove usable data source schema

---------

Co-authored-by: shimin <shimin@shimins-MacBook-Pro.local>
Co-authored-by: Andy Yen <38731840+onlyjackfrost@users.noreply.github.com>
2024-04-02 10:41:29 +08:00
Andy Yen d32b02967d Fix: add sample dataset relations and Implement suggestedQuestion api (#58)
* fix(wren-ui): add sample dataset relations

* feature(wren-ui): implement askQuestion API
2024-04-02 10:01:14 +08:00
Pao ShengandChihYu Yeh 8b4d8c90df Feature(ai-service): catch the exceptions for web APIs (#54)
* catch all exceptions via a handler

* catch request validation and unify the response details

* add a test case to validate web error handler

* change http status code of RequestValidationError to 400

---------

Co-authored-by: ChihYu Yeh <chihyu.jimmy.yeh@gmail.com>
2024-04-01 22:16:43 +08:00
william chang(張仲威) 4ff1ae0678 Feature/home api (#41)
* feat(wren-ui): wrenAIAdaptor

* feat(wren-ui): migration file to add thread tables

* feat(wren-ui): ask feature & thread graphql resolver

* feat(wren-ui): thread repository

* feat(wren-ui): finish ask & thread api

* docker-compose for dev

* fix(wren-ui): fix some transformation issues in API

* fix(wren-ui/ask-feature): fix business logics in thread API

* fix(wren-ui): revert some configs back

* feat(wren-ui/ask): add follow-up question support

* support update/delete thread

* feat(wren-ui/ask): finish preview data & show full sql apis

* feat(wren-ui/ask): use allSettle to print error message if a job failed

* feat(wren-ui/ask): remove showsql mutation & put sql into threadResponse.detail

* fix(wren-ui/ask): fix lint issue

* fix(apollo): handle error formating

* error handling

* change of to create in error
2024-04-01 18:19:36 +08:00
Pao Sheng 8127af8e69 verify the openai key (#56) 2024-04-01 16:48:22 +08:00