12 Commits
Author SHA1 Message Date
Andy YenandShimin f4e4551498 Epic: integrate with ibis-server (#403)
* Chore: integrate with ibis server (#306)

* feat: Add ibis adaptor for querying supported data sources

* feat: Add testIbis resolver for querying supported data sources

* feat: use queryService for preview and describe statement

* feat: Refactor ibisAdaptor to use DataSourceName enum consistently

* test ibis using tpch query

* rm test ibis

* feat: Add previewSql resolver for SQL preview

* rm debug log

* use projectId and manifest to generate hash
Implement getMDL api

* pass mdl to ibis server to preview

* transform manifest data type to json object when retrieved from database

* better error message from Ibis server, rewrite host when development and using docker

* use base64 str to transfer mdl

* update README

* change env name to fit naming style.
update docker-compose.x.yaml and .env.example file

* fix yarn build issue

* update docker-compose file: fix incorrent ibis server endpoint

* port forward to ibis server

* fix incorrect migration rollback function

* update engine version

* Chore: refactor database schema to reflect how we use them. (#341)

* add connectionInfo column and do data migration

* drop deprecated columns that store connection info, use connectionInfo column instead

* do data migration to store tableReference in model's properties

* fix incorrect migration rollback function

* use tableReference in mdl instead of refSql

* chore: Update variable names in ibisAdaptor and queryService

* chore: Update variable names in ibisAdaptor and queryService

* fix lint

* rename variable in ibis adaptor

* - remove duplicate logic to parse string
- add comment

* release 0.4.0-rc.1 (#378)

* fix: fix nested resolver to format sql (#379)

* feat(wren-ui): Provide limit property in preview data API for excel-add-in used (#373)

* fix(wren-ui): add displayName to all view API which share ViewInfo type in graphQL

* feat(wren-ui): provide limit property of preview API for usage in excel-add-in

* Chore: minimized the diversity of data sources from wren-ui  (#384)

* chore: Update ibisAdaptor to include methods for getting tables and constraints

* remove strategies and connectors from codebase, use ibis server and wrenEngine to fetch metadata of data source

* add validation rule api in ibisAdapter

* replace invalid char when generating referenceName

* fix comments

* Feature: support dry run in preview API (#402)

* can dry-run  with previewSql

* update env.example and docker-compose-dev.yaml

---------

Co-authored-by: Shimin <andreashimin@gmail.com>
2024-06-12 21:19:05 +08:00
Pao Sheng b86cd6f3e2 feature(ai-service): wren-ui dry-run SQL API instead of wren-engine API (#400)
* feat(ai-service): change dryrun api

* feat: change the docker env
2024-06-12 20:20:43 +08:00
Chih-Yu Yeh 8d8bccfbd7 Chore/ai service/minor update (#382)
* update

* use redis

* update

* fix document store duplicate collection issue

* update timer setting

* fix pre_run and comment out qurey_understanding pipeline

* add redis container

* update redis config

* update redis config

* update redis config

* fix bug

* update dummy api

* add DummyAskUser

* update

* add load test observation notes

* refine wording

* update

* fix missing env

* fix bug
2024-06-06 18:29:30 +08:00
Chih-Yu Yeh e96c928b36 Chore/ai service/minor updates (#377)
* restructure test folder

* fix WREN_ENGINE_ENDPOINT issue

* add async timer

* update

* use logger.info

* use asyncio.sleep

* use asyncio.sleep

* fix timer to async_timer

* add dummy endpoint

* fix time.sleep

* add WORKER

* add timer

* add LOGGING_LEVEL env

* simplify code

* change to async text/document embedder

* simplify code

* update configs and fix timer
2024-06-05 14:40:35 +08:00
Chih-Yu Yeh 1fac9b76f3 chore/small refinements to launcher (#269)
* fix missing envs to posthog

* fix .env.example

* update add openai key instructions

* add missing env vars
2024-05-20 16:17:02 +08:00
Chih-Yu Yehandwilliam chang d75f6d1ed7 allow users to change openai model in launcher (#244)
* ..

* add logs for init_providers

* fix ci

* add openai model url instructions

* fix empty generation model if OPENAI_GENERATION_MODEL is not provided

* Update wren-launcher/utils/docker.go

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>

---------

Co-authored-by: william chang(張仲威) <wwwy3y3@gmail.com>
2024-05-14 08:49:15 +08:00
Chih-Yu Yeh e0fa7dcb91 refine demo site for easier debugging (#174) 2024-04-29 11:23:12 +08:00
william chang(張仲威)andonlyjackfrost 3c4a6f28a6 Feature: support PG connector (#135)
* feat(wren-ui): add new migration file to support pg in project

* feat(wren-ui): add new pg connector

* feat(wren-ui): install required deps to test pg connector

* feat(wren-ui): refactor strategy a bit (put strategy of data sources into different files) and add pg strategy

* feat(wren-ui): add pg support in repository

* feat(wren-ui): support pg in graphql schema

* feat(wren-ui): fix connection reusing issue and add finalization stage for testing

* feat(wren-ui): change to a better file names & structure in tests

* feat(wren-ui): comment out postgres part in docker-compose-dev

* fix(wren-ui): column properties be empty object in pg connector

---------

Co-authored-by: onlyjackfrost <onlyjackfrost@gmail.com>
2024-04-19 19:05:01 +08:00
Chih-Yu Yeh cf02536bb9 Feature/wren ai service/demo lab (#128)
* setup duckdb demo dataset testing

* allow demo to use duckdb demo dataset

* remove debug message

* remove unused command

* update wren-ai-service demo setup and README

* reformat sql, prevent duplicating deployment, update sampledata mdl

* update logger setup and fix preview sql issue

* remove psycopg2

* refine demo setup flow

* revert

* remove unused file

* remove unused dep

* change url

* revert

* add TODO for improvement

* update
2024-04-18 15:51:09 +08:00
william chang(張仲威) a59bafc7f4 feat(wren-launcher): add pg_username & password to accounts file at bootstrap 2024-04-16 11:52:55 +08:00
Chih-Yu Yeh 69263e6dd9 Chore/docker compose update (#69)
* update docker related settings

* change WREN_AI_SERVICE_PORT default 5555

* add pull_policy, restart condition and update wren-ai-service port

* fix default port for wren-ai-service
2024-04-03 15:57:09 +08:00
william chang(張仲威) 4ff1ae0678 Feature/home api (#41)
* feat(wren-ui): wrenAIAdaptor

* feat(wren-ui): migration file to add thread tables

* feat(wren-ui): ask feature & thread graphql resolver

* feat(wren-ui): thread repository

* feat(wren-ui): finish ask & thread api

* docker-compose for dev

* fix(wren-ui): fix some transformation issues in API

* fix(wren-ui/ask-feature): fix business logics in thread API

* fix(wren-ui): revert some configs back

* feat(wren-ui/ask): add follow-up question support

* support update/delete thread

* feat(wren-ui/ask): finish preview data & show full sql apis

* feat(wren-ui/ask): use allSettle to print error message if a job failed

* feat(wren-ui/ask): remove showsql mutation & put sql into threadResponse.detail

* fix(wren-ui/ask): fix lint issue

* fix(apollo): handle error formating

* error handling

* change of to create in error
2024-04-01 18:19:36 +08:00