Bee
0b1a237290
Unify tool name vars ( #6012 )
...
* Use ClineDefaultTool
* Use ClineDefaultTool
2025-09-05 11:18:55 -07:00
celestial-vault
1ffa4085a6
Remove experimental Sonnet 4 code ( #5527 )
...
* remove sonnet 4 experimental tool definitions and prompting
* remove instances of parseV3 in evals
2025-08-12 22:32:30 -07:00
akfoster
d3c8fbbf1d
chore: remove unused parseAssistantmessageV1 ( #5425 )
...
* chore: remove unused parseAssistantmessageV1
* chore: add PR number to comments
* fix: include full path to PR
2025-08-07 22:21:17 -07:00
pashpashpash
6255ac0a51
added provider flag to diff edit cli ( #5334 )
...
* added provider flag to diff edit cli
* dashboard ux
* more dashboard improvmeents
* native handler instead of just openai
2025-08-05 09:21:12 -07:00
pashpashpash and Cline Evaluation
27bf78ddbd
swapping latest diff algo as default ( #4412 )
...
* swapping latest diff algo as default
* updating
---------
Co-authored-by: Cline Evaluation <cline@example.com >
2025-07-16 15:59:48 -07:00
pashpashpash
e91c8208a3
fix streamlit dashboard to be compatible with both old and new versions of streamlit ( #4922 )
2025-07-16 15:28:02 -07:00
pashpashpash
004b313d20
Update diff edit evals README.md ( #4920 )
...
* Update README.md
* Update README.md
2025-07-16 00:17:14 +05:30
Toshii and Cline Evaluation
36e3f4cdd3
add log + run options ( #4630 )
...
* log + options
* changeset
---------
Co-authored-by: Cline Evaluation <cline@example.com >
2025-07-03 14:54:10 -07:00
Toshii
52571ccee8
base ( #4600 )
2025-07-01 17:08:28 -07:00
Toshii and chi.cat
020ae3006e
adding distance metric safety check to the block-apply, for eval ( #4477 )
...
* diff apply add
Co-authored-by: chi.cat <git@chi.cat >
* fname
* integrate
* optionally save locally
* other cli
* name
* default
* return replacements with match type
* baseline -1
* baseline for evals
* work
* more info
---------
Co-authored-by: chi.cat <git@chi.cat >
2025-06-30 16:11:31 -07:00
98e7fac400
updating diff evals with new algorithm + some nice dashboard updates ( #4473 )
...
* updating diff evals with new algorithm + some nice dashboard updates
* Update evals/diff-edits/dashboard/app.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Cline Evaluation <cline@example.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-06-25 15:47:34 -07:00
pashpashpash and Cline Evaluation
d55a23448d
fixing case in dashboard where no valid results ( #4408 )
...
Co-authored-by: Cline Evaluation <cline@example.com >
2025-06-23 21:04:53 -07:00
pashpashpash and Cline Evaluation
50b43c0559
Diff Evals - Replay feature ( #4407 )
...
* wip
* ok replays
* replays cooking
* docs
---------
Co-authored-by: Cline Evaluation <cline@example.com >
2025-06-23 18:25:26 -07:00
pashpashpash and Cline Evaluation
430074d0c2
diff evals ( #4154 )
...
* cleaning up a bit
* cleaning up some more
* readme
* added max limit
* making it portable
* ignore
* committing plans for now
* strealit hooked up, multi model runs, better db torage
* docs
* VALID attempts
* logging
* more stability
* strategy
* cleaning deps
* docs
* streamlit dashboard work
* dashboard showing bad cases
* better parallelization pt1
* global worker pool for even better more robust parallelization
* bumping up default max parallel requests from 20 -> 80
* better devx
* better docs
* docs
* better devx
* better docs
* better presentation
* dark mode
* removed unused import
---------
Co-authored-by: Cline Evaluation <cline@example.com >
2025-06-20 11:41:16 -07:00
Toshii
336eb46547
replay evals ( #4140 )
2025-06-10 17:11:06 -07:00
Toshii
335086ef36
diff edit evals ( #4112 )
...
* base
* multi parallel
* function registry
* nit
* basic prompt
* support data 1
* types
* types
* input format
* path name
* use helpers
* logs
* claude4 prompt
* handling
* evals history
* verbose
* prints
* var
* cli base
* cli inputs
* sqlite
* v3 diff apply
* thinking tokens
* more metrics
* nit
* new structure
* print
2025-06-09 16:01:27 -07:00
pashpashpash and Cline Evaluation
90b0d6a73b
evals formatting ( #3105 )
...
Co-authored-by: Cline Evaluation <cline@example.com >
2025-04-24 15:26:12 -07:00
pashpashpash and Cline Evaluation
9d9e54360b
activating extension with evals.env ( #3041 )
...
Co-authored-by: Cline Evaluation <cline@example.com >
2025-04-21 15:06:13 -07:00
pashpashpash
e70264a56c
Running Commands Old-School + Living on the Edge with the Latest VSIX ( #2999 )
...
* using ndoe shell instead of vs code terminal for commands + always using latest vsix
* 30s max time for commands in test mode
* removed overwhelming logs
* better 30s termination
2025-04-21 11:00:35 -07:00
pashpashpash
ff3c840021
CLI for orchastrating automated evals ( #2874 )
...
* cli for evals
* preloading with multiple language extensions
* preloading with multiple language extensions
* moving to my repo
* test server
2025-04-14 19:29:49 -07:00
Bee