 Benjamin Schrothandcubic-dev-ai[bot]
|
d6dcf3b749
|
test(ai-builder): Support evals for agent building and for config evals (no-changelog) (#33888)
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
|
2026-07-15 12:34:21 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
ced861603b
|
test(ai-builder): Move the workflow-eval case corpus to LangTracer (no-changelog) (#33983)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-15 08:58:49 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
2233d720ae
|
ci: Bound and instrument Instance AI eval lane containers (no-changelog) (#33903)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:28:46 +00:00 |
|
|
|
f40e8e6efd
|
feat(core): Align Instance AI intent recognition and evals with the anchor + embeds_other taxonomy (no-changelog) (#33843)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 08:16:46 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
1d61db2252
|
test(ai-builder): Rename response-matches eval check and fix multi-turn wiring (no-changelog) (#32810)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-10 12:58:13 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
a88231544a
|
feat(ai-builder): Persist eval expectation verdicts to LangSmith run outputs (no-changelog) (#33788)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-09 22:21:46 +00:00 |
|
|
Robin BraumannandCursor
|
f25699fe2c
|
test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-07 12:49:32 +00:00 |
|
|
Riqwan ThamirandCursor
|
0775ea114a
|
refactor(core): Remove Instance AI orchestration delegate tool (no-changelog) (#33556)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-07 09:15:26 +00:00 |
|
|
Milorad FIlipović
|
c5d65998da
|
test: Reduce non-builder noise in MCP workflow evals (no-changelog) (#33565)
|
2026-07-06 13:48:11 +00:00 |
|
|
Milorad FIlipović
|
579656db2e
|
test: Parallelize MCP workflow evals across build lanes (no-changelog) (#33468)
|
2026-07-03 08:33:42 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
a8f1b2c1b8
|
ci: Scope Instance AI evals dispatcher to PR gating (no-changelog) (#33499)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-03 07:29:09 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
b3497f0076
|
docs(ai-builder): Expand the create-instance-ai-eval skill (no-changelog) (#33407)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-02 13:01:56 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
65f375bbd4
|
feat(ai-builder): Make eval executionScenarios optional for build-only cases (no-changelog) (#33252)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-30 09:41:14 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
23d70d1bb9
|
feat(ai-builder): Source eval test cases from LangTracer (no-changelog) (#33067)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 10:17:49 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
c3741ce12a
|
feat(ai-builder): Re-run Instance AI evals against the PR head on demand (no-changelog) (#33148)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 06:00:43 +00:00 |
|
|
Milorad FIlipović
|
e12ce0ead0
|
feat(core): Enable LangSmith for mcp evaluations (no-changelog) (#32995)
|
2026-06-25 09:33:22 +00:00 |
|
|
Milorad FIlipović
|
d3dd105aae
|
feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916)
|
2026-06-25 06:33:50 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
fe11536df1
|
feat(ai-builder): Add conversation pre-seeding to workflow evals (no-changelog) (#32196)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-23 17:30:30 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
13239d1cfe
|
feat(ai-builder): Add per-test-case eval credentials via thread credential-view pinning (no-changelog) (#32161)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-22 14:02:57 +00:00 |
|
|
Riqwan Thamir
|
b60bc923d4
|
feat(core): Add ability to view agent traces locally under a flag (no-changelog) (#32397)
|
2026-06-17 08:36:38 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
efc8e28967
|
test(ai-builder): Behaviour eval cases + authoring docs (no-changelog) (#32055)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-11 18:30:54 +00:00 |
|
|
oleg
|
77b95c611d
|
feat(core): Harden Instance AI eval attribution and diagnostics (no-changelog) (#31951)
|
2026-06-09 12:10:10 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
7791a940dd
|
feat(ai-builder): Author-level conversation expectations on eval test cases (no-changelog) (#31787)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-09 10:06:07 +00:00 |
|
|
Milorad FIlipović
|
9bb77cc55e
|
feat(core): Allow deleting pre-built workflows after evaluating (no-changelog) (#31960)
|
2026-06-09 08:50:31 +00:00 |
|
|
olegandRiqwan Thamir
|
52a1a0809a
|
feat(core): Decouple Instance AI workflow verification from planning (#31340)
Co-authored-by: Riqwan Thamir <rmthamir@gmail.com>
|
2026-06-05 10:44:47 +00:00 |
|
|
Albert Alises
|
6cd07e5b42
|
fix: Add item-flow builder guidance (no-changelog) (#31660)
|
2026-06-04 09:23:20 +00:00 |
|
|
Albert Alises
|
332d2df44e
|
fix(core): Move instance AI builds to a skill (#31412)
|
2026-06-02 16:06:00 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
2a1f3d6b2d
|
feat(ai-builder): Add datasets field for PR-tier suite (no-changelog) (#31429)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-02 13:30:31 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
64f25b2ad8
|
feat(core): Show eval-mock executions in canvas list (no-changelog) (#31244)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-02 13:14:51 +00:00 |
|
|
Benjamin Schroth
|
55423cbff1
|
feat(ai-builder): Support binary data in eval mock layer (no-changelog) (#30738)
|
2026-05-29 10:16:22 +00:00 |
|
|
Albert Alises
|
8bb5db3bbd
|
feat(core): Add runtime skills to Instance AI builders (no-changelog) (#30838)
|
2026-05-27 06:54:40 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
700b32237f
|
feat(ai-builder): Surface WHAT-dimension binary checks per built workflow (no-changelog) (#30932)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-26 12:18:52 +01:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
30d9a168bc
|
feat(ai-builder): Add --prebuilt-workflows flag for eval CLI (no-changelog) (#29830)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-07 11:47:29 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
2164afc5df
|
chore(ai-builder): Improve eval comparison alert clarity (no-changelog) (#29929)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-06 21:20:49 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
bbe3e2d148
|
feat(ai-builder): Add per-PR eval regression detection vs LangSmith baseline (#29456)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-06 08:15:08 +00:00 |
|
|
|
fdceec21b9
|
feat: Add pairwise workflow eval pipeline (#29123)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Jaakko Husso <jaakko@n8n.io>
|
2026-05-04 13:26:27 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
e503587854
|
docs: Restructure instanceAI evals README for first-time users (no-changelog) (#29095)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-28 07:22:45 +00:00 |
|
|
Benjamin SchrothandClaude Opus 4.6
|
c961849226
|
feat(ai-builder): Add sub-agent evaluation harness with binary checks (no-changelog) (#28289)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-24 07:50:46 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
16e5f9572f
|
feat(ai-builder): Add LangSmith integration for workflow eval tracking (no-changelog) (#28835)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-23 08:47:02 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.6
|
560f300716
|
test: Add Instance AI workflow evals CI pipeline (no-changelog) (#28366)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-20 14:15:41 +00:00 |
|
|
|
2383749980
|
feat(ai-builder): Workflow evaluation framework with LLM mock execution (#27818)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Arvin A <51036481+DeveloperTheExplorer@users.noreply.github.com>
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
|
2026-04-07 13:31:16 +00:00 |
|