 Benjamin Schrothandcubic-dev-ai[bot]
|
d6dcf3b749
|
test(ai-builder): Support evals for agent building and for config evals (no-changelog) (#33888)
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
|
2026-07-15 12:34:21 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
2233d720ae
|
ci: Bound and instrument Instance AI eval lane containers (no-changelog) (#33903)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:28:46 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
3bc2292c78
|
test(ai-builder): Treat answer-only cases as valid without a built workflow (no-changelog) (#33942)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-10 21:54:14 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
13c95f2c05
|
fix(ai-builder): Eliminate non-builder noise families in workflow evals (no-changelog) (#33944)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-10 13:25:29 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
7dd065a77b
|
feat(ai-builder): Scale eval budgets by case complexity and bound the heaviest prompts (no-changelog) (#33950)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-10 12:58:17 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
1d61db2252
|
test(ai-builder): Rename response-matches eval check and fix multi-turn wiring (no-changelog) (#32810)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-10 12:58:13 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
35632ce3ab
|
fix(ai-builder): Sync execution scenarios on lang-tracer push updates (no-changelog) (#33841)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-10 12:50:12 +00:00 |
|
|
Riqwan ThamirandCursor
|
345b7aaabe
|
perf(core): Reduce Instance AI initial tool context (no-changelog) (#33815)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-10 07:59:35 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
a88231544a
|
feat(ai-builder): Persist eval expectation verdicts to LangSmith run outputs (no-changelog) (#33788)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-09 22:21:46 +00:00 |
|
|
|
e6dee743e6
|
test(ai-builder): Add advanced user-behavior multi-turn eval cases (no-changelog) (#31758)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: José Braulio González Valido <josebragv@gmail.com>
|
2026-07-09 18:13:42 +00:00 |
|
|
|
5c6544af4a
|
feat(core): Port agent builder skills and tools to Instance AI (no-changelog) (#33384)
Co-authored-by: Robin Braumann <robin.braumann@n8n.io>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: bjorger <50590409+bjorger@users.noreply.github.com>
Co-authored-by: Michael Drury <michael.drury@n8n.io>
Co-authored-by: Michael Drury <me@michaeldrury.co.uk>
|
2026-07-08 12:41:12 +00:00 |
|
|
Mutasem AldmourandClaude Opus 4.8
|
c79184b5a5
|
feat(core): Add eval:langtracer-push to push eval cases to a suite (no-changelog) (#33781)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-08 07:52:23 +00:00 |
|
|
Robin BraumannandCursor
|
f25699fe2c
|
test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-07 12:49:32 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
a89f85b052
|
fix(ai-builder): Make eval verifier resilient to stalls and exclude no-verdict runs from scoring (no-changelog) (#33562)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-07 08:29:53 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
eb59191076
|
feat(ai-builder): Capture compiled workflow JSON as a trace event for eval seed reconstruction (no-changelog) (#33302)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-06 15:03:38 +00:00 |
|
|
Milorad FIlipović
|
c5d65998da
|
test: Reduce non-builder noise in MCP workflow evals (no-changelog) (#33565)
|
2026-07-06 13:48:11 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
7fc1e4e791
|
fix(ai-builder): Track consolidated-tool data table creations for eval cleanup (no-changelog) (#33580)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-06 09:51:36 +00:00 |
|
|
Albert Alises
|
2be4092c4d
|
fix(core): Improve Instance AI workflow-building reliability (#33530)
|
2026-07-03 13:27:45 +00:00 |
|
|
Milorad FIlipović
|
579656db2e
|
test: Parallelize MCP workflow evals across build lanes (no-changelog) (#33468)
|
2026-07-03 08:33:42 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
a8f1b2c1b8
|
ci: Scope Instance AI evals dispatcher to PR gating (no-changelog) (#33499)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-03 07:29:09 +00:00 |
|
|
oleg
|
6f0d30fbb1
|
fix: Improve AI Assistant post-build follow-ups (#33419)
|
2026-07-02 11:34:21 +00:00 |
|
|
Milorad FIlipović
|
3f3b3a756c
|
fix(core): Harden MCP eval execution against transient network errors (no-changelog) (#33398)
|
2026-07-02 08:51:49 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
65f375bbd4
|
feat(ai-builder): Make eval executionScenarios optional for build-only cases (no-changelog) (#33252)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-30 09:41:14 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
7ea6900e58
|
feat(ai-builder): Honor seedThread.liveTurnRunId in eval reconstruction (no-changelog) (#33251)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-30 09:34:10 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
b8a993a2ed
|
test(ai-builder): Render full judge text for eval failures, warn only on barely-passed units (no-changelog) (#33127)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-30 09:30:35 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
1d28330d18
|
feat(ai-builder): Dual-tenant LangSmith reads for Instance AI evals (no-changelog) (#33230)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 17:17:14 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
23d70d1bb9
|
feat(ai-builder): Source eval test cases from LangTracer (no-changelog) (#33067)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 10:17:49 +00:00 |
|
|
Arvin A
|
9b7451f387
|
ci: Record git provenance metadata on eval experiments (no-changelog) (#33024)
|
2026-06-29 09:12:31 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
c3741ce12a
|
feat(ai-builder): Re-run Instance AI evals against the PR head on demand (no-changelog) (#33148)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 06:00:43 +00:00 |
|
|
oleg
|
a00ac2722c
|
fix(core): Make AI Assistant workflow verification and setup repeatable (#33085)
Signed-off-by: Oleg Ivaniv <me@olegivaniv.com>
|
2026-06-26 13:39:28 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
3380ca3790
|
fix(ai-builder): Reconstruct file-based seeded workflows and judge the whole conversation (no-changelog) (#33048)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-26 10:06:20 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
d78aba164e
|
test(ai-builder): Add absolute green-gate verdict for pr-tier evals (no-changelog) (#32984)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-26 10:00:06 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
5fc00bf17d
|
fix(ai-builder): Guard optional conversation in run-debug report label (no-changelog) (#32883)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-25 12:24:26 +00:00 |
|
|
Milorad FIlipović
|
5b77a717b0
|
fix(core): Handle array-style conversations in mcp evals (no-changelog) (#33013)
|
2026-06-25 11:53:57 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
974e7be09b
|
fix(ai-builder): Scope seedThread reconstruction and add per-turn tool counts for the judge (no-changelog) (#32962)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-25 10:56:59 +00:00 |
|
|
Milorad FIlipović
|
e12ce0ead0
|
feat(core): Enable LangSmith for mcp evaluations (no-changelog) (#32995)
|
2026-06-25 09:33:22 +00:00 |
|
|
Milorad FIlipović
|
d3dd105aae
|
feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916)
|
2026-06-25 06:33:50 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
fe11536df1
|
feat(ai-builder): Add conversation pre-seeding to workflow evals (no-changelog) (#32196)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-23 17:30:30 +00:00 |
|
|
José Braulio González ValidoandClaude Fable 5
|
13239d1cfe
|
feat(ai-builder): Add per-test-case eval credentials via thread credential-view pinning (no-changelog) (#32161)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-22 14:02:57 +00:00 |
|
|
Riqwan Thamir
|
b60bc923d4
|
feat(core): Add ability to view agent traces locally under a flag (no-changelog) (#32397)
|
2026-06-17 08:36:38 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
efc8e28967
|
test(ai-builder): Behaviour eval cases + authoring docs (no-changelog) (#32055)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-11 18:30:54 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
5fa988104b
|
test(ai-builder): Richer multi-turn eval framework (no-changelog) (#32054)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-11 12:57:08 +00:00 |
|
|
oleg
|
77b95c611d
|
feat(core): Harden Instance AI eval attribution and diagnostics (no-changelog) (#31951)
|
2026-06-09 12:10:10 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.8
|
7791a940dd
|
feat(ai-builder): Author-level conversation expectations on eval test cases (no-changelog) (#31787)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-09 10:06:07 +00:00 |
|
|
Milorad FIlipović
|
9bb77cc55e
|
feat(core): Allow deleting pre-built workflows after evaluating (no-changelog) (#31960)
|
2026-06-09 08:50:31 +00:00 |
|
|
Albert Alises
|
4271d42398
|
fix(core): Teach the builder the SDK language subset and stop repeated invalid repairs (#31911)
|
2026-06-09 07:42:28 +00:00 |
|
|
oleg
|
2925d654d1
|
fix: Use UUID thread IDs for Instance AI evals (no-changelog) (#31830)
|
2026-06-05 13:15:45 +00:00 |
|
|
olegandRiqwan Thamir
|
52a1a0809a
|
feat(core): Decouple Instance AI workflow verification from planning (#31340)
Co-authored-by: Riqwan Thamir <rmthamir@gmail.com>
|
2026-06-05 10:44:47 +00:00 |
|
|
José Braulio González ValidoandClaude Opus 4.7
|
46a222a15b
|
ci: Re-enable Instance AI evals on PRs with cost-bounded trigger (no-changelog) (#31430)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-05 08:40:23 +00:00 |
|
|
olegandClaude
|
afd7ddf372
|
feat(core): Use n8n default sandbox for Instance AI (no-changelog) (#31335)
Signed-off-by: Oleg Ivaniv <me@olegivaniv.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-04 08:31:27 +00:00 |
|