mirror of
https://github.com/Shubhamsaboo/awesome-llm-apps.git
synced 2026-08-28 19:11:53 +08:00
0aa5126bf2
Tier 2 (trigger & routing) is now automated in CI instead of a manual protocol: run_trigger_evals.py checks that positive prompts clear the near-miss negatives on description vocabulary alone, and — once the catalog has 2+ skills — that positives rank their own skill first and no two descriptions near-collide. Reasoning-triggered cases (necromancer mode) are marked lexical:false and covered by tier 3. Tier 3 (behavioral) adopts skill-creator's evals.json schema verbatim, so Anthropic's run_eval.py, benchmarking, and eval viewer work against our files unmodified. project-graveyard's four behavioral cases written in that schema. The evals README tier table now uses Addy's names for Addy's tiers, and marks the two tiers that are ours because our skills ship executable code and his don't (security scan, deterministic script evals). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>