eval-leakage-audit

SKILLWorkflowcommunity
v0.0.0AlexZio00MITUpdated 4d agoSource →

Audits whether a verification (eval/metric/experiment/holdout) actually secures independent external ground truth, or whether the designer, the model, and the scorer are just confirming each other in a circle — via an 18-pattern taxonomy. Read-only. Use before trusting any 'how we'll know it worked'

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
124Repo stars
1Clients
1Formats
4d agoLast update
Skill
AuthorAlexZio00
Version0.0.0
LicenseMIT
CategoryWorkflow
Formatsskill.md
PromptNot published
Compatibility
Claude✓ Supported
Cursor
Copilot
ChatGPT
Gemini
About

Audits whether a verification (eval/metric/experiment/holdout) actually secures independent external ground truth, or whether the designer, the model, and the scorer are just confirming each other in a circle — via an 18-pattern taxonomy. Read-only. Use before trusting any 'how we'll know it worked' — A/B tests, holdouts, scores, validation — especially when a result feels too clean or self-confir

Keywords
skillclaude