pmstack-run-eval

SKILLFlusso di lavorocommunity
v0.0.0RyanAlbertsMITAggiornato 1 mesi faFonte →

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
8Stelle del repo
1Client
1Formati
1 mesi faUltimo aggiornamento
Skill
AutoreRyanAlberts
Versione0.0.0
LicenzaMIT
CategoriaFlusso di lavoro
Formatiskill.md
PromptNon pubblicato
Compatibilità
Claude✓ Supportato
Cursor
Copilot
ChatGPT
Gemini
Descrizione

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required env vars are missing — never simulates results. Use when the user asks to "run", "execute", or "scor

Parole chiave
skillclaude