pmstack-run-eval

SKILLFlujo de trabajocomunidad
v0.0.0RyanAlbertsMITActualizado hace 1 mFuente →

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
8Estrellas del repo
1Clientes
1Formatos
hace 1 mÚltima actualización
Skill
AutorRyanAlberts
Versión0.0.0
LicenciaMIT
CategoríaFlujo de trabajo
Formatosskill.md
PromptNo publicado
Compatibilidad
Claude✓ Compatible
Cursor
Copilot
ChatGPT
Gemini
Acerca de

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required env vars are missing — never simulates results. Use when the user asks to "run", "execute", or "scor

Palabras clave
skillclaude