pmstack-run-eval

SKILLWorkflowcommunity
v0.0.0RyanAlbertsMITUpdated 1mo agoSource →

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
8Repo stars
1Clients
1Formats
1mo agoLast update
Skill
AuthorRyanAlberts
Version0.0.0
LicenseMIT
CategoryWorkflow
Formatsskill.md
PromptNot published
Compatibility
Claude✓ Supported
Cursor
Copilot
ChatGPT
Gemini
About

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required env vars are missing — never simulates results. Use when the user asks to "run", "execute", or "scor

Keywords
skillclaude