pmstack-run-eval

SKILLWorkflowcommunauté
v0.0.0RyanAlbertsMITMis à jour il y a 1 moisSource →

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
8Étoiles du dépôt
1Clients
1Formats
il y a 1 moisDernière mise à jour
Skill
AuteurRyanAlberts
Version0.0.0
LicenceMIT
CatégorieWorkflow
Formatsskill.md
PromptNon publié
Compatibilité
Claude✓ Pris en charge
Cursor
Copilot
ChatGPT
Gemini
À propos

Execute an evaluation YAML produced by pmstack-eval against a real target system, running n_trials per task and reporting both pass@k and pass^k. Implements the running side of Anthropic's eval framework. HARD-STOPS with educative errors if no target is configured, no tasks are present, or required env vars are missing — never simulates results. Use when the user asks to "run", "execute", or "scor

Mots-clés
skillclaude