huggingface-community-evals

SKILLWorkflowcommunity
v0.0.0waybarriosMITUpdated 2d agoSource →

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
470Repo stars
1Clients
1Formats
2d agoLast update
Skill
Authorwaybarrios
Version0.0.0
LicenseMIT
CategoryWorkflow
Formatsskill.md
PromptNot published
Compatibility
Claude✓ Supported
Cursor—
Copilot—
ChatGPT—
Gemini—
About

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Keywords
skillclaude