ai-distributed-training

Name: ai-distributed-training
Author: vasilyu1983

SKILLWorkflowcommunity

v0.0.0vasilyu1983MITUpdated 2d agoSource →

Guides multi-GPU pre-training: DDP, FSDP2, ZeRO, tensor/pipeline/expert parallelism, fp8/Muon. Use when scaling a run, training MoE, or reproducing GPT-2 on rented GPUs.

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →

75Repo stars

1Clients

1Formats

2d agoLast update

Skill

Authorvasilyu1983

Version0.0.0

LicenseMIT

CategoryWorkflow

Formatsskill.md

PromptNot published

Compatibility

Claude✓ Supported

Cursor—

Copilot—

ChatGPT—

Gemini—

About

Guides multi-GPU pre-training: DDP, FSDP2, ZeRO, tensor/pipeline/expert parallelism, fp8/Muon. Use when scaling a run, training MoE, or reproducing GPT-2 on rented GPUs.

Keywords

skillclaude