ai-pretraining

Name: ai-pretraining
Author: vasilyu1983

SKILLWorkflowcommunity

v0.0.0vasilyu1983MITUpdated 2d agoSource →

Builds a transformer/GPT and BPE tokenizer from scratch. Use when implementing autograd, self-attention, a nanoGPT-style pretraining loop, or a byte-level tokenizer.

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →

75Repo stars

1Clients

1Formats

2d agoLast update

Skill

Authorvasilyu1983

Version0.0.0

LicenseMIT

CategoryWorkflow

Formatsskill.md

PromptNot published

Compatibility

Claude✓ Supported

Cursor—

Copilot—

ChatGPT—

Gemini—

About

Builds a transformer/GPT and BPE tokenizer from scratch. Use when implementing autograd, self-attention, a nanoGPT-style pretraining loop, or a byte-level tokenizer.

Keywords

skillclaude