cupynumeric-parallel-data-load

SKILLWorkflowcommunity
v0.0.0NVIDIAApache-2.0Updated 1d agoSource →

Load a sharded, on-disk dataset (sharded .npy, Parquet/Arrow, raw binary, sharded HDF5, custom layouts) into a distributed cuPyNumeric ndarray via a manual partition + leaf @task launch with CPU/OMP/GPU variants. Use when no single-call loader fits, including when per-shard row counts differ across

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
3kRepo stars
1Clients
1Formats
1d agoLast update
Skill
AuthorNVIDIA
Version0.0.0
LicenseApache-2.0
CategoryWorkflow
Formatsskill.md
PromptOpen (see Prompt tab)
Compatibility
Claude✓ Supported
Cursor—
Copilot—
ChatGPT—
Gemini—
About

Load a sharded, on-disk dataset (sharded .npy, Parquet/Arrow, raw binary, sharded HDF5, custom layouts) into a distributed cuPyNumeric ndarray via a manual partition + leaf @task launch with CPU/OMP/GPU variants. Use when no single-call loader fits, including when per-shard row counts differ across files. Prefer cupynumeric.load or legate.io.hdf5.from_file when they apply.

Keywords
skillclaude