Software Development
PhysicsNeMo Shard Tensor
Physicsnemo Shard Tensor supplies NVIDIA‑authored guidance for integrating PhysicsNeMo ShardTensor domain parallelism into training and inference scripts using DDP or FSDP2. It allows developers to write and register shard patches for new layers and operations while bootstrapping multi‑GPU correctness tests. The skill benefits teams building physics‑based models that require sequence or spatial sharding, ring attention, or DeviceMesh‑based hybrid parallelism.
- Publisher / source
- NVIDIA Skills (Verified)
- Upstream record
- NVIDIA/skills
- Version
- Version 2
- Published
- Publication review
- Approved for publication
- Content fingerprint
9bb522d6860585b959c10cb4c508758de79e8779fea267655655816cf1ff70d1