Software Development

FSDP2 Integrator

Integrates PyTorch FSDP2 into training scripts for large models requiring distributed sharding and checkpointing.

Publisher / source
Orchestra-Research/AI-Research-SKILLs (found on skills.sh, an awesome list)
Upstream record
Orchestra-Research/AI-Research-SKILLs
Version
Version 3
Published
Publication review
Approved for publication
Content fingerprint
b540043bd17d741840843df2f76d556d41be29c82a2acd85565ce2b1ce088a50