TokenToSeaSkill 广场
English 控制台

Pytorch Fsdp2

Orchestra Research

Adds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU memory or when you need DTensor-based sharding with DeviceMesh.

安装

npx skills add Orchestra-Research/AI-Research-SKILLs --skill pytorch-fsdp2