https://steven-yl.github.io/mywebsite/tags/%E5%88%86%E5%B8%83%E5%BC%8F%E8%AE%AD%E7%BB%83/分布式训练 - 标签 - mywebsiteHugo -- gohugo.iozh-CNsteven@gmail.com (Steven)steven@gmail.com (Steven)This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.Thu, 12 Mar 2026 00:00:00 +0800https://steven-yl.github.io/mywebsite/distributed_training_guide/Thu, 12 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/distributed_training_guide/从进程组初始化、DDP 封装、数据分片、集体通信到 Lightning 封装，全面讲解如何在单机多卡与多机多卡场景下正确使用 PyTorch 分布式训练。