https://steven-yl.github.io/mywebsite/categories/pytorch/PyTorch - 分类 - mywebsiteHugo -- gohugo.iozh-CNsteven@gmail.com (Steven)steven@gmail.com (Steven)This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.Fri, 03 Apr 2026 00:00:00 +0800https://steven-yl.github.io/mywebsite/00_overview/Wed, 01 Apr 2026 10:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/00_overview/算子级练习项目的整体架构与推荐阅读顺序。https://steven-yl.github.io/mywebsite/lr_function/Tue, 24 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/lr_function/lr曲线图https://steven-yl.github.io/mywebsite/active_function/Tue, 24 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/active_function/本文汇总 Sigmoid、Tanh、ReLU、GELU、Swish 等激活函数，并提供分组图与总览图。https://steven-yl.github.io/mywebsite/distributed_training_guide/Thu, 12 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/distributed_training_guide/从进程组初始化、DDP 封装、数据分片、集体通信到 Lightning 封装，全面讲解如何在单机多卡与多机多卡场景下正确使用 PyTorch 分布式训练。https://steven-yl.github.io/mywebsite/01_activations_and_fundamentals/Wed, 01 Apr 2026 10:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/01_activations_and_fundamentals/TorchCode 文档第一章：从最底层算子到损失函数。https://steven-yl.github.io/mywebsite/pytorch_dataset_guide/Thu, 12 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/pytorch_dataset_guide/覆盖 map-style/IterableDataset、全部内置 Dataset 扩展、图数据与 HF datasets、典型项目扩展模式、padding 与 collate 职责划分，以及与 DataLoader 的衔接。https://steven-yl.github.io/mywebsite/net_init/Thu, 12 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/net_init/全面对比深度学习权重初始化方法的原理、公式推导、优缺点与适用场景，附 PyTorch 代码示例和 Transformer 架构初始化最佳实践。https://steven-yl.github.io/mywebsite/02_normalization/Wed, 01 Apr 2026 10:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/02_normalization/TorchCode 文档第二章：归一化技术全解。https://steven-yl.github.io/mywebsite/dataloader_guide/Thu, 12 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/dataloader_guide/从索引流、取样本、成 batch 三条线讲清 DataLoader 职责，涵盖 Sampler、collate_fn、num_workers、pin_memory 及与 Dataset 的衔接。https://steven-yl.github.io/mywebsite/03_attention_mechanisms/Wed, 01 Apr 2026 10:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/03_attention_mechanisms/TorchCode 文档第三章：注意力机制从基础到高效实现。