https://steven-yl.github.io/mywebsite/tags/%E4%BC%98%E5%8C%96%E5%99%A8/优化器 - 标签 - mywebsiteHugo -- gohugo.iozh-CNsteven@gmail.com (Steven)steven@gmail.com (Steven)This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.Tue, 17 Mar 2026 00:00:00 +0800https://steven-yl.github.io/mywebsite/training_solver_guide/Thu, 12 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/training_solver_guide/从总览到各章节：Optimizer/SGD/Adam/AdamW 全解读、LRScheduler 族、param_groups、梯度累积与裁剪、损失选型及学习率与 batch 配置经验。https://steven-yl.github.io/mywebsite/batch_size_lr/Tue, 17 Mar 2026 00:00:00 +0800Stevenhttps://github.com/steven-ylhttps://steven-yl.github.io/mywebsite/batch_size_lr/详解分布式训练中 batch size 扩大时学习率的线性缩放、平方根缩放及线性+长 warmup 的推导依据与使用建议。