View Attach Info

Add new attachment

In order to upload a new attachment to this page, please use the following box to find the file, then click on “Upload”.

This page (revision-11) was last changed on 23-Dec-2025 16:22 by 14.155.111.65

This page was created on 18-Nov-2025 16:19 by 139.162.79.56

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Difference between version and

At line 35 changed one line
计算量：FP32精度下通常为6*total_prams*data_size；FP16精度下则除以2
计算量：FP32精度下通常为6*total_params*data_size；FP16精度下则除以2
At line 39 added 4 lines
显存计算：
主要集中在优化器的显存占用，如果是fp32精度，通常优化器所需要的显存为4*2*total_params，模型权重和梯度所需要的显存共为2*4*total_params，所以至少需要64*total_params的显存
At line 143 changed one line
如果要确定最佳超参数，可以在2000步进行不同超参数的测试，选择损失最低的超参数组合，再进行长时间的训练
如果要确定最佳超参数，可以在2000步进行不同超参数的测试，选择损失最低的超参数组合，再进行长时间的训练；
Version Date Modified Size Author Changes ... Change note
11 23-Dec-2025 16:22 4.949 kB 14.155.111.65 to previous
10 18-Dec-2025 19:05 4.907 kB 172.239.69.242 to previous | to last
9 18-Dec-2025 17:53 4.91 kB 172.239.69.242 to previous | to last
8 18-Dec-2025 17:46 4.85 kB 172.239.69.242 to previous | to last
7 20-Nov-2025 12:13 2.72 kB 139.162.79.56 to previous | to last
6 19-Nov-2025 20:39 2.69 kB 139.162.79.56 to previous | to last
5 19-Nov-2025 20:38 2.688 kB 139.162.79.56 to previous | to last
4 19-Nov-2025 20:36 2.685 kB 139.162.79.56 to previous | to last
3 18-Nov-2025 17:08 2.439 kB 139.162.79.56 to previous | to last
2 18-Nov-2025 16:29 2.315 kB 139.162.79.56 to previous | to last
1 18-Nov-2025 16:19 2.327 kB 139.162.79.56 to last
« This page (revision-11) was last changed on 23-Dec-2025 16:22 by 14.155.111.65