Issues

• Validation loss vs model size per step

  huggingface/datablations#14 · Filter by author orena1 opened on Feb 20, 2025
  3

• wonder if LR=1e-3 for mup is optimal value from small-scale proxy model and dropout is crucial for multi-epoch

  huggingface/datablations#13 · Filter by author SeunghyunSEO opened on Jul 22, 2024
  4

• Figure issue about your paper (Figure 4 and Figure 15)

  huggingface/datablations#7 · Filter by author MatthewYZhang opened on Jun 4, 2023
  1

• A question about the conclusion of this paper

  huggingface/datablations#6 · Filter by author OleNet opened on May 31, 2023
  1