AdamW or Ranger are usually my go-to optimizers. ... [R] New Newton solver beats SGD and Adam for large models on ImageNet/CIFAR.
確定! 回上一頁