你即將離開本站

並前往https://icml.cc/media/icml-2020/Slides/6684.pdf

Improving Transformer Optimization Through Better Initialization

On layer normalization in the transformer architecture. In ICML, 2020. [3]: Zhang, H. etc. Fixup initialization: residual learning without normalization, ...

確定！ 回上一頁

查詢 「Etc transformer」的人也找了：

  1. Big Bird: Transformers for longer Sequences
    2.
  2. Longformer
    3.
  3. ETC encoding long and structured inputs in transformers
    4.
  4. A variant of Transformer
    5.
  5. Transformer long sequence
    6.
  6. Linformer
    7.
  7. LongT5
    8.