Note that 768×1 embedding sizes are used for the BERT-base models. Embeddings size of 1024 × 1 is used for BERT-large models. Source publication.
確定! 回上一頁