Back to Modules
10.1 Vision Transformer (ViT)
10.2 Pretrained Transformer Models
10.3 Scaling of Decoder Transformer Models
📚 Resources, Readings & Colab

Recommended reading: Dive into Deep Learning — D2L: Chapter 11.

Optional papers (arXiv):

DeiT Playground (Colab)
Hugging Face Transformer Tutorial (Colab)
Homework Transformer 2.0 (Colab)
Module 9
Module 11