Transformer Architecture Deep Dive

Hard

llms Google DeepMind OpenAI

Multiple Choice

Self-attention, convolution, and pooling layers Multi-head self-attention and position-wise feedforward network, each with residual connections and layer normalization Recurrent cell, attention gate, and output projection Multi-head attention, LSTM cell, and batch normalization

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations