Transformer Architecture Deep Dive

Hard

llms Google DeepMind OpenAI

In the original transformer architecture, what are the key components within a single encoder layer?

Multiple Choice

Self-attention, convolution, and pooling layers Multi-head self-attention and position-wise feedforward network, each with residual connections and layer normalization Recurrent cell, attention gate, and output projection Multi-head attention, LSTM cell, and batch normalization

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations

Transformer Architecture Deep Dive

Multiple Choice

Related problems

Deep-dive guides