Purpose of Positional Encoding

Easy

llms Google DeepMind Meta

Why do transformer models need positional encoding?

Multiple Choice

To reduce the memory footprint of the attention mechanism To provide the model with information about the order of tokens in the sequence To normalize the embedding vectors to unit length To enable the model to handle multiple languages simultaneously

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations

Purpose of Positional Encoding

Multiple Choice

Related problems

Deep-dive guides