What Is a Token in LLMs?

Easy

llms Google OpenAI

What is a 'token' in the context of large language models?

Multiple Choice

A complete word in the input text A sub-word unit from a learned vocabulary that serves as the model's basic processing element A single character of the input text A sentence boundary marker used during training

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations

What Is a Token in LLMs?

Multiple Choice

Related problems

Deep-dive guides