LoRA Fine-Tuning

Medium

llms Meta Hugging Face OpenAI

How does LoRA (Low-Rank Adaptation) reduce the cost of fine-tuning large language models?

Multiple Choice

It reduces the model's vocabulary size during fine-tuning It freezes original weights and trains small low-rank matrices that are added to the weight updates It removes half the transformer layers during fine-tuning It converts all weights to 4-bit precision before training

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations

LoRA Fine-Tuning

Multiple Choice

Related problems

Deep-dive guides