LoRA Fine-Tuning

Medium

llms Meta Hugging Face OpenAI

Multiple Choice

It reduces the model's vocabulary size during fine-tuning It freezes original weights and trains small low-rank matrices that are added to the weight updates It removes half the transformer layers during fine-tuning It converts all weights to 4-bit precision before training

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations