QuizMe

* השאלה נוספה בתאריך: 20-03-2024

How does LoRA leverage the low intrinsic dimensionality of pretrained models during fine-tuning?

		By compressing the pretrained model into a smaller size before fine-tuning
		By discarding the original model parameters and initializing new ones from scratch
		By representing the change in weights as a product of two low-rank matrices and updating the original weights with these matrices