QuizMe

ישן

What is the difference between multihead attention and regular attention?

		Multihead attention uses multiple heads, each with its own keys, queries, and values matrices
		Regular attention does not involve softmax normalization

נערך Mar 20 '24 - 17:20 Shachar Adam

חדש

* השאלה נוספה בתאריך: 20-03-2024