שאלה | How does MQA differ from traditional multi-head attention?

How does MQA differ from traditional multi-head attention?

		MQA uses a single query head while traditional multi-head attention uses multiple query heads
		MQA uses multiple key and value heads while traditional multi-head attention uses a single key and value head
		MQA uses multiple query heads but only one key and value head
		MQA uses a single key and value head while traditional multi-head attention uses multiple key and value heads