What is the purpose of using multi-head attention in Transformer models?

Master LLM and Gen AI with 600+ Real Interview Questions Question:What is the purpose of using multi-head attention in Transformer models?A) To reduce the complexity of training by splitting attention across multiple layers.B) To capture diverse relationships in the data by attending to different parts of the sequence simultaneously.C) To enhance gradient flow across layers … Continue reading What is the purpose of using multi-head attention in Transformer models?