What is the difference between single-head and multi-head attention?

What is the difference between single-head and multi-head attention? — LLM Engineering | Unlo