What is the role of model architecture in LLM Engineering?

What is the role of model architecture in LLM Engineering? — LLM Engineering | Unlo