We went over multiple research papers in depth, and how they related to my research. I was also asked a few technical questions as well to verify knowledge of general ML and DL concepts.
Interview questions [1]
Question 1
Explain the differences between MQA, MHA and GQA. Why is GQA particularly interesting for LLMs and Multi-Modal models?