It was the first time I remember people struggling to mentally map the controls.

Your grandma or little sibling could understand how to move NES Mario around (not necessarily being good at it, of course), but 3D was too intimidating for a lot of people to even try.