Yep, Math is a bitch, even when you tell it to get lost, it always comes around again in anything tech related.
University Degree !
If you want to be a game designer, knowing about usability, designing GUIs, getting feedback on it, etc. may be helpful. Those two fields have similar concepts and thought processes.
Do you know what a game designer actually does in a professional environment? I don't want to sound patronising, I wouldn't be sure myself ;).
Thinking back when I started going into IT, the first internship I applied was not in the field I am currently working in. It also wasn't what I imagined. As you, my dream was to make games. But since I live in a country with practically no game studios, I didn't even knew of different roles and what they include.
When you want to go into this industry, IT will be a big part of it. Don't make your future path too narrow, maybe you like something completely different in the field of Computer Science. Many laymen don't know that, you don't just "work in IT", there are many different jobs and with that, many different ways to have fun