...it's very hard. I started with 2D and the most easiest part is drawing on the screen and making something move. However, as soon as you try to add basic physics(they don't have to be realistic) or other stuff like collision detection or collision resolution, it becomes difficult, you begin to see errors in your design that you chose in the beginning, but it's too late to fix it, so you try to get around it with some fix, but turns out the fix has a bug that isn't really a bug but it can crash your program, you can mostly handle it, but you really don't know if there are any edge-cases which aren't handled or if your fix even works as intended.
And it's also important to carefully consider if your map will be uniform or not as it directly affects performance and difficulty of your code and various other aspects that I didn't.
So yeah, game programming is hard, takes one to do it to know it even if someone else told you it's hard. Makes me wonder if I will ever be able to work with 3D game programming if I am already at my limits so far.