Thought I'd chime in here because I was in a similar position about 2/3 week ago. I was considering switching from unity to monogame for my next project.
I've made games with both unity & using a "game framework" like monogame (I've used its predecessor XNA as well as a few others like libGDX etc). It's true that you get a lot more control with game frameworks because you get to do collision, drawing all yourself. But this comes with a HUGE pricetag, which is: you will be spending most of your time writing an engine, and not making a game.
One thing that you will notice if you research monogame is that the documentation is lacking. Since monogame is a relatively new opensource clone of XNA. This is fine for experienced developers because it's opensource. But it's something to consider if you don't want to muck around with someones code all day.
I personally prefer unity, it has great tools that allow most of your work to be devoted to building out your game. It does have downsides, and it takes awhile to think within the unity constraints. In my opinion, it's totally worth it. Not only does it give you a tool to create great games easily, it also gives you some insight/knowledge about how you might design your own engine in the future if you decide to go the game framework route.