Honestly if your goal is to make games and not engines, you should be using an engine, not pure API's.
It can take months to figure out D3D by itself, whereas something like Unity can have full 3d objects rolling around a level in minutes. Plus you have to write all the connecting game engine code.