If I were the OP and I didn't want to use low level directx or openGL, then I would use either Irrlicht, or Ogre3d to do my drawing/window manager, and input ( ogre3d comes with an input lib, irrlicht handles this too ).
Irrlicht is easier to use and get started, Ogre3D is more tweakable.
However I would rather use low level openGL and libs like GLFW, GLEW, and GLM.