When I want the camera to follow an object I multiply the camera matrix with the object matrix. So it follows/rotates/scales with the object (I usually disable scaleWithParent).
I recommend to read this article: http://www.gamedev.net/page/resources/_/technical/math-and-physics/making-a-game-engine-transformations-r3566