It sounds like your light position might be camera-relative, or vice-versa.

I feel like a moron XD

I was making the OpenGL light a directional light opposed to a point light, therefore messing with it. For future reference, how would I go about making my own light positions? Would I just multiply the position by the modelview matrix?