If you go to the following website and grab the very first example, you will have a Visual Studio project that creates a window using OpenGL. I ran it using Visual Studio 10 Express. It builds and runs without any extra dependencies, I went to some trouble to find something that would run right away without any hassle or setup nonsense, this is it.
If you then go all the way to the bottom to the Render Function you will see the following
If you change it to look like the following, you will have the beginning of that Pong game that you mentioned making.
It will be nice and plain old boring looking like you want. A white square on a black background.
The following code that I added in comes from the first chapter of the OpenGL Redbook. Found here.