I know about that. The strange thing is, that this allocated memory persists, even after a call to Present, which flushes the pipeline as far as I know.
One user made me aware of this because he ran out of memory after loading a save-file 20 times.
I guess I'll have to do more tests with this tomorrow or something. Maybe something else is badly screwing up there.