Your right I was approaching it in a pretty convoluted fashion .
Anyhow I got it working using a single matrice for the point light. Now I just have deal with some peter-panning of the shadows
P.s. I don't know why but it makes me cringe to have to send more data to the shader then just a few matrices and a variable or two.
I would imagine however doing PCF in the pixel shader to be a bit more intensive