I fixed it! I was making two mistakes, the lookAt vector was not properly initialised (i.e. 0,0,0 instead of 0,0,1) and I was applying the particle's composite transformation matrix AFTER I had manipulated the camera matrix, not before. Now it works fine and I am a happy bunny. :)

Thanks for the input.