Did you, or did you not, yet, create a separate shader with just one effect (Bloom) as I proposed above, to check the actual difference in performance ?
Easiest way would be to just add a different shader technique to a same HLSL file. If you are not familiar with techniques, and are not willing to learn them - then just create a separate shader HLSL file with the new shorter pixel shader.
Then post the FPS here.