When I change the color of the mortar of the brick texture to a color other than white (grey for example), the issue disappears. I'm now starting to think this is a limitation of DX and something I cannot fix. This would explain why so many games using muted colors or colors close in range.