Hey,
That's your HDRI talking. Try lowering the MAX SAMPLE INTENSITY to 1 instead of 25 and see those points dissapear.. Certain areas might get a TAD darker, but honestly, it's not worth the headache. Solve it with lowering contrast and such in the tools on the VFB.
On the bright side, you can remove denoiser, it takes up space and time you need. And change the Image Filter to "High Quality" - Since this works really nice but doesn't work with a desnoiser in the game. So win/win.
Grts!