I think you have a lot of noise in that image, check the roof or hte red surface, but indeed your case is weird because you have a lot of noise and I don't usffer from that amount of noise in my scenes.
One question, are you lighting with an HDRI? And if that's the case, how is your HDRI, do you use a blurred HDRI with less resolution for lighting or do you use the high resolution version? I'm not sure if that can affect this, it's a long shot.
Cheers.