2 hours for one full hd frame is extremly high. On your Cpu 15-20min should be enough.
What I always do, is to set the High quality denoiser to 0.5 and do some additional denoising for flat surfaces in neat video in premiere pro or after effects.
You said that you are lighting with a hdri, that can be the reason for 2x rendertime. I would try to light your scene with a sky or area lights. Should be easily possible, to reach the same lighting.
I have rendered this scene before and I have rendered 13min for one frame at 1920x1080 on a Ryzen 1700 and I have used only arealights outside the windows.
Your scene is no complex scene and you should reach much faster rendertimes. I am sure 10-15min could be possible on your setup.