Give some thickness to your walls (by applying shell modifier, for example) and those small dots should dissapear. As for noise, if it's mainly in direct pass, then you'd most likely want to increase LSM to 4-6 and render till noise will converge to acceptable level.
ninja'd by Lucutus :]