I found the problem, there was an enviroment object behind the windows and there was used emiting light material which caused that grain. Glass, IES and everything else was quite ok, I will try to use standard photometric lights instead of IES to speed it up a bit, will post result here....actually I have A5 so photometric lights doesnt work so I used IES anyway