Have you increased light sampling multiplier and PT samples in case of using environment?
yes i dead 10 for ligh sampling and pt sample in HD 4000 , and 64 for pt sample , even i play with all settings , light coroan is much faster than skylight and light material