Try to increase ray directionality, it should help with unwanted "spillage". You may also want to decrease quality, too high value will only make your render slower, but will not produce any better result, although it has nothing to do with this specific issue.