In fact you get pretty realistic caustics, the problem may be the render time needed to clean it up.
In your case I bet you have a diffuse light source like a big area light, this will give you what you show, blurred caustics, for sharp caustics you need a sharp source of light, like the sun or a point (or nearly point) light.
Check attached picture and scene.
Cheers!