Ty for the scene, yes that happens to me too.
I get an error on loading the scene, about missing Arnold Renderer plugins but I deleted the render settings for that and still got the same result. For me, I can render to IR in the VFB, and get the "smoother" result, render offline in VFB and get the "rougher" result, and repeat that over and over, so both are giving different results.
However, if I create a new sphere and apply the displacement material to it (leaving the old sphere in there too), the new sphere does NOT show this change between IR and offline, while the old sphere continues to render differently.