Yeah, that would be a solution. The more objects distance map has to consider the slower it gets, a checkbox for rendertime only would be great, but instead of a global setting, it should be set per distance map.
Is the lag you get present while rendering with IR only? I've learnt the hard way to avoid doing any changes to the map or the distance objects while IR is running, it's either unstable or locks up Max for a... while.