Hello,
I think I can see what the issue is. If you add something into "Direct visibility override", IR VFB gets updated, but if you change it by putting something else inside, VFB does not get updated. I will pass this issue to the developers.
In the meantime, you don't have to "stop start" every time, you can turn off visiblity override and turn it back on (double click on the checkbox) and it will update.
Thanks for reporting,
Jan