I had it happen with both Nvidia on and off, but strangely enough the issue got less and less yesterday afternoon, nothing changed in the file, actually got more stuff in it, but compared to the last few days it isn't a "problem" right now.
I'm not sure, I was wondering if it could be network problems, with the material editor refreshing every time?