"change camera view"
In order to save memory and render time, Screen mode is the default for displacement. It is calculated before rendering, based on what is seen in the view - if you then change views with IR running, displacement is not recalculated, and if that view is looking at something not seen in the previous view, the displacement will not have been calculated there. All by design :)
Options are to use World Space for displacement (with the associated cost of greater memory requirements and longer to calculate displacement on render start up), or to stop and start IR if you change camera view.