Ok, the new scene works fine for me - I am able to reproduce the issue.
Here are some extra findings:
1) Keeping the layered material applied, but just unplugging the layer 1 material makes rendering fast again
2) Keeping the original layered material setup, but just unplugging the bump map from the base material makes rendering fast again
This is very strange and probably worth looking into.