You can send the scene to make sure there is no bug, but I can easily see why this would happen: if you have large IOR, lots of light get trapped inside the objects for many bonuces because of total internal reflection. There is more total internal reflection going on with higher IOR. This is what causes the diamond optical properties, but can also be hard to simulate, because extra bounces are needed.