I always use this config and it works fine with .jpgs but when I save a .hdr (or .exr, I'm not sure, one of them) it comes out with doubled gamma correction so the only way to fix this is to set output gamma to 1.0. It's kind of annoying, is there any proper way of saving 32-bit files with proper gamma?
Up to Max 2013, this is actually one of two officially correct workflows. There is no way to make it any different. That is just how Autodesk made it.
There are two options:
If you often save low dynamic range formats, and only rarely EXRs (Means that EXR workflow is not your primary), then you have output Gamma at 2.2, and you have to manually override output in save window to 1.0 when saving HDR formats.
If you often save HDR formats (Use EXR workflow), then you have output gamma set to 1.0, and you manually override output in save window to 2.2, when saving LDR formats, like Jpeg.
In Max 2014, this should be handled automatically, as input and output gamma is not present in settings anymore, and when saving, gamma is set according to selected format. Unfortunately, this seems to be working correctly only for integrated renderers (MR, Scanline, iRay), because 3rd party renderers often use their own VFB, which is not compliant with the new output standard yet.