I'd go for dual Xeon setups too.
Now, assuming you can build them yourself with used/ebay parts, here are two options that have nice price/performance.
Cheaper/older - dual E5-2670. That's V1 Xeons, very cheap cpus on ebay/aliexpress/other, can use simple DDR3 on some boards. Or just get ecc ddr3 64Gb kits for about 100euros on ebay.
Expensive/newer - dual E5-2683 V3. I'd suggest SR1XH stepping, as it's close or retail, so should have no issues. As far as I know dual boards with these require server ram. But performance is double of the previous system.
There are various V3/V4 chips that might be better, but I personally don't like early revisions for lower clockspeed and possible issues. And V4 have a problem with throttling under AVX, as discussed here on forum.