Yes, in such cases and places you will need to fine tune the chamfering and displacing amounts so there are no overlapping displacement.
The 20 segments will work just as well, but you will probably need to offset both displacement values with the same number.
You can try with 20 segments (even though I don't recommend it), and then set displacement min 0 (so there is nothing being pushed inwards) and then adjust the Max value until you get the desired look.