Then you have to make your displacement map properly. Map that you are using won't work as displacement. If you want to know why, just open it in photoshop and convert it to greyscale. It should be very obvious then why it can't work as displacement.
BTW, those jaggies are from jpeg compression - displacement is much more sensitive to it than normal maps.