The calipers are meant to collapse in order maintain a repeatable and consistent pinch on the rotor as the pads wear. I would be looking at your rotor first, to ascertain it's not warped. A good straight edge will tattle on any warpage, but to get a good survey, you may have to pull the rotor. If it's warped bad enough, it will show in situ.
