I play PC, for me, if I have a custom destination set, I remove it by clicking elsewhere on the map to create another destination point. The prompting dialogue will as you 3 options, one of which is to REMOVE previous destination. See if that works for PS3.