Is there a way to change the position and angle of an idle with SetVehicle?

I'm using a cart prisoner idle on the player with a rowboat, and the idle sets him way too high and looking to the side. Other non cart idles didn't seem to work at all, including the driver idle.