Depends how far around your wheel has come already. If the bike is still going straight, you can get off the rear and be fine (I've done it by accident...) but yeah, gotta be carefull because if the rear wheel is sideways signifficantly, and it suddenly regains traction, it's going to stop going sideways, by the momentun of you and the bike won't stop, and over you go.
