I rode a 19t all over the mountains between Prescott and Grand Canyon twice, never had a problem. I think I kept up with everybody when I was there. You just drive a gear lower than the other people.
I try to aggravate one person a day. Today may be your day.