I already have some sort of tinnitus in my left ear -> all those Motörhead concerts I guess, so I'm trying to hang on to what's left of my hearing. Nowadays I wear earplugs (custom made for my ears) every time I ride.
Believe me, it's not the exhaust but the wind and other noises that do make you deaf in time (if Motörhead doesn't do the job first).