I wouldn't use any kind of a solvent, you sure do not want to rinse out or dilute the lubricant sealed behind the o-rings. Plain old clean rags cut in strips for the inner recesses would be my first choice. I am forced to travel dirt roads as well to get places, and I keep the exterior of my chains and sprockets as clean and dry as possible. I do use a bake on, Teflon/Moly
web page coating from Brownells on my sprockets when new.