I say be safe as possible. First slow down to limit the potential for needing a quick stop by increasing the distance between you and the traffic in front of you. No need to get rear ended just because someone else is following too close. Take the control of the issue by slowing down.
Then get out of the way by changing lanes and letting the idiot pass, or turning off into a street or parking lot to let them go. (I don't need to use this tactic too ofter. Most roads where I ride are two lanes at least.