For a Florida Cracker:
Too cold is when ear plugs, 1. Resist pre insertion compression and 2. Resist post insertion expansion.
Too cold is when one's mpg falls dramatically due to the extended warm ups.
Too cold is when your gloves no longer stick to the hand grips.
same cracker but now traveling:
Too cold is when windchill forces you to ride so slow that you take back roads so you can ride without fear of being rearended.
Too cold is when the beer freezes in your saddlebags...
...on the way back to the hotel from the market.