When it gets really cold, I wear Gerbings heated gloves and heated jacket. It's a thin jacket that fits well under the leather and is unbelievably toasty. I recommend the gaitors John suggested. The neck stays warm with those.
About the goggles...I guess you don't have a full-face helmet? If not, get one for winter. It will keep you warm and dude, crap really hurts when your face is frozed and you take a rock to the cheek.