So long as the floats are set correctly, and needle and seats are not seeping you are fine. The problem comes when they seep. Fuel drips into the combustion chamber and from there past the rings into your oil. It can wash down your cylinder walls too. Japanese bikes have a vacuum operated gas tap that actually shuts the gas off when it isn't running. I tend to error on the side of caution, and turn mine off....... just in case.
No doubt someone will jump in and explain about the exploding air box before it's all over with........ I'm not sure leaving the gas on has anything to do with that, but there are those who do.
04 Black America
Custom seat,TOR's,Progressive springs & 440's,18T,45/132,K&N,not a Sportster