I remember making it to first on this rule as a kid. The pitcher threw a wild pitch that I swung at and missed, so I just took off. The catcher missed the ball, didn't hustle for it, and I ended up safe on first.

So, yeah, it's a technical thing, but I'd hate to be the catcher that didn't tag the batter and let him get to first!