Yes it will but don't do it. Without the battery in the loop, there is the potential for the voltage to spike and fry your electrical components. In simple terms, the battery provides some stability to the regulator circuit.

12 Rocket Roadster
03 Bonneville America
69 BSA Firebird Scrambler
73 Yamaha TX 750