I did mine the same way. You just have to put some pressure on the drill until it starts cutting. I used some WD40 also to lube the bit. It will jump around some but it will work.

I wondered why the frisbee was getting bigger......and then it hit me. '05 BA - Mulberry/Graphite,128 mains,42 pilots,TBS needles,drilled slides,debaffled stock pipes,Uni,no snorkel