>A tap was used, and some rust came out.

Good idea.

>Can't grease them or eventually they'll come out.

I doubt that lubricant would cause problems.
How 'bout anti-sieze?

Said Molly to James, that's a fine motorbike. Richard Thompson