You can get small chrome thingies called pin locks, which are made to go over the pin and lock on with an allen key to tighten them up.
Look on ebay they sell for about ten dollars for ten of them.

Stewart Chrome Accessories for 'Modern Classic' Triumphs