Just throwing out some ideas.
What about chain alignment/rear wheel alignment? Loose/cracked chain guard? Loose drive sprocket?
You probably have a 16 tooth front sprocket on an early Speedmaster. I'm running an 18 tooth on my 03 America. For my kind of riding, it's fine but you will have to try for yourself.
