Just one theory I'll throw out here, seein' as how I haven't yet seen it touched upon here...Have you checked your front to rear wheel alignment with a perfectly straight piece of wood or other such implement?
Ya know, ya really can't count on those little marks on the back of the swingarm that are supposedly there to use as a reference when adjusting the chain to be true "north-south" on the bike.