Take two minutes to remove the front fender again and see IF the problem comes back. I ride 50% of the time without the front fender (and no bracket) and I've never felt any pull. Just sayin'.
And you may see me tonight
With an illegal smile
J. Prine