Yup. I had the same problem. I used a dremel and took a little paint off around the hole in the bracket. Now it slides into the groove a bit easier. Not perfect but much better.
You don't have a sissy bar, do you? Then you need different spacers from the Easy Bracket people.
Cody