It seems one could weld a stop block on the inboard side of the bracket. It wouldn't show except from the other side of the bike and need not be that big anyway. Or pin it rigid with a through bolt drilled through the swingarm and bracket. After all those mods you have accomplished so far, this one shouldn't be much of a challenge for you. Looking forward to how you deal with it.
