Curtis, I agree, some pics of what you're working with would be great.
I think the only way that you will get the fender as close as you're describing is to mount it to the swing arm or bolt some pieces to make it rigid.
If you go the rigid route, let me know if you want to get rid of your brackets.
