Yes, you do need to support the pipes at that back bracket. I also removed that plate, and then I put the passenger footpegs in those holes (with the mounting brackets for the pipes behind them). One washer in there, and it tightens up just fine.
Will