I haven't done any pipes with the cat in them so I don't know how much room you have but I can't see where removing the baffle will hurt anything as long as you don't physically hit it with any tools.

I learned all I need to know about life by killing smart people and eating their brains.
Eat right ,Exercise ,Stay fit, Die Anyway!