The thing that you pushed back in is a shaft that has a flat spot ground in it. When you pull lever, shaft rotates and the flat spot pushes on a pin that pushes the clutch. There is nothing holding that thing in except where the pin rides in that flat spot. If the spring (#3 in the picture) breaks or comes out of the hole, shaft will rotate past the flat spot and the lifter arm and shaft will come right out. You will need a new left side cover gasket, its not re-useable. Also, take care when you pull cover. Starter gear is on a loose shaft that is held in place by the cover.
Bikebandit schematic
