Maybe try setting the unit in boiled water... not so it's immersed, but just so the outer part (the insert) is heated up by the water. It may expand enough to let go of the cap?

Live to love, love to live.