The back plate on mine (the takedown 'button' is a part of it) is incredibly tight inside the upper. I've oiled it well, but I still have to put a fair amount of force on it to get it in or out. Give it a good push inward with a screwdriver, then once it is open, put your hand over the back plate and slam the bolt carrier back into it to pop it out of the upper receiver.