Do you know what make or model of magazine it is? Does the follower only tilt/bind at the bottom of the magazine when it hits the five round 'pin', or does it jam up at random points throughout its range of motion?
Unfortunately some manufactures have taken to stamping the magazines with a divot that impedes the follower. I think this is a cheaper and faster means of modifying a magazine to conform to our regs than a different follower, pop rivet, etc. Its based on the notion that the vast majority of people don't strip their mags.
No, not all magazines are pinned in this fashion. Unfortunately, its probable that any modification to the mag or follower that allows you to by-pass the 'pin' and remove the follower, will also render the magazine capable of holding more than five rds, and therefore would probably be illegal.
I once bought a batch of pistol magazines, only some of which were pinned in this fashion, but ALL of the mags had a protrusion that stuck up from the bottom of the follower that ALSO restricted the mag to 10 rds. Didn't notice the punch until I realized that I could disassemble some mags, but not others. I promptly returned the mags to the point of sale and exchanged them for ones that aren't doubly pinned, and only have the modified follower. I had to explain in quite a bit of detail to the store manager why I was dissatisfied.
As for the tilting/binding, unless it bands in random places throughout the range of motion of the follower, I suspect the issue is probably being caused by pushing the follower beyond the depth required to hold five rounds, causing it to hit the 'pin' on the front side but being allowed to continue downward motion on the rear causing the tilt/binding. If you have the means, pinning the magazine in a similar fashion at the REAR of the magazine, should help keep the follower level once it bottoms out. An anti-tilt follower would be the better option, but then you have to find another way to pin the mag, and I am unsure if it would be legal to do yourself. Lastly, if returning the magazine to point of sale is an option, that is your best bet.