ok, I re-read...
You can install it, you can use it, the only problem is the safety won't engage because it is off slightly... correct?
The other problem is you feel the barrel is rubbing on the slide when it cams/tilts? This is normal, almost all semi-auto barrels tilt and get rubbed.
I think this is a minor fitment issue (judging from the safety pic). Seriously, today shoot a thousand rounds through it and your safety might move up afterwards.
Otherwise, I think a reputable gunsmith could remove a little material from the breech face and solve your fitment issue.