Remove the bolt & while looking through the breech end of the receiver into & through the barrel, hold the rifle up to a bright light. You should see sharp rifling starting just after the chamber, continuing throughout the barrel. Is that what you see?
Now reverse the process. You should see sharp rifling right up to the bore's crown.
Now look at the barrel muzzle. Where the steel at the muzzle end of the barrel meets the inside of the barrel, are there any gouges or bumps?
Since you have Burris Zee rings installed, are they the ones with plastic inserts?
Loosen the screws on one side of your scope rings just a bit until you can twist the scope with your hand. Again, with the bolt removed, look through the scope at a specific point either on the wall or at a point outside. Do the cross-hairs stay put on that point as you rotate the scope around its axis, or does the point change as you rotate the scope?
Removing iron sights will not cause bullets to key-hole.