No clue what your issue is, but maybe read up on parallax?? If you are using a centerfire cheap Bushnell - could be set by factory for 125 or 150 yard parallax - then you are using it for 20 yard shots? Would be all on your cheek placement on the stock. To check for parallax sighting error - set rifle on something solid - rifle not moving, not able to wiggle. Then aim at a target, at distance of interest - now move your head up and down or side to side. If there is parallax error, the cross hairs will appear to move against the target. I have a Leupold 2-7x28 rimfire scope - parallax free set for 60 yards as per the Leupold book - at 15 yards, if I go extreme one side (so I start to see some black in the view) to extreme the other way, easy move the cross hair more than an inch on that target.
I also have a Bushnell scope that "broke" - started to sight in one on a 303 British - holes just kept walking right, even though I was adjusting the windage turret to bring them back - nope - just continued right - further and further each time I fired. That scope was replaced.