The old rule of thumb with points of contact is if the pressure is increased(say barrel heating for one) the rounds will tend to be shifted in opposite direction of the pressure point generated.
A perfect teaching/demonstration example of this and one you can experience through a full range of adjustment is with the Remington 742/7400 Semi Auto Rifles. I figured this out over 30 years ago with a 7400.243W I had just bought and thus never had a complaint with these rifles for accuracy or their wandering zeros and I still own one in 30 ought-six.
Was zeroing for Deer just this fall, had her POI exactly at 200 yards with the cheapest ammo I could find Winchester 150s, then realized I hadn't gone through my yearly clean under forearm, re-tighten and mildly locktite the forearm screw ritual, that stays put till Deer season is over.
I applied the 1/8 turn necessary to do this right on the bench and then wondered just how high she would fly now from my established zero, remember she's going opposite the pressure so up she should go with it applied to the bottom of the barrel in the gas lug by the Screw.
Fired again from the bench rest and my 200yard zero went from point of aim on my 200 yard lower target to point of aim into center of the bull on my upper .270 target,..... a full 2 feet!!!. See what a little tension does to a whipping barrel LOL.
This is a roundabout way to tell you if your ferrule, or anything for that matter,.. starts to exert a tiny bit more pressure on top of your barrel during heating, your rounds are going to fly 180 opposite from this, so they go down, lower impact if the old rule of thumb applies here.
I'm guessing by the barrel heat up procedure guys speak of before shooting for groups, this pressure only reaches a certain point and then stabilizes there.
The post with Thomas' correction to a plastic stock is what you should do to your stock and be aware of contact points that will shift zero opposite them on increase of pressure caused by heating.