I have an HS stock on my Rem. 700. When setting the action into it, I have to make sure it's bottomed out completely towards the stock before tightening the action screws.
The slot for the lug isn't a snug fit, so the positioning of the action can vary enough to make a difference...and in my case, not allow the bolt release link clearance and thus block its function.
Skim bedding, with attention to the lug area, is probably a very good idea, as eventually recoil is bound to shift the action within the bed, certainly with heavy recoiling calibers.
I've read that aluminum bedding blocks are subject to temperature changes that can affect it, albeit nowhere to the degree that wood is affected. I tend to think this aspect is tad bit overstated.