Well, most magnums will only give their best accuracy and consistency with near max or right on max loads.
Back in the day, when I suffered from magnumitis I strived to find a powder that filled up the case completely, to the base of the bullet, even if it was slightly compressed. This, IMHO, led to far more consistent velocities and accuracy. This also seems to be the case with intermediate cartridges.
All of this might just be my imagination as well. I will say, all of my rifles behave best with slightly compressed loads as a rule of thumb. There comes a point though where to much compression can be a problem. Especially with faster powders.