That's not written in stone DB. It really depends on the rifle. Especially twist rate and length.
WL, Varget should be just fine for 55 grain bullets just as all the good folks above have stated.
It's been my experience with different rifles, chambered for the 22-250, that twist rate and barrel length have a big difference in harmonics.
Heavy barrelled rifles not so much, but walkabout hunting rifles with normal profiles can be quite fussy.
At 34 grains, with a 1-14 twist rate, you're just getting into the "accurate" node. Bump it up a grain or use magnum primers, if you can get them, and the groups you're getting will get tighter.
Sounds like you're cull hunting, so accuracy just has to be enough to bring the animal down asap. If you're happy with the accuracy and it will work for you, stop where you are.
Working accuracy that is consistent is far more important on cull hunts than tiny groups. Tiny groups don't hurt anything, but when they aren't needed, time in such cases is money.
Keeping it all in perspective is the key.