First, what twist rate does your barrel have.
Those bullets are a bit short for a 1-10 twist and can be over stabilized at higher velocities.
I found the best twist rate for bullets that light, which I have shot thousands out of a Hunter Bench Rest rifle chambered for 308Win. with a 1-15 twist rate.
After that barrel was burned out, the next barrel had a 1-14 twist rate and liked the same load.
My present 308Win has a 1-12 twist rate and it also likes this load. Sub MOA groups out to 300yds, if I do my part.
I've tried it in a rifle with a 1-10 twist rate and it doesn't perform well. Two inch groups at 50yds and getting larger as range increases, to the point that at 200yds they won't even hit the target. My suspicion is that they are coming apart in flight, before they get there.
The powder I used was W748.
My accuracy load was:
50.0grn W748
Speer 125 grn TNT
CCI 250 mag primers