Bullet weight is a big factor, bullet shape as noted above will also play a big role.
Best thing to do is sight it in with whichever bullet youou choose and then try the others to see where they will impact. For my 7mm-08, I sighted it in with Federal fusion, 140 gr, can't remember anymore than that. Then I reloaded some Winchester brass with 139 BTSP Hornadys and they shoot the same, only tighter.
With my 22-250, I used 45 gr Winchester (white box walmart special) ammo I got about 3/4" group, then I tried 40gr balistic silvertip (factory) not only did I get a much bigger group but I was 2 inches higher and 4 inches to the righ, then I tried 55gr soft point (factory) and shot about the same as the 40gr. But my reloads, 50gr Vmax, shot in the same place as the first load and shot wel under 1/2"
You really just have to try it, when you find the ammo you want for hunting, then you need to try it at 50yds, 200yds and every 50yds after that that youplan to shoot it. I was quite surprised to see my 7mm-08 to hit almost the same at 50 as 100, 200 a bit low, 250 a bit more BUT 300 was about 6" low! I have since reasoned, that I am good to 250yds but anything longer will require alot more practice and experience. Man I wish we had ground hogs down here!!!