Some interesting comments on causes of group sizes. There are lots more reasons why the bullets don't all go into the same hole.
Going from a standard military type trigger to a good custom trigger, where the release occurs within the trigger itself, will, without doubt, cut down group size.
Lighter recoiling rifles will make better groups than heavier recoiling rifles, with all other factors remaining the same. OH, I can hear the voices out there screaming, "Not Me, I never flinch with a big boomer!"
OK, let's give you the benefit of the doubt, for now, you don't flinch, but your rifle moves, even with remote release of the trigger. Years ago the British military were great for figuring out every thing and finding reasons for what happens. They discovered that with the standard full wood Lee Enfield 303 rifle, shot by an average weight soldier lying prone and wrapped up in his military sling, moved back a tenth of an inch, before the bullet left the barrel!
So if your big boomer is resting on sand bags, or commercial rests, is it not reasonable to assume the barrel is going to rise before the bullet gets out the barrel? Or if it just moves backward before the bullet gets out the barrel, the movement will not be the same with every shot. And since the distance to the 100 hard range is about 100 lengths of your rifle, any upward movement of the barrel would be multiplied 100 times in the distance to the target. This means if the barrel rose 1/10 of an inch before the bullet got out of the barrel, it would hit ten inches high at 100 yards!
And even if the barrel rose only .01", about the thickness of one sheet of writing paper, before the bullet got out the barrel, it would hit the target one inch high.
One other thing about recoil. After the 308 Winchester came out it soon became very popular in bench rest shooting and people assumed it was more accurate than the 30-06. But world class bench rest shooters soon corrected that theory, stating the reason they shot better with the 308 than they did with the 30-06 was because of less recoil with the 308.
In short, there are a great many reasons why we don't make one shot holes with our rifles, if we shoot more than one shot!