Perosnally, I don't think the group size has anything to do with your loads.
Don't get me wrong, your groups show other variations caused by other issues than your load development indicates.
Ganderite had a good suggestion about adding an extra half grain. The problem with small cases, is that depending on powder used, pressures escalate rapidly, even with small increases of any of the components.
I notice your scope doesn't have an AO adjustment. The ideal paralax adjustment may not be at the distance you are shooting.
From some of your groups, it looks like inconsistent shoulder/cheek weld placement or slight canting of the rifle are involved as well. Those high mounts don't help but are needed with that scope.
Are your crosshairs and target both sharply in focus at the same time????
How consistent is your trigger pull? Both your own finger and the trigger on the rifle.
Now for the biggie, how often are you cleaning out the jacket fouling?
There is the very odd exception but in most rifles, anything over 25 rounds will start to show spreading groups. Some will start to indicate fouling problems at far less. Even the best barrels will have this tendencey. I have one rifle that seems to be impervious to fouling. ONE, out of dozens. Maybe you have a lottery winner as well???
Neck resizing only is a very good idea but if your chamber is already large in the neck area it might not help. If this is the case, partial neck sizing might be a good idea.
Also, have you checked your loads for run out?
Another thing that may help, is to seat your bullets very close to the leade. Say .005 inch.
Many bench rest shooters, seat the bullets so that they are touching the leade.
Here is one more thing to consider. If the rifle was new off the shelf, it will need a break in period. The better groupings that you are getting as you go along, may be due to your barrel settling down and some of the rough spots smoothing out.
The dispersion shown on your targets, can mostly be accounted for by shooter error. Not much error there either. You need an experienced mentor to watch your technique.
That rifle behaves very well. That shows by how it groups all of the loads very close to center of target. If your technique, were more refined and consistant, your groups would all be tighter and each load would show slightly higher groups, if you use the same scope settings, with each increase in powder charge. Maybe, even some windage dispersion.
From what I can see there, that rifle is capable of sub 3/8in groups on a regular basis. If it has the 1-8 twist rate, it may even prefer heavier/longer bullets than you are using to stabilize them properly at 100meters.
As you saw from your 55 grain attempt, the twist rate is probably to fast for the bullet.
A real master of 223 shooting, is David Tubb. He uses a bolt action AR look alike system and loves to shoot off hand.
I witnessed him shooting a match and he shoots better offhand than most fellows do from the bench. He is abosolutely meticulous about his rifles and ammunition. He even figures out how much his leades will wear after a specific number of fired rounds and loads accordingly.
He told me that 90% of the shooters he competes against, not me, don't have consistent trigger habits and don't take their breathing into account. He wouldn't admit it but I suspect he even monitors his heartbeats.
DT, seems to have unlimited money to spend on his rifles/optics/ammo components.
He gets his components in huge batches, all from the same lot as well. Same goes for powder, cases, primers and bullets. He will test them out on a test rifle he has bolted to a bench, with a particular batch of barrels. If they don't perform quickly, the barrel is changed out and tested again. If it doesn't work the second time, at least to his standards, he won't bother to play around with components. He expects them to perform as advertized. If they don't, back to the supplier they go.
Every component supplier in the US, maybe even the world, would love to have David Tubb using their product. It's an endorsement made of gold.
One more quick bit to look for, although you are shooting very well, is light condition. Bright sunlight, reflecting off the ground, will cause elevation dispersion, as will mirage. At 100 yds, wind shouldn't be much of a problem but it can be if it's fast enough.
One thing about wind, it's the wind in the first 50-100 yards that puts most effect on your bullet out at longer ranges. Mostly. When shooting extreme distances, heavy winds are possible at any distance.
This can go on forever.
Nice rifle, nice shooting. You're very close to shooting to what the rifle/ammo is capable of.