If the bedding, optics/mounts, rests, bench, etc are all good, I would keep adding 0.1gr and you will start to see the groups shrink, and flatten. Then they will rapidly expand and you will start to see pressure signs.
Also, keep in mind the accuracy potential of the rifle and bullet. If this is a factory rifle, I would be thrilled with consistent 1/2 min accuracy. Even more excited if using your average hunting bullet.
Match bullets like Berger will offer more accuracy BUT the barrel may not.
If things continue to improve, you will likely find your load around 20.1gr. When you do, test a bit above and see how much more it takes to cause the groups to grow to what they are now.
If it takes 0.1gr, then you have to keep an eye on ambient temp changes and adjust for that. Likely lower your loads as you get warmer, increase your load as you get cooler.
Just like keeping a musical instrument in tune.
Jerry