I am assuming you are talking about target shooting, not hunting.
I shoot often.
I shoot precision bolt action rifles.
I do not clean them until accuracy falls off.
Many believe, as I do, that damage can be done by overcleaning.
My Tikka T1 gets cleaned after heavy shooting sessions of over 150 rounds, which many here call the first half hour of the outing.
I've settled on the 150 round number, because, depending on which ammo I',m shooting and for what purpose, accuracy tends to go south around that number.
If I'm shooting the Aquila type that is likes, It shoots very well, starting on the second shot.
For hunting grouse/bunnies out to 50 yards, the first round gives acceptable accuracy and I don't bother with a fouling shot.
The advice given above to not clean until accuracy drops off is good advice.
It doesn't hurt anything to run a very lightly Kroiled patch down the bore, after a hunt or shooting session to get the crud out.
I've used this method with all of my decent 22rf rifles for the last 20 years.
My rifles work best up to appx 300 rounds, before accuracy startst to suffer. At first it's hardly noticeable, other than the odd unaccountable flyer.
By 400-450 rounds, I wouldn't trust them to hunt with.
That being said, I've seen 22rf rifles with thousands of shots through them, that have likely never been cleaned in a decade that are outstanding tack drivers.
It's up to you to find the sweet spot.
I find that some of the lubed lead bullets are extremely soft and will leave lead fouling behind, even in very smooth bores, such as those found on most Tikka/Anschutz/CZ offerings.
It sounds like you're just getting to know your rifle well. Good on you. The more quirks you can figure out the better.
You will find that each brand/lot of ammo will have different sweet spots.
Very difficult to recognize those sweet spots with cheap, Federal or Blazer offerings.
Doesn't mean they won't shoot well, just means they won't be reliably consistent from shot to shot, depending on your accuracy requirements.