I load 3-5 times before annealing the case necks or they'll split from work hardening eventually. Many guys report 7-10 loadings before a split without annealing.
I neck size until the cases don't chamber easily anymore; varies from 2-7 firings depending on the rifle, pressure, cartridge, etc. I don't really full-length resize but just bump the shoulders back with the FL sizing die.
I'm up to 15-ish reloads on various sets of brass using this method and haven't had to pitch a whole set yet because of splits (but have for other reasons).
When the case is fired it expands. A new bullet will usually drop into the case through the neck as the neck has expanded and can no longer hold a bullet. Sizing the case brings the neck back so it can hold a bullet properly with neck tension.
Cartridge cases are designed to expand to seal gasses and then contract slightly to allow for easy extraction. Over time they don't contract much anymore in the body and the cases will be a near perfect match to your chamber. If the chamber is very slightly out of round, even .0005" (1/8 thickness of printer paper), and the case is not inserted in the same orientation, it wont go in easily. Also if the shoulder has moved forward and is now very firm between the chamber shoulder and bolt face, the bolt wont close easily. Sizing returns the cases to a smaller dimension so they chamber quickly and easily. You don't want your bolt to jam half-way when loading a second round for a follow-up shot.
Normally the cases will start to get stiff to insert or stiff to close the bolt, and I know I have to bump the shoulder back. If I continued to load the same cases with only neck sizing they may eventually not chamber at all except in one very specific rotational orientation. A bolt action rifle is operated by you so you can apply as much or as little force as is required. There is less mechanical advantage in a lever action or pump action and the chambering force is controlled by springs in a semi so these rifles often don't feed well with neck-sized cases. Sometimes it'll work but that's determined on a case-by-case basis.