Hmm... You mention that some of the brass is once fired... Suggest you segregate the new and used brass. Unless the brass is once fired by you, I would be suspicious of the brass. (Aside from a safety issue, mixing brass can compromise accuracy.)
You mention that about a third of the cases display this problem - perhaps it is the used brass. The necks may have lost a bit of ductility through work hardening, and are springing back a bit.
Regarding the mandrel - not sure if you have surmised the dia by measurement or you are reading the notation on the mandrel (308). Anyway, sounds like you are close - resolve the brass issue, and polish the mandrel if needed.