For all the work involved, I tumble all rifle brass after sizing, to get the lube off, and to better visually inspect it. And all pistol brass before sizing, to get the dirt off it before putting it through the dies (sometimes again after, to clean up the primer pockets). Fortunately, I have enough brass for at least 3-4 range trips, in everything I load for. So if it takes time, it's no big deal.