I was going through what you are back around December. I had a serious itch for an accurate varmiter in .204 Then the Savage model 10 xp in .223 went on sale from Cabelas canada for $100 less than the other calibers, including .204.
Still I hesitated, until all the other calibers became sold out so I grabbed one in .223 while I could. Very happy with it, a real tack driver, literally, I hit a thumbtack the other day at 100 yds!
Cheap ammo is plentiful and available in all stores whereas .204 is still a search here.
The 10 XP is not light though, mine is 10 lbs + with the scope. Cabelas did have a smoking deal recently for a TC venture package + foxpro caller for less than my Savage and it is a thin, fluted barrel.