Personally, I'd go smaller to a .243
Plentiful cheap ammo (crappy Tire - $18/box, $5ish/box less than the calibres you mentioned), basically no recoil, flat shooting, great dear/coyote gun. If you buy a quality gun, it's also of a size/calibre that you could start off kids/wife/etc. on.
If you ever go for moose then buy/borrow a bigger gun.
Everyone talks recoil, but noone ever mentions noise. If you're in a populated area, the .243 is more of a "crack" and the .30 calibres are more of a "boom".
Me.