I'm in much the same boat as you, and this is what I've come up with for my 'wants' for shooting.
Field-hunting deer out around ~400 yards, longer range plinking and varminting, with the ability to take longer shot strings. Gonna look for a heavy-barrelled 243 Win or AI build with a higher power (maybe even fixed power) scope. From what I've seen and read, it's hard to beat a 243 for filling the lower end of lethality for deer and the higher end of lethality for varmint, but doing both effectively.
Hunting rig with the power to reach out (500+ for moose, deer, elk etc) when/if my skill and opportunity allow it, I'm going with a custom 270 WSM build off a Remington 700 with a #4 or 5 contour match barrel. If I was sticking to more common long range calibers I would pick up a used rig on the EE, I am however a little partial to the 270 cal, and have had good success with Matrix bullets, hence the different choice.
Or I might omit the .243 all together. There are some 90-110 Gr varminting bullets in .277 that might do the job (without destroying the pelt) if loaded down a bit, even at short range...