Large brush busting calibers are nothing but a myth regardless of how many people believe otherwise, so don't put any stock in that as a basis for one caliber over another.
http://www.chuckhawks.com/myth_busting_calibers.htm
Bullet selection will make more of a difference on this subject than caliber alone.
It's best to go with a very popular caliber so it's easy to find ammo.
I find that you should test the limits of low recoiling calibers so you will be able to shoot accurately while under stress. For this reason I would avoid calibers like the 30-06 and even 270. A 308 is very common and if you can find 125 grain ammo in particular it's a nice balance of power and light recoil with great deer killing performance. If you want to shoot far, then you can generally do that very well too with 150 grain bullets.
I would really set the 308 at the upper limit regarding recoil. So that being said, go with something no bigger, because bigger will help you develop bad shooting habits, flinch and ultimately miss your deer. A 243 is probably about ideal, although I would prefer something that takes about 20 percent less powder for deer if it was a common caliber.
6x47 Swiss Match would be just perfect for deer if ammo was easy to find with bullet weight of 108 grains. If you're into hand loading this would be just about ideal. You'll hit everything you shoot at.
260 Rem is also real nice and accurate for deer with only moderate recoil.