For light whitetail loads in a 30-06, I have used 150 grain bullets. 4895 powder is excellent for loads less than full power, because it is accurate at lower pressure, as well as at full pressure.
I loaded them to about 2650, but you could go a bit lighter, if you wish. Just look to see what a starting load is in a loading chart. It may be about 2650, but just go higher, or lower, to get the approximate velocity you want.
Sight it in for about 2 inches high at 100 yards, but don't ask your rifle whether it likes it, or not!
I have never yet seen a bench rest out where deer are shot, so practice with a shooting position you would be likely to use when shooting at a deer. That may be sitting, standing, kneeling, leaning up against a tree, or many other variations. A tin plate about five inches across at 100 yards is about right. If you can hit that about three times out of five, go get your deer.