A 7mm magnum (Remington, Weatherby, WSM or SAUM) has negligibly more recoil than a .30-06 (+/- a pound or two depending upon exact loads, rifle weight etc). They do tend to have slightly more muzzle blast, but are not significantly worse to shoot than an '06.
If you dislike the recoil of the .300 magnum, you are correct in that you will shoot it less. The ammo for an '06 is also significantly cheaper when comparing apples to apples. A bigger, more expensive case, and more powder will always cost more to produce, factory or handloaded.
Shooting should be fun. If you hate the recoil, it will never be fun. In the field, you will never notice the difference in energy between a .300 mag and a .30-06, except at longer ranges where the extra energy of the magnum may give a slightly quicker effect. You will notice the flatter trajectory of the magnum, but only on shots beyond 300 yards.
Either rifle you are looking at is a well built firearm and should serve you well. The best one for you is the one that fits you best, fits your budget, and combines a cartridge of adequate or more than adequate power for the game you are hunting, while being within your tolerance for recoil. A good bullet in a .30-06 will easily kill any deer or elk you will encounter if you place it into the vitals. So too will many other cartridges, but if you want an '06, get it, shoot it, build confidence in it and go kill your animal(s).