Prior to 1992, IMR 4895 was THE standard powder for Palma/TR shooting at ranges out to 1,000 yards. It still works, but it maxes out with pressure before you get really high velocities.
For example, most people will agree that a standard hyper-accurate .308 load is 41.5 to 42.0 grains of IMR 4895 pushing a 168 Sierra. This is one of those "universal" magic loads, and it still works today. However, if you chronograph it, you might find that it's not giving you more than 2,550 fps velocity. At 1,000 yards, this would be trouble, but for closer ranges, it's still great. This is essentially .303 British-level power and should be good for hunting.
On the other hand, these days most 1,000-yard shooters want a powder that will push a 155-grain bullet at or above 2,950 fps (out of a 30-inch Palma barrel). Varget has no trouble doing this, and it is cheap and readily available. Theoretically, IMR 4064 should give very similar performance, but anecdotal reports suggest that it is more sensitive to changes in temperature, and it tends to give a bit more signs of pressure at the top end. This is why the majority of shooters use Varget.
If you really want to stick with IMR powders, that's totally fine. I'm confident that IMR 4895 and IMR 4064 should work with the 165 Nosler for hunting loads. Personally, though, I prefer Varget -- but I'm a competitive shooter and I go through pounds and pounds of the stuff.
Once again, for a hunting rifle, even your idea of using IMR 4350 with a 165 Nosler should work fine. You don't need to buy the other powder unless you actually want to play with it.