Big bore heavy caliber rifles are never pleasant to shoot from a bench....for anyone. However all it requires is absolute focus and the realization that it will not cause any real or lasting damage. When I bench rifles with muzzle energies exceeding 5000 ft/lbs like my 470 NE, 375 and 378 Wbys, 9.3X300 WM, 416 Rigby and a few more, I find it best to keep the session down to 20-25 rounds in an afternoon. Interspersed with lighter more pleasant cartridges to bench. The lighter cartridge rifles will also let you know if you're having a twitchy day and maybe starting to flinch. No one is immune to flinching, it can happen to all of us and particularly from the bench. I know I have rock solid nerveless days and I have jumpy twitchy days....on jumpy twitchy days it's best to stay with the lighter calibers and FOCUS.
One thing I do know is that once I have a heavy sighted in and a good load worked, I seldom bench it again. I also know that I never feel nor hear my rifle go off when shooting game, so it's not likely I'm jumping the trigger or anticipating recoil (flinching) either. Rifles like my double 470 are a lot of fun to shoot when standing on your hind legs. Recoil rolls you around but is not painful or unpleasant, velocity is only 2160 fps with a 500 gn bullet. When the Rigby is loaded to potential it is bordering on ugly and is not pleasant with a 400 gn bullet at 2600 fps. I haven't done enough with my 378 to really give a good opinion yet. I think It could be a bit of a "yelper", what I have done hasn't been particularly bad but I haven't tried max loads with the 325 gn bullets yet.
Generally speaking, I guess heavy recoil and some folks just don't go well together. I don't believe everyone can overcome it, most I think can but just like a boxer with a glass jaw, some things we just can't control. I think it has a lot to do with how a guy/gal is wired and whether they are fairly stoic or pretty high strung. As has already been said here, I do know recoil sensitivity or lack thereof has absolutely nothing to do with physical stature.