The radiation danger posed by tritium in sights is negligible. Unless you're inhaling with your mouth right on the vial when you pop it, you probably get more radiation daily from the sun and cosmic sources.
Regardless if a sight pusher is the 'way to go', it's not the only way. Careful drifiting with a PROPERLY FITTED sight (ie: not oversized) should not damage the vials.