I like 'em. I've always been a fan of single shot firearms in general, both higher-grade and also budget-grade ones. I owned a bunch of assorted H&R/NEF singles back in the day, and generally enjoyed them. Now that they are no longer made, most of the examples that come up for sale are listed at much higher prices than they sold for new...and, at these new prices, they simply aren't worth it.
The Henry singles are much nicer firearms than the H&R's ever were. I've had a couple, in fact just sold one a couple weeks ago, still have a brass-framed .45-70 that I very much enjoy shooting. As Suther stated, as long as you get one that was built post-recall or sent back for the recall work, they are a joy. Most of them have some very attractive wood in their stocks.
Another gun to look at is the CVA Scout series. These are even better than the Henry products in terms of average accuracy, trigger pull and general shootability, at least based upon the several examples of each I have owned or examined. The only catch is that they are all synthetic-stocked and, relatively speaking, kinda ugly. I think that if CVA brings out a wood-stock option, and/or an outfit like Boyd's starts selling aftermarket wood stocks for them, the CVA rifles will own the budget single-shot market.