How much you want to spend, really decides for you.
On the cheap side, I'd look at a Lee Classic Cast single stage press. Tough, lots of room to get your hands in and move cartridges and components.
More money? Look at the RCBS, Hornady, or Lyman offerings. Pretty good quality all 'round, and not a huge difference in features. A used 25 year old Rock chucker will cost about what a new lee Cast will, and either will last you for the next 100 years or so.

Definitely look at a single stage press. I'm not a fan of the "breech lock" or similar systems, but if that works for you as a feature... But even after you are all set up with a big progressive rig (if), the single stage press will have a place.
I have, and still use, am old Lyman convertible hand/bench type press made of pot metal. It works. I wouldn't rely on it for reforming brass though. Not for long, anyway.
Look hard at the Lee or RCBS 'complete' kits. They have all you need to load. Some of the stuff is not the best, but it will get you going and it all works. Dead easy to upgrade the things you want to, once you have a handle on what works for you, and what does not.
Load data! Books, internet compilations, whatever. Never trust a single source for load data. Cross-check and compare. There have been some typo's in the load manuals over the years. Not many, not often, but cross-check anyways.
Cheers
Trev