The first question that I would ask you is what are you planning on reloading for? Handguns tend to use more ammunition than rifles, and reloading several hundred 9mm on a single stage press can get boring in a hurry. On the other hand, if you are primarily reloading rifle ammunition, then a good quality single stage press is ideal.
Having said that, if you are even considering getting into reloading, the best advice I could offer would be to buy a reloading manual (or two) and to read them. Do not just read the "Load Data", but read the whole book including the really dry parts on safety and proper techniques. I would recommend Lyman's 49th ed and/or the current edition of the Hornady manual. There is no reason to buy anything else until you have done this.
Availability of materials can, at times, be somewhat problematic. This applies to the equipment which you will need, but to a greater extent to the "consumables" with powder often being particularly difficult if you are looking for something specific. The availability of powder is getting better, but if you need some "right now", then it never hurts to have a Plan B in mind. Like the song says, "You can't always get what you want, but if you try sometimes, you'll get what you need."
Start-up costs are fairly significant and there are a few trains of thought. Some will say get something cheap just to get reloading and to mitigate the cost by the savings you will get in the lower cost of reloading your own ammo. Others will say "Buy once. Cry once." and recommend getting great equipment to start with. I would tend to say the truth is likely somewhere in the middle. There are several kits out there that will offer a new reloader the 80% solution. They offer reasonably good components at a reasonably affordable cost. Keep in mind, though that if you go this route, as your skills improve, and needs become more clearly defined, the components included with your kit will likely be outgrown and you will want to upgrade. Only you will know when (or if) you reach that threshold.
If you plan on reloading only rifle ammunition, I would look at a single stage press such as an RCBS Rockchucker or comparable press (kit). This will give you the lowest cost option and the potential for the most accurate ammo.
If you plan on reloading pistol ammunition, I would seriously consider a turret press (kit) such as the Redding T7 or the Lyman T-Mag. This will give you the ability to use it as a single stage press if you do reload rifle ammunition, but will also allow you to reload higher volumes of handgun ammo in a reasonable amount of time.
No matter what you eventually get, know that no kit is complete it is just a really good starting point. You will almost certainly need to pick up odds and ends that didn't come with it.
Read everything I wrote with a grain of salt. It is nothing more than an opinion. Hopefully it is an informed opinion, but other people will have other opinions. Weigh all of the advice, and do what is right for you.