I'll probably get a lot of hate, but a good place to start is one something like a Lee Anniversary kit. I started out on that and I learned a lot. It comes with a press, scale, powder measure and everything you need except the dies for your specific calibre. The best part is it comes with a Lee manual with lots of very good info and recipes for each calibre. I used it initially and learned a lot. I sold it and upgraded to a Hornady progressive press, but eventually got an RBCS single stage press for all my rifle calibres. I only use the Hornady for pistol/high volume reloading for 45acp. Was always thinking I should have got a Dillon, but don't know.
I think a good balance scale is as good as you need for reloading unless you need high volume.
If you want to learn, I would suggest the 100th Anniversary from Lee (or whichever comes with the manual) and then upgrade to a progressive once you need its of volume.