You need a heat source - kitchen stove, electric or propane hotplate, or casting furnace.
Next, a bullet casting ladle(Lyman or RCBS), and an appropriate bullet mold with handles. If you want easy accuracy and velocity from a rifle, you are probably better of with a gas checked bullet design, and will need gas checks.
Then there's the lead - the alloy is important. For smaller calibres or higher velocities, use an alloy that can be hardened(drop bullets from mold into a pail of water with a pad at the bottom being VERY careful not to get water into the mold). This alloy must contain antimony to harden and a little bit(1 or 2%) tin. Most of us use old wheelweights and 1 - 2% tin.
For lower velocities or if your rifle prefers it, 1 part tin to 20 parts lead is good. Don't be hung up on which of the two to use. As someone said 50 years ago or so, some of these questions you have to ask your rifle.
Last but very important you need a reloading manual that covers cast bullets. I suggest the Lyman manual or their cast bullet handbook.
I'm a little out of touch with current costs - for a start try Higginson Powder for Lee molds and accessories, Wholesale Sports for reloading dies(Lyman or RCBS). It depends a lot how much of a factor cost is.
It's a great hobby with a lot of history and a great way to shoot a lot more for a lot less. I'm sure there are lots of people here who will be happy to help you along the way. All the best and I hope you take it up and enjoy it.
Grouch