Check with your local garages and tire shops. Best source of casting metal is used wheel weights! I get 'em free by the 5 gallon bucketful! I've got about 200 lbs of ingots cleaned up this summer. Still have about 800lbs waiting to be cleaned and cast into ingots.
The Lee casting stuff, with the exception of their lead ladle (Total POS!), is okay. Some moulds are difficult to cast good bullets, i.e., cast out of round bullets, etc... A better option than the Lee stuff is to go to a junk store and buy the biggest cast iron pot, dutch oven or similar that they have....get two if they have 'em. The cast iron pot plus a Coleman stove (propane or coleman fuel types will work) and a run of the mill soup ladle will get you into the casting game.
BEFORE trying to melt any metal, get the Lyman Cast Bullet Handbook and read it. Casting can be a fun and safe hobby if you do it right. It'll also save you money in the long run if you must ship in reloading supplies, i.e., live in the boonies like I do.
Most importantly, you Must wear proper safety equipment. Eye protection or full face shield, pair of heavy leather gloves (welders gloves work good) leather apron if you have one (extra layer of protection, but not absolutely necessary) wear cotton fiber clothing, no synthetics. Some sort of mask or respirator will also prevent you from breathing any potentially noxious/poisionus fumes or minute lead particles.
Keep water and sweat away from molten lead. One drop of water and you'll have a lead explosion and molten lead sprayed everywhere!
Check out eBay or the exchange forums here on CGN for used Lyman, RCBS, SAECO or H&G moulds. Far superior to the LEE product.
One of the best resources for newbie casters is the Cast BOOLIT forum here:
http://castboolits.gunloads.com/index.php Great bunch of guys there, many of them refugees from the now defunct Shooters.com site.