I use to cast outside, when I was in my teens and my mother did not like the smell in the garage seeping into the house. I did cast on cold day around -10, it is doable, but I found the molds would cool really fast and two minuets in the cold and they would take ten or so cast to bring it back to temp, so not really worth it. But I did do it when I was determined, but I recommend find somewhere warm.
She was smelling your flux, rather than the lead, I figure. Smoke is easy to smell.
Cheers
Trev