The OP asked about muzzleloading rifles.
But I'm going to suggest that it is worth considering a smoothbore and small game hunting to begin. Small game hunting opportunities can be a lot more common than big game.
There are some modern reproduction shotguns, that do turn up from time to time at reasonable prices. Perhaps $500 or less.
Original guns in shooting condition are not uncommon and can be quite reasonably priced. In past ten years or so I have paid from $100 to $1125 for shotguns in serviceable, shooting condition. The least expensive was a Belgian percussion double, the most expensive a British flintlock single.
But I'm going to suggest that it is worth considering a smoothbore and small game hunting to begin. Small game hunting opportunities can be a lot more common than big game.
There are some modern reproduction shotguns, that do turn up from time to time at reasonable prices. Perhaps $500 or less.
Original guns in shooting condition are not uncommon and can be quite reasonably priced. In past ten years or so I have paid from $100 to $1125 for shotguns in serviceable, shooting condition. The least expensive was a Belgian percussion double, the most expensive a British flintlock single.