Let's start with what's avaialble on the market right now:
Mosin Nagant m91 (m38, m44, type 53, etc etc etc etc)
The Good - cheap ammo available, can be taken apart and cleaned without special tools, sights are decent, cheap to buy and easy to find, can be accurate shooters. Come in different lengths. Special magazine feature stops rimmed cartridges from jamming against each other.
The Bad - the ammo is corrosive so you'll have to clean it religously. Some of the triggers are good some of them are terrible. Built by every com bloc country ever and quality is different for most of them. Bolt is hard to work compared to others, may have issues with laquered ammo (bring a 2x4). I find the stock isn't very ergonomic - may be different for you.
Overall - if you can find a nice clean specimen and you're willing to do a bit of tuning and cleaning after you shoot it you'll have a damn fine rifle for a low price that you can afford to shoot without reloading.
Lee Enfield No4mk1 or No1mk3
The Good - Firepower! A 10 round magazine with a slick bolt means lots of lead down range in a short amount of time

Excellent sights on #4. Decent trigger. Great historical significance to Canada. Available for a decent price. Easy to find parts - sporter parts guns can be had for cheap with all the spares you need. Ergonomics are good. Build quality is generally good.
The Bad - You can go through ammo very quickly with this rifle if you get excited *L* If you want to shoot for cheap you have to reload (not really that much of a problem). Bedding can be an issue and it's hard to fix properly. Rifle naming convention can be damn confusing (No4mk1 - mk1* - mk1/2 - mk1/3 etc etc). Rimmed cartridges have to be loaded right or you risk a jam.
Overall - The Lee Enfield has a cult following and it's deserved. They're great rifles that shoot a good cartridge, are comfortable, don't hurt very much when you shoot them unless it's a No5mk1, and have excellent sights.
Mauser KAR98k or other Mausers
The Good - Nice handling rifle, no mag or snagging bits sticking out. Stripper clips work very well due to the rimless cartridge. The 8x57 cartridge combined with the strong action is a potent combination. Ergonomics are good. Bedding is easy to fix if you're into that, can be really accurate. Mausers come in all shapes and forms, small ring, large ring, #### on open, #### on close, all sorts of chamberings and barrel length, actions can be blued and some south american rifles are left in the white (beautiful). You can be pretty sure that a Russian refurb KAR98k has seen some action somewhere, not sure if that should be in the good or bad section
The Bad - People complain about the sights on this rifle and they are a bit weird - you can get used to them though and not all mausers have this problem. Triggers can often use some work. The rifle can be punishing to shoot if it's a heavy cartridge. Almost all mauser floor plates are a pain to remove so if you need to unload then you have to cycle the action to get them out (not a huge deal IMHO). Parts matching, German made Mausers are beautiful but are expensive - the Russian refurb ones are cheap but often look like crap (can be cleaned up though) and are forced matched. Late war KAR98k's can be really rough.
Overall - a strong choice depending on what mauser you end up with. The standard mauser is chambered in a great cartridge (actually all mausers are chambered in great cartridges). They're easy to operate, easy to handle, and they're tough. Can be really good shooters without much effort. You just have to watch out and make sure you're getting a good one, if it's German or a South American rifle made in Germany then you're pretty safe.