I have a thing for pre-decimal Australian silver coins. I've found that these are fun to collect because I can relate to them, adding to the fun.

Their silver make up allows them to hold value, while remaining somewhat accessible in terms of price and scarcity.

I'd definitely recommend starting with a collection similar to this if you're just getting started.