How do you get stones?

I've been playing for some time now and haven't figured out how to find specific stones and was wondering if it's just a random drop. Can anyone confirm this?