The natural instinct is to assume that its the hard surface that stands wear and the soft that gives way but usually its the other way round.
My understanding is that it's because abrasive particles tend to embed themselves into the soft material, where they are held firmly and thus able to wear away at the harder surface.