You should be able to physically check the splines on the hub and wheel..they will likely have sharp knife like edges if worn. If you have 'backlash' with the drum and hub stationary then it sounds like splines.
My Healey had the clunk and i replaced the hubs only, the wheel splines looked fine which surprised me as i though the wheels may be softer than the hubs. It cured the clunk.
