yes just don't try it with an aluminium one!
It's perfectly possible to anneal aluminium, Steve. The trick is to rub soap all over it and heat it until the soap turns black.
I dislike aluminium washers though, and always swap them for copper if I find them.