The OEM gaskets are quite stiff - a sandwich of hard rubber, aluminum, and hard rubber with a formed sealing ridge. But it's a lightly stressed gasket so I suppose one made out of normal gasket material would be fine - it's just sealing the drain-back oil from the rockers.
I was surprised at how heavy the stock cast rocker covers were.
