I remember posting the very same problem in 2008 when I bought my first Morgan and at least a dozen owners posted back news that this was a standard feature, "they all do that Sir".
Some interesting and ingenious ideas have been suggested as a cure, such as hair driers and vacuum suction, but nothing fixed mine other than warmer weather.