Hi Oliver,
Just a thought, make sure you completely remove the locking screw from the base stem. It may be that although the screw is loose it is still projecting inside enough to stop the mirror stem from coming out of the base.
Good luck and welcome!
