It will pull out as suggested.
The problem is that it is difficult to get a grip on the handle because of the sharp edges of tin gearbox cover. I lever with a flat bladed screwdriver under the handle just to prise the dip stick up an inch or so. Then you can get your fingers around the dip stick handle and pull it up. You will then see that the reason why it is so difficult is that there is a long cork seal on the dip stick where it sits in the gearbox top.
Have fun,
Tony