It will pull out as suggested.
The problem is that it is difficult to get a grip on the handle because of the sharp edges of tin gearbox cover. I lever with a flat bladed screwdriver under the handle just to prise the dip stick up an inch or so. Then you can get your fingers around the dip stick handle and pull it up. You will then see that the reason why it is so difficult is that there is a long cork seal on the dip stick where it sits in the gearbox top.
Have fun,
Tony
Yes: I use a long bladed screw driver and pry it up. (prise???) It takes a bit of force. My +4 is neither cork nor rubber but not sure what the material is. But Tony and I do it the same way. While You are in there be sure to grease the zerk at the firewall for the clutch piston. Once a year at the very least.
