I had exactly the same experience - losing a nut and wondering where the hell it had gone.
Some bendy garden wire fished it out.
As you say, what a bugger of a job for what it is.