How old are your tyres?
Old tyres go hard and don't help steering! I wouldn't have tyres over 5 yrs old on my Mogs, no matter how much tread they have or how few miles they have done.
Getting new tyres for my 4/4 (no power steering) made a fair amount of difference.