Some mirrors just don't seem to be adjustable to be of practical use. My driver's mirror wasn't great, until I replaced the lower arm with one sent to me by Meabh

(the spring ratchet was dying in the old arm). Now I can set the mirror perfectly. Just seems odd, but may have something to do with the nylon insert in the arm not being in the correct place.