Always worth reviewing what you wear in the car.
I created similar wear in our old car through a wallet in a hip pocket. Nowadays, except for short journeys to the pub or similar when I may wear chinos with limited pockets, I always wear trousers without pocket zips (plenty around with velcro) and the wallet goes in a cargo pocket on the thigh.

is banned from wearing trousers with zipped pockets in the car too.