Just like all base/main colours, it depends what colour you put with it. It can make quite a difference.
Interior trim, dash, metal finishes (chrome, ally, stainless) wheel colour, graphics etc...
That may add even more confusion for you, but perhaps if you come at it from the other end and ask yourself what colour leather you prefer, it might tip the balance for you.
