There is great fun to be had in driving a lower performance car to its limit,
This is exactly the point of driving for pleasure in my view. You need to be able to feel the car as it nears the limit, understand how the tyres move, what the steering inputs do, and so on.
Sure, you can do this in a high performance car, but you need to pay for an expensive closed track with extensive runoffs, and if you get it wrong you are looking at even more expensive repairs. On the other hand, larking about on a deserted B road in a car that has a much smaller performance envelope is not only free, but even if you do get it wrong you'll be sliding into the hedge at 40mph rather than 140mph.
For the rest of it, which usually involves just getting from A to B with the least grief, is actually more enjoyable in a lower performance car as you don't have to be constantly fighting the urge to go faster. My 4/4 on a motorway is perfectly happy up to 85 and can sit at 70 all day, but there's no risk of me absent-mindedly pressing a bit too much on the throttle and getting nicked for 90mph +