Leave the sidescreens on the car?

My rack doesn't have sidescreen storage and I think racks look ugly with that gap under the rails, plus it would put a suitcase another 6 inches higher. I keep mine behind the seats on the rare occasions I don't use them.