It is generally recommended to do so for ventilation. The hotter it is, the more you want to open your windows. But with that comes the issue of insects and/or rain. You can find car window nets and window deflectors that will eliminate these problems.