compositor: properly unmap views

Fixes an invalid write when restarting the shell client.