Check that window-close-symbolic is found in icon theme.