close if we tried to close politely just close next time

Signed-off-by: Andy Green <andy.green@linaro.org>