GRILL-582: closing cli closes underlying grill session

Can we fix that by adding some closing flag? We should have a way to gracefully shutdown, as shutdown hooks are not reliable.