Builds we polling the deployment state every 5 seconds to see if the deployment was complete. Whilst the deployment was marked as successful, it seemed to cause the deployment to reset to an unknown state.
Not 100% sure what the issue was, but this patch seems to do the trick.