Remove startup listener after being run once