If the PacketBuilderThreadPool has not been initialized yet, there is nothing to shut down