Yes, all servers that have completed their creation process will be billed until they are deleted, regardless of their state. This is because internally we allocate resources to servers regardless of whether they are powered on or off. Additionally, this allows for almost instant boot and startup times.