Ideally, it is recommended to change the changing table cover after every diaper change. This helps maintain cleanliness and hygiene for your baby. However, if the cover is not soiled or stained, you can extend the usage to a couple of diaper changes.