question: How to save a checkpoint every n steps and overwrite the previous saved checkpoints?
context: How do I save checkpoints every, as well as deleting and/or overwriting the previously saved checkpoints?
answer: Just to be sure, do you mean every n step or every n epoch.
  For doing it every n epoch, you can initialize model checkpoint with period parameter
  checkpoint = pl.callbacks.ModelCheckpoint(period=n)