This is another area where most plugins offer you great flexibility. You could choose to store your backups locally on your regular computer or even an external hard drive. Also, you could opt for one of the many cloud storage services available, some of which are free up to a certain limit. Storing your backups in various places might be the best way to secure your data.