Backupify is a fantastic online solution that can automatically maintain backups for many popular web apps such as Gmail, Twitter, Flickr and many more.
You could setup a desktop mail client to automatically sync your mail at set intervals.