Incremental Backup Solution for Small Business and Professionals - Page 1
Forum section: electronics / general

author: kaevee
author_rank: Regular Contributor
timestamp: September 27, 2021, 01:15:37 pm
content: Hi,Recently one of my client's computers was hijacked by ransomware. I had to revamp their network security and file services. They wanted an easy-to-access backup system for their data as they don't have a dedicated administrator. I wrote a program to take incremental backups from Windows/Mac/Linux systems to NAS.Key FeaturesUser defined backup intervalsUser defined backup rotations per intervalUses hard links to save space across backup intervalsCross Platform (Windows, Linux, MacOs, FreeBSD). Requires CygWin for windowsThe backups can be reviewed/access without any special tools.Check outhttps://github.com/kaevee/NgBackupfor more information.

author: Karel
author_rank: Super Contributor
timestamp: September 27, 2021, 02:48:36 pm
content: Why didn't you use something like rdiff-backup?https://rdiff-backup.net/

author: kaevee
author_rank: Regular Contributor
timestamp: September 27, 2021, 04:21:14 pm
content: Quote from: Karel on September 27, 2021, 02:48:36 pmAs I wrote in my initial post, the client does not have an in-house administrator. So, we needed an incremental backup system accessible to users as a shared drive. A typical tree will bedaily--- 20092021--- 21092021--- 22092021--- 23092021--- 24092021--- 25092021Similarly, there will be an increments tree under hourly, weekly, monthly, and yearly folders.if one wants to get a file as of 22092021, all they need to do is copy the file from the 22092021 folder.

author: Benta
author_rank: Super Contributor
timestamp: September 27, 2021, 05:02:55 pm
content: I'm running Linux, so I can't say anything about Mac or Win.I split my backups in two:One for system backups. This is only run just before or after system changes or updates. For this I use Timeshift. This is for the sysadm.Another for user data (/home/user) backups. Here I use BackInTime and can let it run automatically on preset intervals.Both are rsync-based incremental backups with hard links and are extremely stable. The main differences are the GUI front-ends and their setup. I have not been in a situation where recovery wasn't possible.Splitting the two backups makes sense to me, but perhaps not to everyone.

author: kaevee
author_rank: Regular Contributor
timestamp: September 27, 2021, 11:50:22 pm
content: Quote from: Benta on September 27, 2021, 05:02:55 pmI did explore many open-source tools and most of them are designed for mainstream users on Linux servers. TimeShift, BackInTime look very good and I am sure they will meet the needs of almost all users.I am using TrueNAS Core based on FreeBSD. ZFS in NAS has a native snapshot feature. The hourly, daily, weekly, monthly, yearly snapshots have been set up in NAS. I need to compliment the snapshots with an easy-to-use restore on their own feature where only a file or small subset of data is needed by users. Furthermore, I need to push some files directly from Windows system(s) as some data is stored locally.With ZFS one needs an administrator to restore data. My approach will allow users to recover a file or directory on their own. If there is a need to recover the full data, ZFS snapshots will be used.

author: bson
author_rank: Unknown
timestamp: October 03, 2021, 09:56:42 pm
content: Why not use the best tool for each platform? On Windows, Macrium Reflect is excellent (and free unless you want enterprise type features). It can image a bunch of partitions to a single backup, or do incrementals, or both. So you can say image the system once a week, maybe Sunday AM if people typically don't work weekends, and then a nightly incremental. If their computer fails (business PCs aren't exactly the pinnacle of reliability) fixing it is as easy as replacing their entire system and loading up their last image using a bootable recovery stick. It'll happily write to NAS. Having a complete tamper-proof restorable image lets you recover from ransomware, randomware (Windows becoming unbootable for example), garbageware (yeah sure, these Win7 drivers work just fine on Win10 - famous last words), Windows just barfing all over itself like a drunken sailor, or smoke and fire. Different systems, different needs...

author: kaevee
author_rank: Regular Contributor
timestamp: October 04, 2021, 03:09:05 am
content: Quote from: bson on October 03, 2021, 09:56:42 pmI could have used platform-specific tools. As noted in my initial post, access to previous data using a share was one of the primary requirements. Furthermore, we were not looking to restore the complete system.

author: Foxxz
author_rank: Regular Contributor
timestamp: October 06, 2021, 04:13:53 am
content: https://borgbackup.readthedocs.io/en/stable/I'm using this with great results.

author: Halcyon
author_rank: Unknown
timestamp: October 06, 2021, 08:32:39 am
content: I use both ZFS snapshots and regular offline backups.The snapshots allow you to quickly and easily restore data that has been changed or deleted. You can define them at any interval you like, even hourly if you really want. This is native to ZFS and TrueNAS.For proper backups, I use LTO tape.

author: kaevee
author_rank: Regular Contributor
timestamp: October 06, 2021, 10:19:37 am
content: Quote from: Foxxz on October 06, 2021, 04:13:53 amThis looks very good. Probably I will consider using it once they release windows binaries.

author: kaevee
author_rank: Regular Contributor
timestamp: October 06, 2021, 10:23:17 am
content: Quote from: Halcyon on October 06, 2021, 08:32:39 amWe are using TrueNAS and periodic ZFS snapshots are enabled. The Python script is complimenting the ZFS snapshots in TrueNAS, by providing easy access to backups for users. As I noted in my initial post, we don't have a full-time administrator to restore data on demand.

author: PaulAm
author_rank: Frequent Contributor
timestamp: October 13, 2021, 03:10:14 pm
content: I've used backuppc for both my self and a number of clients. It's an rsync based platform that runs on Linux, but clients work fine with windows. Great for incremental backups and file/directory retrieval, not so much for entire systems. I do full dumps for that.Had one client hit with ransomware and it was relatively easy to rebuild his system.For a backup solution to be effective against ransomware it pretty much has to be an out of band solution. If a backup share is visible to a system it's just as likely to be encrypted as anything else.Whatever solution you use, be sure to do a test restore before you actually need to. Don't assume everything will just work fine; 9 times out of 10 it won't. I've seen everything from individual users to major data centers caught by that.

author: Halcyon
author_rank: Unknown
timestamp: October 13, 2021, 06:53:20 pm
content: Quote from: kaevee on October 06, 2021, 10:23:17 amSnapshots in TrueNAS also support the Windows volume shadow copy service. That way if a user deletes/overwrites a folder or file by accident, they can just right-click and go to the "Previous versions" tab and restore it themselves from their own machines. No scripts needed.

author: kaevee
author_rank: Regular Contributor
timestamp: October 14, 2021, 12:46:45 am
content: Quote from: Halcyon on October 13, 2021, 06:53:20 pmOf course, we have enabled shadow copy. It meets almost all the needs except for a remote backup. Remote backups with shadow copy can be achieved if we have a second TrueNAS replicating the data from the primary server. We are yet to set up a failover system for the TrueNAS server.