Ok, so the backup situation for all of our TROM files. We have 4-6 million files and around 8TB of data. A struggle to find a proper way to back it up online. But I am perfecting it I think.

The server.

Millions of files, all around 1.5TB in size. With file versioning we get closer to 2TB. I used to grab them locally via SFTP with FreeFileSync but that took hours every day and TBs of data. No at all ideal. Now I am doing it with Borg. Finally managed to understand how it works. 2 servers, 2 repositories, 2TB of borgbase.com storage. The good thing with Borg is that you can have your own borgbase.com if you want, thanks to @YunoHost . But for now I choose to buy from them.

So Borg is great because it compresses and deduplicates all files and the Yunohost config is quite easy once you "get it". Now it should keep several versions of files and it is server to server. No more "I need my computer and a great internet connection to keep the servers backuped". The backups are fast and thanks to Vorta, their desktop tool, I can easily connect to these repos and mount them or extract any files I want, or delete some. As easy as that. I do not like the terminal, I feel blind when using it, but for Borg I will still have to use it to restore backups for example. And I can put up with that. Tested, seems easy.

So I use borgbase with 2TB of storage for all of the servers + my local system files, like config files and such, since Borg works great with tons of files that are not that big sized. From servers to Borg, from my computer to Borg. All seem to work really well thus far.

The files.

The rest of the files are around 6TB. That is TROM II documentary, VN stuff, and so forth. It seems that Mega is great for very large files. Probably Mega got stuck when I told it to backup tons of small files because now it seems to work well. So I backup the rest to Mega.

2TB of BorgBase + 8TB of Mega = 350 Euros a year. 50 Euros more than when I first planned for this and got donations for this purpose. It is fine. I'll add 50 more Euros for that. I am still testing this for a week or so before buying these for a full year. I want the backups to be seamless and "just work". Right now they seem so, but let's see. 1 week should settle this dispute :).

Backups are damn important so you should do them properly, regularly, and safely. The options I chose are encrypted end to end. And easy to setup it seems.

I want to go back to TROM II after this. Tomorrow I shall start. #tromlive