I need to sync around 11million various files/folders each day after work to an offsite location, both only have 200Mb fibre links.
Cant really Archive stuff at the moment so that wont help.
Syncing is over sftp and is fairly slow, are there any ways I can speed up.
Will using Database to detect changes help?
Or maybe do a full sync, then use Time span feature do say only sync items changed in last 2-5 days?
Speedup sync offsite
- Posts: 3
- Joined: 24 Aug 2023
- Posts: 4056
- Joined: 11 Jun 2019
Database will help, it will reduce the number of re-copy actions that are performed if items are renamed or moved. I am not necessarily sure if that works over FTP though, you will have to test.
Time Span is another great option to reduce the quantity of data you are working with
Time Span is another great option to reduce the quantity of data you are working with
- Site Admin
- Posts: 7211
- Joined: 9 Dec 2007
https://freefilesync.org/manual.php?topic=ftp-setupSyncing is over sftp and is fairly slow, are there any ways I can speed up. Hemps, 26 Jun 2024, 09:36
Move detection works fine as long as the moves happen on a device that supports file IDs, even if the target device doesn't, e.g. SFTP.I am not necessarily sure if that works over FTP though xCSxXenon, 26 Jun 2024, 14:30