I am trying to sync 2 file servers and I keep getting errors when it completes the comparison.
Servers have 8 CPU's 16GB of RAM, there is 30 million files.
Anything I can do to make it work?
sync fails with out of memory error
- Posts: 1
- Joined: 6 May 2020
- Posts: 292
- Joined: 13 Apr 2017
https://freefilesync.org/faq.php#limitations
Are there limitations on the number of files to sync?
FreeFileSync imposes no artificial limitations on how many files you can sync. Practically speaking, the only limiting factor for extremely large sync jobs is the amount of free memory available: For each 1 GB of RAM, FreeFileSync can synchronize roughly 1.7 million file pairs at a time.
So: 16 GB RAM * 1.7 million file pairs = 27.2 million file pairs your system can manage
Are there limitations on the number of files to sync?
FreeFileSync imposes no artificial limitations on how many files you can sync. Practically speaking, the only limiting factor for extremely large sync jobs is the amount of free memory available: For each 1 GB of RAM, FreeFileSync can synchronize roughly 1.7 million file pairs at a time.
So: 16 GB RAM * 1.7 million file pairs = 27.2 million file pairs your system can manage
-
- Posts: 2456
- Joined: 22 Aug 2012
Unfortunately aalex24 does not mention what erros are reported.
If the limitation indicated above by Gianni1962 is the cause, this can be overcome by splitting the single, large scope sync in multiple, smaller scope syncs, and run those syncs consequetively.
You may limit the scope by selecting lower level left- and right- base-folder locations, or via the Include or Exclude Filter, whichever suits your use case the best.
If the limitation indicated above by Gianni1962 is the cause, this can be overcome by splitting the single, large scope sync in multiple, smaller scope syncs, and run those syncs consequetively.
You may limit the scope by selecting lower level left- and right- base-folder locations, or via the Include or Exclude Filter, whichever suits your use case the best.
- Posts: 3
- Joined: 13 May 2020
Unfortunately aalex24 does not mention on what operating system the error occurs. There is another discussion in viewtopic.php?t=7265. Following a change in my operating system (from LM Mate 19.3) to Ubuntu Mate 20.04, I had a problem with the number of inode watches. In Ubuntu Mate this number was dramatically reduced to 8000. After increasing the number to 250000, the error disappeared.
