I did small test:
Folder with 1141 files and 18 folders, 14MB summary.
Copy time from nvme to NAS with FFS: 40s.
Copy time from nvme to NAS with Total commander: 13s.
Why such difference?
When it comes to synchro a lot of GB of such data there is big deal.
Slow synchronizig large group of small files
- Posts: 5
- Joined: 27 Apr 2020
- Posts: 2450
- Joined: 22 Aug 2012
FFS does a safe-file copying.
This means that if (pre)existing files are to be overwritten by a newer version, first the previous file is renamed into a tmp-file, then the new version is written, and only if writing the new version completed sucessfully, the previous (tmp) version is deleted.
If writing the new vesion would fail, the previous (tmp) version is renamed back to its original name.
This process requires several file-accesses, that for network connections to a NAS may include quite some latency.
For a few large files this overhead is (relatively speaking) minimal, but for small files can be more than the actual time to copy the file over.
This means that if (pre)existing files are to be overwritten by a newer version, first the previous file is renamed into a tmp-file, then the new version is written, and only if writing the new version completed sucessfully, the previous (tmp) version is deleted.
If writing the new vesion would fail, the previous (tmp) version is renamed back to its original name.
This process requires several file-accesses, that for network connections to a NAS may include quite some latency.
For a few large files this overhead is (relatively speaking) minimal, but for small files can be more than the actual time to copy the file over.
- Posts: 5
- Joined: 27 Apr 2020
Thx for fast reply. I disabled "fail safe copying". Now time reaches 25s instead of 40s. But is still 2x slower compared to Total Commander 13s.
Any ideas?
Any ideas?
- Posts: 2
- Joined: 4 Jul 2022
I think that I always had fail safe copying enabled but since January I see some .tmp files in the Windows trash bin. That was not the case before. What might be the issue? I am syncing between the internal Windows SSD and an external HDD.
- Posts: 4056
- Joined: 11 Jun 2019
Why do you believe that's an issue in the first place?
- Posts: 2
- Joined: 4 Jul 2022
I am confused about so many files in the trash. They are too much to manually go through. Usually I am checking the trash before emptying it but that is not possible anymore.Why do you believe that's an issue in the first place? xCSxXenon, 05 Jul 2022, 16:30
- Posts: 4056
- Joined: 11 Jun 2019
Sounds like you are syncing a bunch of temp files that are being automatically deleted as they are supposed to be. Then, you sync again and FFS has to delete them from the destination and puts them in the Recycle Bin. You should adjust your filters to exclude .tmp files