Hi,
Windows 10
Source NTFS disk 1.1TB used out of 4TB with maybe 5,000,000+ files, second disk was fresh format NTFS
Sync was set left to right (from source disk to empty disk)
Left running overnight so computer not touched.
Only copied around 512GB of files and then said Complete
It did not copy all the files
Clicking Synchronize again showed as per picture which had been running for a few minutes. So glad I did that as a confirmation step:)
An additional filter is for Recycle* otherwise everything else is untouched.
I realise this is probably not the appropriate tool/app but this achieved a higher throughput. Anyway, I find this very concerning. Please let me know if you need any other information.
Thanks for your help/thoughts
- Andy
Millions of Files - Says complete but only PARTIAL COPY
- Posts: 4
- Joined: 13 Nov 2020
- Attachments
-
- freefile.PNG (137.9 KiB) Viewed 678 times
-
- Posts: 2947
- Joined: 22 Aug 2012
Your posting is a bit unclear in several aspects.
> Left running overnight so computer not touched.
Could it be that, due to the Power & Sleep settings, your machine went into standby or hibernation and "froze" the further sync progress?
> ... and then said Complete
Where and when did what say Complete?
Your Compare result window and the progress bar clearly show the sync is far from complete, and that FFS is "aware" of this. If you only pressed Sync again and did not do a renewed Compare, it seems FFS is simply trying to continue the sync it had started earlier, which seems to be the correct behavior.
> Left running overnight so computer not touched.
Could it be that, due to the Power & Sleep settings, your machine went into standby or hibernation and "froze" the further sync progress?
> ... and then said Complete
Where and when did what say Complete?
Your Compare result window and the progress bar clearly show the sync is far from complete, and that FFS is "aware" of this. If you only pressed Sync again and did not do a renewed Compare, it seems FFS is simply trying to continue the sync it had started earlier, which seems to be the correct behavior.
- Posts: 4
- Joined: 13 Nov 2020
Hi
Thanks for the quick reply.
The power and sleep settings are disabled (set to never). I only ever switch the monitor off.
When I switched the monitor on about 8 hours after starting the copy, it said FFS showed "Complete" and the graphs were showing as complete.
Out of habit I double checked the process by clicking the "compare" again - this is something that I normally do. It usually says that all the files are in sync, but this time it didn't. This concerned me greatly.
Please let me know if you need anything else. Once this current copy completes, I can run another test to another freshly formatted disk and so if you would like any specific tests/logs etc then please let me know. Happy to help.
- Andy
Thanks for the quick reply.
The power and sleep settings are disabled (set to never). I only ever switch the monitor off.
When I switched the monitor on about 8 hours after starting the copy, it said FFS showed "Complete" and the graphs were showing as complete.
Out of habit I double checked the process by clicking the "compare" again - this is something that I normally do. It usually says that all the files are in sync, but this time it didn't. This concerned me greatly.
Please let me know if you need anything else. Once this current copy completes, I can run another test to another freshly formatted disk and so if you would like any specific tests/logs etc then please let me know. Happy to help.
- Andy
-
- Posts: 2947
- Joined: 22 Aug 2012
No real clue on what went wrong, unless you may have unintentionally selected (the ~500GB) part of the files and only synced those.
> Out of habit I double checked the process by clicking the "compare" again
Clear, so not resuming a paused/stalled sync but doing a renewed Compare.
At least FFS concluded correctly that a very substantial part of the files still required syncing.
> Out of habit I double checked the process by clicking the "compare" again
Clear, so not resuming a paused/stalled sync but doing a renewed Compare.
At least FFS concluded correctly that a very substantial part of the files still required syncing.
- Posts: 4
- Joined: 13 Nov 2020
I will try to reproduce. Just trying to be helpful.
- Posts: 4
- Joined: 13 Nov 2020
Similar problem with a slightly different setup.
The synchronization process says it had completed after approx 8 hours. Then, without restarting FFS, clicking compare resulted in the following picture showing that it had not sychronized all the 2M+ files.
The process had run overnight uninterrupted.
Please let me know if you have any advice or whether I can gather any diagnostics in a final run.
Hope this helps
- Andy
The synchronization process says it had completed after approx 8 hours. Then, without restarting FFS, clicking compare resulted in the following picture showing that it had not sychronized all the 2M+ files.
The process had run overnight uninterrupted.
Please let me know if you have any advice or whether I can gather any diagnostics in a final run.
Hope this helps
- Andy
- freefile.PNG (77.64 KiB) Viewed 623 times
-
- Posts: 2947
- Joined: 22 Aug 2012
You are likely misinterpreting the Compare results.
The picture you share shows that
• There are 2,159,211 files that are considered equal (the = icon) on the left and right side. As these 2M+ files are equal, they are in sync, and do not need to be synced presently. These files are presently not shown in the Compare result window because you did not click the "=" icon.
So, it is not true that FFS had not sychronized those 2M+ files.
• There are 35,386 files that exist on the left side only (the =>+ icon) and are intended to be synced left-to-right. Even though those 35k files are presently not shown in the Compare result window because you did not click the "=>+" icon, these files will be synced left-to-right when you click Synchronize.
• There are 21,617 files, presently show because the "U-" icon is highlighted, that exist right-side only, and are about to be deleted from the right side when you click the Synchronize button.
Likely, you are running a Mirror sync variant and have deleted, moved or renamed those 21,617 files from/in your left location, assuming these 21,617 files ended up in the right-side in one or more previous syncs.
If you do not want files existing on the right side that do not or no longer exist on the left side to be deleted from your right side, you should use the Update sync variant, not the Mirror variant.
If you want to apply any file or folder renames or moves also to the opposite side as a rename or move (instead of a delete and copy), you should use the Two Way variant (even if you only make changes to one side).
The picture you share shows that
• There are 2,159,211 files that are considered equal (the = icon) on the left and right side. As these 2M+ files are equal, they are in sync, and do not need to be synced presently. These files are presently not shown in the Compare result window because you did not click the "=" icon.
So, it is not true that FFS had not sychronized those 2M+ files.
• There are 35,386 files that exist on the left side only (the =>+ icon) and are intended to be synced left-to-right. Even though those 35k files are presently not shown in the Compare result window because you did not click the "=>+" icon, these files will be synced left-to-right when you click Synchronize.
• There are 21,617 files, presently show because the "U-" icon is highlighted, that exist right-side only, and are about to be deleted from the right side when you click the Synchronize button.
Likely, you are running a Mirror sync variant and have deleted, moved or renamed those 21,617 files from/in your left location, assuming these 21,617 files ended up in the right-side in one or more previous syncs.
If you do not want files existing on the right side that do not or no longer exist on the left side to be deleted from your right side, you should use the Update sync variant, not the Mirror variant.
If you want to apply any file or folder renames or moves also to the opposite side as a rename or move (instead of a delete and copy), you should use the Two Way variant (even if you only make changes to one side).
-
- Posts: 4867
- Joined: 11 Jun 2019
Yeah, the right side is less than a GB of data to be deleted, yet it's 20k files. Looks like temp/cache files that have been removed since syncing
