Search found 3 matches

by Werve
23 Jun 2022, 11:43
Forum: General Discussion
Topic: Feature request : faster content comparison
Replies: 9
Views: 5248

Re: Feature request : faster content comparison



The use of checksums [...] would not speed up the FFS comparison.

Correct, but performance with checksums is much worse: While FFS is comparing file content it breaks on the first byte difference found. Using checksums on the other hand would always require reading the full file content.


I ...
by Werve
23 Jun 2022, 10:34
Forum: General Discussion
Topic: Feature request : faster content comparison
Replies: 9
Views: 5248

Re: Feature request : faster content comparison

On what storage type were the files stored?
I tried between mechanical HDD and microSD 10GB each side (200+ files in each side) and it took almost 3 hours. Also depend of where the difference are, for example if each file have the same bytes except the last one it need a lot more time to compare ...
by Werve
22 Jun 2022, 14:44
Forum: General Discussion
Topic: Feature request : faster content comparison
Replies: 9
Views: 5248

Re: Feature request : faster content comparison

I join in asking to add an option in the settings to speed up the comparison using the checksum method (perhaps in the donations package along with the other options for performance?).
Open source projects using this approach are very fast:
https://github.com/arsenetar/dupeguru/
https://github.com ...