Parallel file operations - compare and copy

Get help for specific problems
Posts: 9
Joined: 19 Jun 2020

cjdshaw

I'm accessing an SMB share over a VPN, so there's a lot of lag and latency. When comparing large folders, this means the more threads the better - I've found performance peaks at about 10 threads. However, if there's then a lot of large files to sync, trying to copy 10 at once seems to choke the connection. Is there any way to control the compare thread count separately from the number of parallel copies?
User avatar
Posts: 4056
Joined: 11 Jun 2019

xCSxXenon

I would sync large/small files separately as a temporary workaround
Posts: 9
Joined: 19 Jun 2020

cjdshaw

I'm not sure how that would help. If I had the large file copy as a separate config, with a low thread count, I'd still then have to do the very slow comparison. My current workaround is simply to scan with 10 threads, then lower the thread count if there are large files to sync.

Ideally, I'd want separate controls for the comparison thread count and the actual copy thread count
User avatar
Posts: 4056
Joined: 11 Jun 2019

xCSxXenon

Aha, I understand the issue. Hopefully this can be added fairly easily then!