Parallel file operations - compare and copy
- Posts: 9
- Joined: 19 Jun 2020
I'm accessing an SMB share over a VPN, so there's a lot of lag and latency. When comparing large folders, this means the more threads the better - I've found performance peaks at about 10 threads. However, if there's then a lot of large files to sync, trying to copy 10 at once seems to choke the connection. Is there any way to control the compare thread count separately from the number of parallel copies?
- Posts: 4056
- Joined: 11 Jun 2019
I would sync large/small files separately as a temporary workaround
- Posts: 9
- Joined: 19 Jun 2020
I'm not sure how that would help. If I had the large file copy as a separate config, with a low thread count, I'd still then have to do the very slow comparison. My current workaround is simply to scan with 10 threads, then lower the thread count if there are large files to sync.
Ideally, I'd want separate controls for the comparison thread count and the actual copy thread count
Ideally, I'd want separate controls for the comparison thread count and the actual copy thread count
- Posts: 4056
- Joined: 11 Jun 2019
Aha, I understand the issue. Hopefully this can be added fairly easily then!