Synchronous update of files, error: 17:47:03 Error Unable to read file "sftp://fp1cmes@10.x.x.x/home/fp1cmes/aplog/ppt

Get help for specific problems
Posts: 11
Joined: 16 Aug 2025

windfall

Synchronous update of files, error: 17:47:03 Error Unable to read file "sftp://fp1cmes@10.x.x.x/home/fp1cmes/aplog/ppt/INITQ_CPPT.2025-0816-162427.log".
Unexpected data stream size: 8,146,94.
Because I need to synchronously download multiple log files from FTP, but these log files are continuously being written, I only want to batch synchronously download the latest one. I don't need it to be precise to the second, but the download failed, resulting in the inability to download the latest log file. Could the developers or experts help solve this problem?
Posts: 1222
Joined: 8 May 2006

therube

If Windows, you might test to see if using VSS might help?
https://freefilesync.org/manual.php?topic=volume-shadow-copy

(With something like that, the copy will not be "real-time", but as of... some time.
Which time that is offhand, I'm not sure ?, but it might be when FFS was initiated, or maybe when the copy of the particular file itself was initiated?)
Posts: 11
Joined: 16 Aug 2025

windfall

The file "sftp://fp1bmes@A.A.A.A/home/fp1bmes/aplog/ppt/INITQ_BPPT.2025-0819-163403.log" cannot be read.
Unexpected data stream size: 3,190,784
Expected: 2,969,600 [unbufferedStreamCopy]

I have set up the program to start with administrator privileges as you requested, but it still reports this error. Could you develop a new mode, like the "FileZilla" program, which only downloads the latest files currently? During the download, no comparison is needed. "FileZilla" currently does not have a batch download function and can only download one by one. "FreeFileSync" has a batch synchronization function, but it cannot download log files that are continuously written. Could the expert solve this issue?
Posts: 11
Joined: 16 Aug 2025

windfall

I have set up the program to start with administrator privileges as you requested, but it still reports this error. Could you develop a new mode, like the "FileZilla" program, which only downloads the latest files currently? During the download, no comparison is needed. "FileZilla" currently does not have a batch download function and can only download one by one. "FreeFileSync" has a batch synchronization function, but it cannot download log files that are continuously written. Could the expert solve this issue?
Posts: 11
Joined: 16 Aug 2025

windfall

I need help. Who can help me?
Posts: 11
Joined: 16 Aug 2025

windfall

I need help. Who can help me?
Posts: 11
Joined: 16 Aug 2025

windfall

I need help. Who can help me?
Posts: 4910
Joined: 11 Jun 2019

xCSxXenon

VSS won't help since the files are on a remote location.
You won't be able to download a file that is continuously being written to. How often is a log file rotated and closed?
Posts: 11
Joined: 16 Aug 2025

windfall

VSS won't help since the files are on a remote location.
You won't be able to download a file that is continuously being written to. How often is a log file rotated and closed? xCSxXenon, 09 Sep 2025, 01:56
This log file is written to irregularly, which means it is constantly being written to all the time.
Posts: 11
Joined: 16 Aug 2025

windfall

All I need is the batch download function. However, currently when synchronizing, the software compares whether the two files are the same. If they are not the same, it will report an error, which conflicts with what I want.
Posts: 1222
Joined: 8 May 2006

therube

Oh, so it's only an "after the fact" (failing on the size compare) where the issue occurs.

On the Comparison settings page, what does selecting the 'Ignore errors' box do?
Will that allow the sync, but ignore the actual "error", allowing the "erroneous" log file to persist in its' destination (even though it is "wrong")?

If it does, that could work as a work-around.
(You could even set up a separate folder pair for that particular file/directory, if need be.)
Posts: 11
Joined: 16 Aug 2025

windfall

Oh, so it's only an "after the fact" (failing on the size compare) where the issue occurs.

On the Comparison settings page, what does selecting the 'Ignore errors' box do?
Will that allow the sync, but ignore the actual "error", allowing the "erroneous" log file to persist in its' destination (even though it is "wrong")?

If it does, that could work as a work-around.
(You could even set up a separate folder pair for that particular file/directory, if need be.) therube, 11 Sep 2025, 15:05
I have tried this function and found it to be somewhat incorrect. It merely ignores the error messages and proceeds to download the next file that doesn't have any errors. However, the content of the file with the error will not be synchronized over, nor will it be downloaded. It's simply ignoring the error message.
Posts: 4910
Joined: 11 Jun 2019

xCSxXenon

This isn't possible if the log file you are wanting to copy is written to during transfer
Posts: 11
Joined: 16 Aug 2025

windfall

This isn't possible if the log file you are wanting to copy is written to during transfer xCSxXenon, 12 Sep 2025, 04:17
Could we develop a new copy-downloading mode? It would only require downloading the content from the previous moment. I noticed that the FTP download software 'FileZilla' can achieve this, but this software can only download files one by one manually and doesn't have the function of downloading multiple files simultaneously.
Posts: 4910
Joined: 11 Jun 2019

xCSxXenon

You can try, FFS is open source if you want to take a crack at it.
I don't see how any software can accomplish this, I would need to see it to believe it.
Posts: 1222
Joined: 8 May 2006

therube

Maybe set something separate up.

Perhaps ROBOCOPY with /Z will do it?

Or (& I know nothing of it, but) logrotate on Linux?
(No, seems not, https://linux.die.net/man/8/logrotate.)
Posts: 11
Joined: 16 Aug 2025

windfall

Maybe set something separate up.

Perhaps ROBOCOPY with /Z will do it?

Or (& I know nothing of it, but) logrotate on Linux?
(No, seems not, https://linux.die.net/man/8/logrotate.) therube, 15 Sep 2025, 16:10
FreeFilesync does not have this configuration.