Feature Request: Cloud Sync

Posts: 1 · flipsideza 1 Mar 2016, 09:49

Hey

Been using FFS for a while now and loving it. It would be amazing if you were able to integrate cloud storage as a sync location. Similar to that of GoodSync.

At the moment I sync from one drive to my google drive folder, and the google drive uploads it... but imagine just going directly without the duplicate data on my HDD.

Thanks,
Chris

Posts: 1 · justinsu 17 Aug 2016, 18:01

I second this request. I am using Amazon Drive and it doesn't provide a network drive mapping.

Posts: 1 · Grapfen 28 Apr 2017, 16:09

I would highly appreciate the implementation of this feature! I need to sync an external hard drive with my google drive account and the program "@max syncup" seems to have implemented it. However, I would prefer to stick with freefilesync. Thanks!

Posts: 4 · doraimom 30 Dec 2017, 04:04

Hi. I just created an account in this Forum to say I also request the inclusion of the Google Drive Sync feature. Hope we can see it soon in the software. Thank you.

Posts: 7 · ZuperMario 24 Sep 2018, 09:40

+1 for a cloud sync, especially amazon drive/photo (free unlimited photo with amazon prime). I also have dropbox, but dropbox sync client is very good, on the contrary, that of amazon is very bad. Thx.

Posts: 7212 · Zenju 15 Jan 2019, 13:49

Google Drive is finally supported by FFS 10.8!

Posts: 7 · ZuperMario 15 Jan 2019, 18:15

Google Drive is finally supported by FFS 10.8! Zenju, 15 Jan 2019, 13:49

Very well, I'll try it as soon as possible! Thanks!

Posts: 1 · Striker37 17 Jan 2019, 14:39

Google Drive is finally supported by FFS 10.8! Zenju, 15 Jan 2019, 13:49

What exactly does this mean? Can I sync directly with the cloud? How do I input a Google Drive folder location that isn't mapped to my local PC?

Posts: 4 · doraimom 17 Jan 2019, 16:42

Google Drive is finally supported by FFS 10.8! Zenju, 15 Jan 2019, 13:49

I'm testing it right now. Extremely slow so far. Let's see how it proceeds.
I'm uploading 64GB to my Google Drive account... After 5 hours, it's slightly over 1%. At this pace it'll take
20 days to complete the backup! A little absurd, since my upload speed is over 25Mb/s in a stable fiber optics internet connection!

Posts: 19 · Illioc 18 Jan 2019, 13:37

Wow, one of my dreams came true...

Thanks so much !!!

Upload speed with MP3 files (typicall size around 3 MB) is the max of my connection speed (300 Mb/s = 35 MB/s), using my "usual" 8 threads. :)

: 2019-01-18 14_33_19-2,58% – Synchronisation en cours ....png (18.27 KiB) Viewed 2707 times

Posts: 4 · doraimom 18 Jan 2019, 14:05

Wow, one of my dreams came true...

Thanks so much !!!

Upload speed with MP3 files (typicall size around 3 MB) is the max of my connection speed (300 Mb/s = 35 MB/s), using my "usual" 8 threads. :)

2019-01-18 14_33_19-2,58% – Synchronisation en cours ....png Illioc, 18 Jan 2019, 13:37

I'm not sure how you are getting this kind of speed but my upload to google drive is ranging from 50kB/s to 700KB/s, in other words, extremely slow and extremely below the limitations of both my computer and my network.

Posts: 19 · Illioc 19 Jan 2019, 19:11

I'm not sure how you are getting this kind of speed but my upload to google drive is ranging from 50kB/s to 700KB/s, in other words, extremely slow and extremely below the limitations of both my computer and my network.

As far as I know, there are these 2 things to consider:

1) You should try to make ZIP of any folders you don't use often: you might have seen that performance on small files are always worse than on big files. Especially if you have still use and not SSD. Synchonizing small files is always slow :(. I used "TreeSize Free" (another great free tool) to check the folders having plenty of small files, then I Zip'ped them.

2) There is an option in FFS (added some months ago) that allows parallele processes. Synchronization to Cloud is exactly where it's needed: because it takes some times for the computer to "discuss" with Google Drive and send a file, you better setup 4 / 8 / 16 parallel processes. In my case I've been using 8 processes since the feature exists in FFS: it allowed me to use the max of my network cables and now the max of my internet.

Posts: 4 · doraimom 19 Jan 2019, 22:03

I'm not sure how you are getting this kind of speed but my upload to google drive is ranging from 50kB/s to 700KB/s, in other words, extremely slow and extremely below the limitations of both my computer and my network.
As far as I know, there are these 2 things to consider:

1) You should try to make ZIP of any folders you don't use often: you might have seen that performance on small files are always worse than on big files. Especially if you have still use and not SSD. Synchonizing small files is always slow :(. I used "TreeSize Free" (another great free tool) to check the folders having plenty of small files, then I Zip'ped them.

2) There is an option in FFS (added some months ago) that allows parallele processes. Synchronization to Cloud is exactly where it's needed: because it takes some times for the computer to "discuss" with Google Drive and send a file, you better setup 4 / 8 / 16 parallel processes. In my case I've been using 8 processes since the feature exists in FFS: it allowed me to use the max of my network cables and now the max of my internet. Illioc, 19 Jan 2019, 19:11

Your second suggestion is very interesting. But it's available only to those who donated. I didn't. So, I'll keep analyzing if FFS is worth being used to upload to google drive or not. So far, by the speed I am getting and the consistent error messages in the scheduled tasks with a loop of network password requests are getting me crazy.
Thanks anyway for the interesting reply.

Posts: 1 · Brazilian Joe 20 Feb 2019, 14:41

Considerations:

Google Drive can deal with same-name documents on the same folder. Currently, FFS just errors out and cannot sync towards inside a folder.

I propose to have some rules clearly set for sync to work better in the case of name collision, if one side of sync supports same name but the other does not.

1) distinguish between files and folders
2) prefer to preserve the folder name over the file name.
3) understand the file naming conventions of a platform. Windows, for example, adds " (n)" to the end of the file name, with "n" being "number of times this file name is repeated - 1". When synced up to Google Drive for example, this would be stripped from the file name on GD's end.
4) If the not-Google Drive end supports it, save the UUID of the GD document as metadata on the filesystem, to better track changes like file move and rename.
5) Team Drives still not suppoerted. THis is a big need for more advanced users (like me) .

Posts: 8 · UbyOne 14 Oct 2024, 11:25

what is about S3 type Cloud Storage?

Posts: 9 · tubemirror 16 Oct 2024, 09:12

Copy 1st paragraph to ChatGPT and you get the name of the program.

> The problem is I am forbidden to tell you about it because the developer of this program
> doesn't believe in two open source programs working together to make a better product.

How can he then develop on or for Linux at all, since this operating system in particular is a bunch of thrown-together OpenSource/GPL/<whatever licence> programs?!

I don't know, anyone who holds such - how shall I put it - strange-sounding views doesn't exactly earn my trust to use their code.

I would be worried that they might make strange decisions in other areas at some point, which would rule out using them together with the tools you use. Be it functionally or in terms of the licence.

I also find this statement/attitude towards the products of other open source developers to be disrespectful. Ultimately, the user should be allowed to choose which combination of tools offers them added value.

Posts: 8 · UbyOne 16 Oct 2024, 09:31

just trying, to check if i will banned:
RClone

Posts: 9 · tubemirror 16 Oct 2024, 13:21

just trying, to check if i will banned:
RClone UbyOne, 16 Oct 2024, 09:31

Surely not here ... the software you can find in the internet and even the sources are provided also on Github. Therefore I am already wondering why the author of this information is so "shy" on this forum not even telling the name and making such strange claims that the author of the software is agains use of open source in combination and forbids him to tell the name of the Software.
Sorry, but such a bull***t (lets really name it like that) I never ever heard.

Maybe a strange attempt for waking interest for this software? Who knows.
At least this this attempt failed for me for the already mentioned reasons.

As I do not need this software (absolutely no interest in cloud backups) I have no intention to ask the author of rclone whether this claim of Leo2 here in this forum is true or if somebody is only making a silly joke.

Posts: 8 · UbyOne 16 Oct 2024, 13:39

@Leo2 + @tubemirror
you can see I was not banned!

I installed RClone.
It requires also WinFsp to be installed and honestly, I do not really understand what WinFsp is doing, but WinFsp installs itself as a Service. I do not really like it at all.

RClone works on CommandLine; it means the simpliest way to run it is in the background, but no "unmount" command is provided, so to stop sharing your S3 locally, you must kill the process. No comment.

But the worst is using it with FFS.
When you sync from local to S3, all new/updated files take the "operation (actual)" TimeStamp, and not the original from copied files. The result is that when you sync again, these files seem to be more recent, so are sent back from S3 to local (call it "rebound effect").

My conclusion.
You were not "forbidden" and FFS developers are not "bad guys".
Simply using Rclone with FFS seems not to be a good option.

So I hope that the "S3 Connector" will be soon implemented in FFS!