Exclude hidden files

[pollotedax]

Hi again,
I would like to know if there is a way to exclude the hidden files and folders on sync.
I saw in other posts like viewtopic.php?t=1407&p=6028#p6028 that Hidden/System are are excluded by default.
Having a look at my .ffs_batch file, I can see this :

<Exclude>
<Item>\System Volume Information\</Item>
<Item>\$Recycle.Bin\</Item>
<Item>\RECYCLER\</Item>
<Item>\RECYCLED\</Item>
<Item/>
</Exclude>

So I think that Hidden/System files and folders are "semi-auto" excluded with that piece of code.

I'm syncing a Windows PC with a Mac and I can see that Mac systems creates some hidden folders like
.HSResource
.TemporaryItems
.Trashes
and some others, as well as some files as
.DS_Store

Those hidden folders are sometimes quite big and/or do have many files inside and makes the job take longer.

Also I'm having some errors with characters, most of them inside those special folders, too.

Maybe there is a list of al possibe special mac names for folders and files I can add to my <Exclude> part of my config file, but I think is easier to be able to ignore the ones with the hidden attribute on.

In your post viewtopic.php?t=1997&p=8421#p8421
you say easy it's easy to exclude specific directories but I have too many.

On another post viewtopic.php?t=1977&p=8288#p8288
you say this is not enough to justify a distinct option but I want to know if there is a workaround or, maybe, you may reconsider it in the future.

Thanks again.

[Zenju]

FFS doesn't consider file attributes like hidden or read-only in the filter, but filters by name only.

[valmatech]

I totally second Pollote suggestion. Not being able to filter hidden files makes FFS too complicated for many. Please let us filter hidden files.

[MartFree]

Still no chance to skip hidden and/or system files? I love freefilesync, I've been using it for ages, but I've problems constantly because of this, I'd say is the only problem, but a constant one. Almost every other sync system has that option, so it can't be that difficult. Would love to pay for it... Please?

[henkk]

to exclude hidden folders in linux/ubuntu I added /.?*/ to the exlusion list
HTH

[hompc]

I solve the same problem in Windows, is any way to exclude system/hidden files/folders?

[Plerry]

In Windows, (at least presently) FFS has no simple way to exclude system or hidden files and folders.

Obviously you can add known system/hidden files or folders tot the Exclude filter (e.g. folders like ProgramData, AppData) if those are (sub)folders of your left and right base location.
The simplest way or doing that, is running a Compare in the FFS GUI, select and right-click the file or folder to be excluded, and via the context menu select to exclude said file or folder.

[xCSxXenon]

To add to Plerry's solution, hidden files are typically few and far between besides the defaults, so excluding is the best in my opinion.

[Moonwalker]

To add to Plerry's solution, hidden files are typically few and far between besides the defaults, so excluding is the best in my opinion.

Horse hockey. Hidden files and folders are a major problem with any syncing software, ESPECIALLY if you want to sync with an online folder system, such as Google Drive. Syncing with such a drive reveals a plethora of randomly named files that CANNOT be seen in any standard file systems such as Windows, Mac, Linux (Gnome for example). GDrive creates all sorts of files named with random alphanumeric identifiers that are utterly useless to any normal user. MOST of these files are ZERO byte files (folders)! Those that are not are quite obviously (at least to me), some sort of temp files that are of no use to the average user.

I would dare say nearly ALL of us that need to back up files are ONLY interested in the files we can actually SEE within our OS, no matter what the OS happens to be.

Without a means to exclude hidden files from the sync process, ANY syncing software is rendered pretty much useless.

Why? Simple. Because nobody cares about backing up hidden files (at least for the grand majority of users). We want to sync our SEEN files, not a bunch of randomly named files that were never intended for the average user to SEE, much less WORK WITH.

There has GOT to be a way to exclude files with (some kind of) hidden attribute! I refuse to believe it's not possible. Because I KNOW it IS possible. I just don't yet know how, but would be forever grateful to anyone who can explain HOW.

Now, before ANYONE chimes in with, "Hey what are you worried about? If they cannot be seen with any standard OS, what's the problem?", read on:

It's a problem because while under normal operating circumstances, they remain invisible, once FreeFileSync sees them in the system that is hiding them, and "syncs" them in to another system, THEY ARE NO LONGER HIDDEN!!!!!!!!!!!!

This unfortunate oversight in design throws a ton of unnecessary files into the visible and navigable system that ALL of us use to keep our files organized!

End of rant, but man, come on, there HAS to be a way to leave out files the systems use (and WE AS END USERS NEVER USE!)!!. It just makes no logical sense that this issue has been raised for several YEARS now, and still there is no easy to locate answers.

I 100% agree that open source solutions like FFS can't solve everyone's problems out of the gate, but it is inexcusable that NO solution (not even a work around such as file hacks, which I am perfectly willing to perform to get the behavior I want from FFS) is yet to be found easily online. What can I do to help?

I'm trying. Any help to solve this ridiculous issue is welcome.

[Moonwalker]

To clarify why it renders file syncing useless:

File syncing saves time by rendering repeated manual file copying unnecessary. Having to click through extensive lists of files in the Compare window, is extremely time consuming and has to be done with every single sync task, UNLESS ignoring these useless files can be SET in a config file, once and forever.

Right now, I am looking into possible ways to edit the xml file to this end, or even java or javascript files. I don't care what I have to hack as long as I can share it afterward with everyone so nobody has to deal with this glaring oversight as long as they are willing to hack some files.

If such a solution can be found, I would hope to heck the FFS developers would find a way to implement it within the completed distribution of FFS.

Please do not misinterpret this rant as a lack of gratuity for the efforts of the developers. It's not. Sometimes a kick in the pants is needed however. so long as the "kicker" is willing to help.

I AM.

...even though this is far above my pay grade and expertise.

That said, I AM willing to learn so as to facilitate my determination to migrate away from Apple and Microsoft systems permanently. I'm so sick of being financially tied to both companies!

Rant over.

Anyone willing to help?

[Moonwalker]

Having a look at my .ffs_batch file, I can see this :

<Exclude>
<Item>\System Volume Information\</Item>
<Item>\$Recycle.Bin\</Item>
<Item>\RECYCLER\</Item>
<Item>\RECYCLED\</Item>
<Item/>
</Exclude>

So I think that Hidden/System files and folders are "semi-auto" excluded with that piece of code.

I'm syncing a Windows PC with a Mac and I can see that Mac systems creates some hidden folders like
.HSResource
.TemporaryItems
.Trashes
and some others, as well as some files as
.DS_Store

Those hidden folders are sometimes quite big and/or do have many files inside and makes the job take longer.

This is the portion of the post that got me chasing the XML rabbit hole.

I have already solved the "files are hidden by naming convention (preceded with a dot)".

That's easy. Just add this to the exclusions under FFS options:

*/.*

That entry will exclude files with the dot prefix that forces OS's programmed to do so to ignore these files within the native explore/finder of said OS. However it should be noted that such file naming can be bypassed in the Windows or Mac systems simply by changing settings within either system. This will render any files prefixed with a ".' visible to your system's file explorer. What is perplexing to many users who don't realize this, is that whether you set these prefixed files to be visible OR NOT, many softwares STILL see them regardless of the system setting.

In other words, even if your Explorer/Finder can't see them, MANY softwares CAN STILL see them when you open a "Browse" button in that software. Some do, some don't. FFS sees EVERYTHING no matter what you do in your OS's system settings. "Compare," and "Syncronize" do not CARE if you can or cannot "see" files in your Explorer/Finder. FFS reveals EVERYTHING.

Currently, the ONLY way I can find to exclude files with a "hidden attribute," is to manually uncheck them individually from every single Sync session as it is performed. This is beyond inefficient.

Again, any help is appreciated. I'm going to leave this for now. I've most likely ranted far more than necessary. It's just that this issue has existed for literally years now and it's about time (IMHO) it was seriously addressed.

In conclusion (for tonight I promise), this is the first time in a long time I've resurrected a necro post, but I truly believe this one is well worth it.

To any and all that have read the entirety of my recent posts: I appreciate your time. Please light a fire under the butts of anyone you know that can actually help solve this issue. Thank you so much and have a great beginning to your new year!

~Moonwalker