Glitch on Sync/Mirror <Item not existing>

Get help for specific problems
Posts: 18
Joined: 17 Dec 2020

jpgill86

After more thinking: Theory is moot. Zenju, 13 May 2021, 16:42
I want this on a t-shirt.
User avatar
Site Admin
Posts: 7505
Joined: 9 Dec 2007

Zenju

I see that there is a deprecated alias, includeTeamDriveItems. Are you perhaps thinking of that? jpgill86, 14 May 2021, 04:20
No, it was "includeItemsFromAllDrives",
https://developers.google.com/resources/api-libraries/documentation/drive/v3/python/latest/drive_v3.changes.html
includeItemsFromAllDrives: boolean, Deprecated - Whether both My Drive and shared drive items should be included in results. This parameter will only be effective until June 1, 2020. Afterwards shared drive items are included in the results.

Looks like this parameter makes all the difference. If it's not included, the file uploaded by a different email account will not appear in the changes list; if it is included, it will be. Could FFS start using driveId in getChangesDelta? Note that getStartPageToken returns a very different token depending on whether or not driveId is provided. jpgill86, 14 May 2021, 04:20
Apparently, that's the fix. Interestingly, if a drive ID is set, and includeItemsFromAllDrives is set to false, the list call fails. On the other hand if set to yes, list still does not return changes from *all* drives, but only for the selected one (as is documented). In other words, the API design is skewed: If drive ID is set, the "includeItemsFromAllDrives" parameter is practically meaningless, but needlessly required to be set to "true".
If no drive ID is set, "includeItemsFromAllDrives" configures whether added/deleted or renamed drives are notified. The added "bonus" of getting notifications of the subset of shared drive files that were accessed is of no value for FFS.

So to sum up: drive notifications are per drive, but "my drive" is special, because it also get's notifications about added/removed drives. Doesn't look like an easy fix.
Posts: 18
Joined: 17 Dec 2020

jpgill86

So to sum up: drive notifications are per drive, but "my drive" is special, because it also get's notifications about added/removed drives. Doesn't look like an easy fix. Zenju, 14 May 2021, 09:19
Are you saying it's more complicated than just adding driveId to the queries?

I know these things can be hard to estimate, but would you guess a fix for FFS is a week away, a month away, a year away, ...?

I think at this point my system's state is no longer of much value to preserve for the purpose of debugging. I'd like to execute the workaround (disconnect Google Drive authorization, then reconnect to rescan the drive), if you agree.
User avatar
Site Admin
Posts: 7505
Joined: 9 Dec 2007

Zenju

Are you saying it's more complicated than just adding driveId to the queries? jpgill86, 14 May 2021, 16:42
A lot more. The Gdrive code needs some medium refactoring. Goal is to have this fixed for the next FFS release.

I think at this point my system's state is no longer of much value to preserve for the purpose of debugging. I'd like to execute the workaround (disconnect Google Drive authorization, then reconnect to rescan the drive), if you agree. jpgill86, 14 May 2021, 16:42
Yes that'll be fine.
Posts: 18
Joined: 17 Dec 2020

jpgill86

This appears to work perfectly! I tried the reproducible test previously described, and some variants I thought of. I'll plan to keep using this beta version until 11.11 is officially released, and let you know if I encounter any problems.

Thanks so much Zenju for being so responsive and efficient! ๐Ÿ˜ I'll make sure my next donation is a little bigger!
Posts: 15
Joined: 2 Nov 2020

t0ma5

Thank you very much for the time and effort to solve this issue. Thanks also jpgill86 for contributing to finding the root of the problem! You guys made my day!
Posts: 18
Joined: 17 Dec 2020

jpgill86

Thank you very much for the time and effort to solve this issue. Thanks also jpgill86 for contributing to finding the root of the problem! You guys made my day! t0ma5, 18 May 2021, 15:02
Hi t0ma5! I'm wondering if you had thoughts on this:
t0ma5, you said you are the only one with access to your Shared Drives, but that they are managed by different organizations. Do you sometimes access them using email addresses that differ from whatever email you've connected FFS to? You also said you only use FFS to interact with them, so perhaps none of this applies to you... jpgill86, 12 May 2021, 01:54
I hope Zenju's fix applies to you too!
Posts: 15
Joined: 2 Nov 2020

t0ma5

Hi t0ma5! I'm wondering if you had thoughts on this:
t0ma5, you said you are the only one with access to your Shared Drives, but that they are managed by different organizations. Do you sometimes access them using email addresses that differ from whatever email you've connected FFS to? You also said you only use FFS to interact with them, so perhaps none of this applies to you... jpgill86, 12 May 2021, 01:54
I hope Zenju's fix applies to you too!

I upload files and folders via web browser to 1 of my SHARED DRIVES and then I sync them (1 way mirror) with others via FFS. So it's always DRIVE 1 TO DRIVE 2, DRIVE 1 TO DRIVE 3, DRIVE 1 TO DRIVE 4, and so on. Nobody else modifieds the files in those drives except for me.
Posts: 18
Joined: 17 Dec 2020

jpgill86

๐ŸŽ‰ Eleven eleven, released this day, hooray hooray! ๐ŸŽŠ
Posts: 7
Joined: 28 Feb 2002

polyglotinc

Hate to rain on anybody's parade, but I just found this forum/post looking for what's going on with 11.11 running on my system and getting several hundred (out of 372K files) showing up as "item not existing" even though I can see them and open them via Finder.
The drive with the supposedly missing files is a drive on a mac down the local ethernet network. Worked fine for over 372,000 files in date/size compare...just mistakenly says 582 are missing when they are not.
Posts: 4
Joined: 6 Mar 2020

KinsleyProk

maybe you would take a look to GoodSync or Gs RichCopy360 , I think you will not face this problem with these tools , search both KinsleyProk, 06 May 2021, 08:45
Those options are painfully slow compared to FFS t0ma5, 06 May 2021, 09:24
No Way , At which mechanism, you judging on both?
What are the differences between FFS and (GoodSync& Gs Richcopy360) that make you very sure FFS is faster ??
I sure FFS saved me many times but after trying the other mentioned tools, the situation is different!!