Mirroring of same sources multiple destinations

Discuss new features and functions
Posts: 9
Joined: 24 Mar 2016

tubemirror

I am mirroring 3TB of data (400.000 files, 42.000 folders) from multiple data sources (disks) to
- 1x internal (10TB Sata) and
- 2x external (USB3.2) drives.
The file search takes a lot of time and needs to be repeated.

I would propose a mode where the file search is only performed once and being fed to multiple mirroring jobs (to different target disks) so that the mirroring can be performed in parallel.

I think by this you can generate a lot of time savings by
a) having to perform the file search only once
b) by performing the mirror jobs in parallel

I do not expect any I/O problem, because one destination is on internal SATA6 disk and the other two are connected to a separate / dedicated USB 3.1 gen 2 controller supporting UASP, the external case as well:
- StarTech Dual Port USB 3.1 Karte - 10 Gbit/s per Port - 2x USB-A - PCIe, ASM2142 (PEXUSB311A2)
- StarTech USB-B 3.1 Gen2 Enclosure, 3.5", USB-B 3.1 (S351BU313)

I think this could be useful for many people who mirror their data to multiple disks / sticks and want to speed up the whole thing.

Many thanks for considering such a mode to make an extremely well product even better.

Best regards
A.
User avatar
Posts: 4056
Joined: 11 Jun 2019

xCSxXenon

As much as the protocols you are mentioning help latency and bandwidth, the more important factor is whether or not you are using an SSD or HDD. FFS does support parallel threads as well. This has been discussed before, but there is no way for FFS to "mirror" operations across multiple destinations without having the destinations mirrored themselves.
User avatar
Site Admin
Posts: 7210
Joined: 9 Dec 2007

Zenju

Just use multiple folder pairs. If a source folder is mentioned more than once, it will still be scanned only once.