Hello support team,
I have an optimization request concerning folder comparison via FTP/SFTP:
setting is:
- comparing two large directory trees (some 40.000 files on each side)
- using FTP (or SFTP)
- one large subpart is only available in the remote server
I've configured BC to use CRC algorithm, which speeds up FTP comparison considerably.
Comparing works pretty well in general, but I found one downside, which is very time consuming in the above mentioned scenario:
BC still tries to get all CRC values even for the files on the remote server, which are definitely not on the local server. This is no problem for some tenth of files, but gets very time consuming for 10.000's of files, especially large ones. (I'm talking of 15-30 minutes in my setting alone for this branch.)
Can this behavior be optimized?
TIA
Bernhard
I have an optimization request concerning folder comparison via FTP/SFTP:
setting is:
- comparing two large directory trees (some 40.000 files on each side)
- using FTP (or SFTP)
- one large subpart is only available in the remote server
I've configured BC to use CRC algorithm, which speeds up FTP comparison considerably.
Comparing works pretty well in general, but I found one downside, which is very time consuming in the above mentioned scenario:
BC still tries to get all CRC values even for the files on the remote server, which are definitely not on the local server. This is no problem for some tenth of files, but gets very time consuming for 10.000's of files, especially large ones. (I'm talking of 15-30 minutes in my setting alone for this branch.)
Can this behavior be optimized?
TIA
Bernhard
Comment