Multiple Connections for building sync list?

[kurt2439]

We have an SFTP connected filesystem that has many many thousands of directories. Currently doing a sync takes 12-15 hours, of which 10-12 hours is just building the sync list. I see that BC has multiple connections for downloading (or so it says on your website), but is there a way to enable multiple connections to scan the folder contents and build the file transfer/sync list quickly?

We are not allowed to use rsync or anything like that so we need to solve the problem using a tool like BC. Anyone know what we can do to improve file transfer performance?

Thanks!

[Zoë]

Hi Kurt,

If you configure BC to use multiple SFTP connections it will use them for both file transfers and directory listings. It actually speeds up listings even more than file transfers since a lot of the directory listing time is back and forth setting up the connection and the like.

[kurt2439]

Thanks for the quick reply! That sounds promising -- although I just looked at the settings and it is set to "Use Default" which appears to be 10 simultaneous connections by the greyed out values. Is that truly the default?

If so, I doubt I will get much more performance out of the sync process.

[Zoë]

The "Use default" checkbox means to use the values inherited from the "<default>" entry at the top of the profile list. As shipped we only use 1 connection, but if you do increase it there it will be reflected in any other profiles that have "Use default" checked, and the greyed out values are what it's currently using. So, yeah, if yours shows 10 you must have already customized it at some point, and theoretically you should already be using 10 connections.

[kurt2439]

Bummer. I guess we will have to be happy with the sync time we are getting currently.

One other question, is there any way to see the status of each individual connection?

Thanks for making such a powerful program for such a reasonable price!

[Zoë]

One other question, is there any way to see the status of each individual connection?

Not right now. If you're using plain FTP it's a text protocol so you can see the directory listings, which should be much faster if you use multiple protocols. SFTP is a binary protocol, so we really only log the initial connection details. You should see the login 10 times though.