Do we have a file size limitation for our SFTP connector?
SFTP connector does not enforce any hard limit for the size of files to be fetched from SFTP server. The connector uses streaming, so it is able to deal with much larger files without any issues.
However, similar to manual transfers of large files between SFTP server and client, you may encounter issues due to connection resets or broken connection issues on the SFTP server end. The connection (an unstable connection, termination of connection based on some policy, etc.) or some settings on the UNIX server hosting the SFTP server.
In case of large files, the possibility of picking up the same file, which is already being processed (being transferred), during next iteration is a possibility. So, changing the file polling time to pick up the file has to be tweaked based on the size of the files you are dealing with. By checking the behavior for different polling timers, you will arrive at an optimal value for your application.
001118267

We use three kinds of cookies on our websites: required, functional, and advertising. You can choose whether functional and advertising cookies apply. Click on the different cookie categories to find out more about each category and to change the default settings.
Privacy Statement
Required cookies are necessary for basic website functionality. Some examples include: session cookies needed to transmit the website, authentication cookies, and security cookies.
Functional cookies enhance functions, performance, and services on the website. Some examples include: cookies used to analyze site traffic, cookies used for market research, and cookies used to display advertising that is not directed to a particular individual.
Advertising cookies track activity across websites in order to understand a viewer’s interests, and direct them specific marketing. Some examples include: cookies used for remarketing, or interest-based advertising.