Troubleshoot Data Stream Errors

Common Zero Copy Data Stream Errors

ERROR: Time out in polling job.Try increasing the timeout value.

ERROR: EXEC_JOB_EXEC_ERR

Time out errors and job execution errors occur when you exceed optimal data volume in zero copy connectors. To fix time out errors, make sure your data volume is within:

• 234 GB or 1 billion rows for Amazon Redshift
• 20GB or 750 million rows for Snowflake
• 23 GB or 500 million rows for Databricks
• 10 GB or 100 million rows for Google BigQuery

Common CRM Data Stream Errors

ERROR: Invalid extractor job query found.\"errorCode\":\"INVALID_TYPE\"

ERROR: Invalid extractor job query found.\"errorCode\":\"INVALID_FIELD\"

An INVALID_TYPE error indicates an issue accessing the CRM object. An INVALID_FIELD error indicates the deletion of a field on the object or a loss of access to a field due to permission changes. To troubleshoot such errors,

• Confirm that the objects and fields are not deleted.
• Confirm that theSalesforce CRM Permissions still has Read, View All Records, and View All Fields permissions for the object listed in the exception.

ERROR: OPERATION_TOO_LARGE

An OPERATION_TOO_LARGE error indicates that one of the fields is referencing an entity that the CRM connector lacks access to. When an entity is related to another entity, Data 360 checks if the related record also has granted permissions before returning a row. This additional query can overload the operation, as the original query expands for each related entity. To resolve this, verify that Read and View All access is granted to all the related objects.

Common SFTP Data Stream Errors

ERROR: STREAM_JOB_STATUS_FAILURE

A STREAM_JOB_STATUS_FAILURE error can be due to the file size being too large. For SFTP, the total limit in a run is 4.5 GB and each individual file is 500 MB. To fix file size issues, make sure the file sizes on the SFTP are within the limits as outlined in the Data 360 Limits and Guidelines.

ERROR: STREAM_JOB_STATUS_CANCELLED

A STREAM_JOB_STATUS_CANCELLED error occurs when two consecutive jobs are run for the same data stream. Make sure you are running one job only at any given time in a data stream.

ERROR: STREAM_JOB_STATUS_FAILURE - Log shows "Data read has a different length than expected"

This error is because SFTP connectors does not support multiple files in a zip file. To fix this, merge all the files together or ingest the unzipped folder using a wildcard.

ERROR: Unknown Error

An Unknown Error usually occurs when the file you are trying to use is corrupted. Try again with with another file.

ERROR: Job Aborted Due to Stage Failure

A Job Aborted Due to Stage Failure error occurs when the source file is missing.

ERROR: Unable to position the current position from -1 to 0

This error occurs due to concurrent connection limits on your SFTP server. If multiple data streams are scheduled simultaneously, they might all attempt to connect at the same time, causing a failure. To resolve this:

• Check the concurrent connection limit on the SFTP server.
• Make sure the number of data streams using the same connection does not exceed the concurrent connection limit. Stagger the scheduling of data streams by approximately 30 minutes to prevent conflicts.