Addressing Errors When Creating New Data Streams Using the Data Cloud Amazon S3 Connector

If you're encountering errors when creating a new data stream using the Data Cloud Amazon S3 connector, confirm that the directory name, bucket name, and AWS S3 bucket policy are correctly configured during data stream creation.

Ensure the correct directory is entered in the Import from Directory field.

• To select the root directory, leave this field blank.
• To select other folders, write the name without a leading slash. For example, use "Sales/OrderHeaders/" instead of "/Sales/OrderHeaders/".

Make sure the correct file name is entered.

• If all file names in a directory follow a certain naming pattern, set this entry as a wildcard using the file extension (e.g., *.csv).

• When using wildcards, make sure that the file naming conventions match the wildcard specification in order to include only the intended files.

• Also, the file name should not contain "Delete_" at the beginning of the file name to be imported.

  When importing data via AWS S3, other cloud storage, or the import API, if the source file contains a file named "Delete_<source file name>", the data imported in the source file will be deleted from Data Cloud.

Properly select the category (Profile, Engagement, or Other) that matches the data within the files you're ingesting.

• The Profile category represents individuals, accounts, or other profiles. This data is used for segmentation and analysis.
• The Engagement category contains behavioral information. Each record captures an individual action (like a click or purchase) performed at a specific time.
• The Other category includes information not related to profile or engagement data (e.g., product or store information).

In all categories, a unique primary key field is required to identify records. For Engagement data, an event time field is also mandatory.

Ensure Appropriate Bucket Policies are Defined in Your AWS S3 Bucket

For Data Cloud to read and write data to your AWS S3 bucket, your bucket policy must be correctly defined.
Confirm Data Cloud's IP Addresses are Allowed in AWS IP Filtering
If you are using IP filtering in AWS, ensure that Data Cloud's IP addresses are allowed.