You are here:
Using an Existing Data Lake Object to Create a Data Stream
You can use an existing data lake object (DLO) when creating an S3, Google Cloud Storage, or SFTP data stream. The data stream that initially created the DLO defines the characteristics, such as the primary key, event date time, and record modified field. You can convey how the new data stream’s fields conform to the existing DLO fields.
Keep these considerations in mind when using an existing DLO to create a data stream.
- You can’t use a DLO that’s already being used by another source.
- You must bring in all data stream fields. If the DLO doesn’t have a field that corresponds to your data stream field, you can extend the DLO on the Data Lake Object tab.
- A data stream field must have the same data type as its intended DLO target field. If you can’t locate the DLO field in the dropdown, it’s because of a data type mismatch or another data stream field is using the DLO field.
- You must assign a data stream field to the DLO’s primary key.
- If the DLO is in the Engagement category, assign a data stream field to the DLO’s Event Date Time.
- If the DLO is of category Profile and the Record Modified field was previously declared on the DLO, assign a data stream field to it. If the Record Modified field hasn’t been previously assigned, you can configure it during data stream setup.
- If the Organization Unit Identifier was previously declared on the DLO, assign a data stream field to it. If it hasn’t been previously assigned, you can configure it during data stream setup.
Did this article solve your issue?
Let us know so we can improve!
