You are here:
Create a Data Stream from a Marketing Cloud Engagement Data Extension
Create a data stream in Data 360 to ingest data from a Marketing Cloud Engagement data extension.
Required Editions
| Available in: All Editions supported by Data 360. See Data 360 edition availability. |
| User Permissions Needed | |
|---|---|
| To create a data stream | Permission set:
|
The frequency of data extension extracts depends on the extract mode chosen and can't be edited: Full and Delta.
Full extracts are received from Engagement and processed daily. Since Data 360 checks for files to process hourly, you'll see 24 refreshes in the Data Stream tab but only one extract is processed.
Delta extracts are received from Engagement and processed hourly. When a data stream for a Delta extract is created, the data extension is fully extracted and ingested into Data 360 on the first run. After that, only Deltas are extracted each hour. For both extract modes, the remaining refreshes show zero rows processed due to no new data from Engagement.
- In Data Cloud, go to the Data Streams tab, and click New.
- Select the Marketing Cloud data source, and click Next.
- From the Connections menu, select the Marketing Cloud Engagement connection you want to configure.
- Select the data spaces to be mapped to the business units of the chosen connection.
- Choose a data extension.
A data extension can belong to one or more business units. Data extensions that belong to multiple business units are listed under Shared Data Extensions.
- Select a business unit in the context filter dropdown to view its data extensions.
- Select the data extension to import.
- (Optional) Change the object label or object API name.
- Select the category and define the primary key.
- Review the field list, and optionally edit the field label, field API name, and data type.
- (Optional) To cleanse your source data or get new fields, add formula fields.
- Configure the data stream name, extract mode, and refresh mode.
If the data extension was already extracted from Engagement, the extract mode and the refresh mode are unavailable. Deleting and recreating the stream doesn’t enable these modes. To extract data using a different method, create a data extension with a unique name to use with the new data stream.
Note A number or date field is required for delta extract options to become available. - Click Deploy.
- To map the data source object to the data model, go to the Data Streams home page and click Start Data Mapping.
When the data extension is extracted for the first time, it takes up to 24 hours for data to be available in the system. After the first 24 hours, data is populated according to the frequency indicated in the data stream settings. Delta extracts load the previous 90 days of data when the data stream is initially configured. Subsequent runs load only new or updated records. For Engagement type, Data 360 extracts the last 90 days of data and for Profile type, the entire dataset is extracted.
- Data Extensions
Data Extension is a table within the application database that contains your data. You can use the data to run queries, pull information, and send to a subset of subscribers. Data extensions can be used in Marketing Cloud Engagement connector. Import Engagement Data Extensions into Data 360 using our Engagement connector. - Extract Mode for a Marketing Cloud Engagement Data Extension in Data 360
Marketing Cloud Engagement Connector Extract mode dictates how Data 360 exports and imports data from Marketing Cloud Engagement. - Refresh for Data Extension Data Streams
For a data extension data stream with the refresh mode of upsert, you can choose to perform either an incremental or a full data refresh.
