You are here:
Extract Mode Use Case
Learn more about extract modes in Data 360 with a specific scenario.
The following example uses a data extension with the following column headers: Claim Number (Data Type: Number); Claim Status (Data Type: Text); Claim Created Date (Data Type: DateTime); Claim Updated Date (Data Type: DateTime).
Raw Data in Marketing Cloud Engagement
| Day 1 Snapshot in Marketing Cloud Engagement | |||
|---|---|---|---|
| Claim Number | Claim Status | Claim Created Data | Claim Updated Date |
| 1 | New | 12/1/2019 | 12/1/2019 |
| 2 | New | 12/1/2019 | 12/1/2019 |
| 3 | New | 12/1/2019 | 12/1/2019 |
| Day 2 Snapshot in Marketing Cloud Engagement | |||
|---|---|---|---|
| Claim Number | Claim Status | Claim Created Date | Claim Updated Date |
| 1 | New | 12/1/2019 | 12/1/2019 |
| 2 | In Review | 12/1/2019 | 12/2/2019 |
| 3 | New | 12/1/2019 | 12/1/2019 |
| 4 | New | 12/2/2019 | 12/2/2019 |
| 5 | New | 12/2/2019 | 12/2/2019 |
Goal
Make sure that Data 360 has the most recent data.
Option 1: Set Extract Method to Full Refresh
- On day 1, data for all time is sent, in this case three rows of data. Rows corresponding to Claims #1, 2, 3 are sent.
- On day 2, data for all time is sent again, in this case now five rows of data. Rows corresponding to Claims #1, 2, 3, 4, 5 including updated Status for Claim #2 are sent.
Outcome: Goal achieved. Data 360 has all up-to-date data.
Option 2: Set Extract Method to Numeric Change Date Capture (CDC) based on the Claim Number column
- On day 1, all initial data is sent in this case three rows of data. Rows corresponding to Claims #1, 2, 3 are sent.
- On day 2, the claims that accumulated between the penultimate claim number maximum of 3 and the newest claim number maximum of 5 are sent. Rows corresponding to Claims #4 and 5 are sent.
Outcome: Goal not achieved. Data 360 has data for all 5 claims, but it doesn't have the most recent status for Claim #2.
Option 3: Set Extract Method to Date Time CDC based on Claim Updated Date column
- On day 1, all initial data is sent, in this case three rows of data. Rows corresponding to Claims #1, 2, 3 are sent.
- On day 2, the claims that accumulated between the penultimate claim updated date maximum of 12/1/2019 and the newest claim updated date maximum of 12/2/2019 are sent. Rows corresponding to Claims #2, 4, and 5 are sent.
Outcome: Goal achieved. Data 360 has data for all 5 claims and it has the most recent status for Claim #2.
Option 4: Set Extract Method to Date Time CDC based on Claim Created Date column
- On day 1, all initial data is sent, in this case three rows of data. Rows corresponding to Claims #1, 2, 3 are sent. On day 2, the claims that accumulated between the penultimate claim created date maximum of 12/1/2019 and the newest claim created date maximum of 12/2/2019 are sent. Rows corresponding to Claims #4 and 5 are sent.
Outcome: Goal not achieved. Data 360 has data for all 5 claims, but it doesn't have the most recent status for Claim #2.
Conclusion
The Full Refresh option and the Date Time CDC with Claim Updated Date high-water mark result in the most up-to-date data for Data 360. But the Full Refresh option means that Data 360 processed 8 total rows of data: 3 rows on day 1 and 5 rows on day 2. The Date Time CDC option means that Data 360 processed 6 total rows of data: 3 rows on day 1 and 3 rows on day 2. Date Time CDC extract based on updated date column is the most efficient option when scaling your use case.
Caveats
If the data extension is extracted from Engagement for an existing automation, the UI reflects the previously configured Extract Mode and high-water mark field.
