Loading

Dataflow warning: "The dataflow was completed, but augment node performed a LookupMultiValue augment operation on a date field, which can give unexpected results"

Publiceringsdatum: Oct 13, 2022
Beskrivning


Dataflow Warning Message

 A date field in the "right_select" of an Augment that performs a "LookupMultiValue" operation will produce this warning:


"The dataflow was completed, but augment node performed a LookupMultiValue augment operation on a date field, which can give unexpected results. We recommend that you set this node to LookupSingleValue, or move the DateField field to a separate LookupSingleValue augment node."


NOTE: This is not a Dataflow Failure. This does not prevent the dataflow from completing. This message is only to alert you to the potential data issues of a multi-value Date.

 

Impact of LookupMultiValue on a Date Field

An augment Transformation using "operation": "LookupMultiValue" generates a multivalue field for any dimensions. It also sums any measures. Date fields are a meta field type that includes both measures and dimensions as date components. If a Date field is included in the "right_select" parameter of the Augment node, the resulting multi-value and summed component fields may behave in unexpected ways.

The date dimension components ("DateField_Year", "DateField_Month", "DateField_Day", etc.) will lose their internal association. References to them will be non-deterministic (random). Creating a multivalue field set could result in varied and meaningless outputs.
For example:
 
Original Date Values
01 / 20 / 2015
07 / 25 / 2018

Possible Outcomes for Year-Month-Day Grouping on Multi-Value Date
2015-01-20
2015-01-25
2015-07-20
2015-07-25
2018-01-20
2018-01-25
2018-07-20
2018-07-25
 
Also, the LookupMultiValue operation will sum the "DateField_sec_epoch" and "DateField_day_epoch" measures, rendering them meaningless.
 
Continuing the above example:
 
Original Date Values and Epoch Seconds
01 / 20 / 2015 : 1421712000
07 / 25 / 2018 : 1532476800

Output "_sec_epoch" for Multi-Value Date
2954188800
This converts to 08 / 13 / 2063
Lösning


Interpreting and Resolving the Warning

 
To determine which augment(s) were impacted, expand the dataflow in the data monitor. Look for any augment nodes with this warning.
 
Perform one of the following resolutions:
 
  • Change the "operation" parameter for the impacted node(s) to "LookupSingleValue"
  • Remove the date field(s) from the right side fields. If the date field is critical to your needs, create a separate augment for the date(s) using "LookupSingleValue"
  • Make no changes. Be aware that the impacted date field(s) will return unexpected results

 

Knowledge-artikelnummer

000383221

 
Laddar
Salesforce Help | Article