Loading

Dataflow or data sync error: 'TODO: // Query is too large. Must partition'

Fecha de publicación: Sep 25, 2023
Descripción
Data Sync (SFDC_LOCAL) and sfdcDigest transformations in a Dataflow create SOQL queries to retrieve data from Salesforce objects. These queries are governed by the limits described in the SOQL SELECT documentation.
 
Notably, there is a limit of 20,000 characters on the length of SOQL queries. This limit cannot be increased.
 
If an sfdcDigest node or a Data Sync object contains a large number of fields, fields with long API names, formula fields, lookups, currency fields (with multi-currency) or other complex fields, the resulting SOQL query may exceed the character limit. This will result in an error containing the following:
 
TODO: // Query is too large. Must partition

This may occur even if there has been no change to the dataflow definition, as the SOQL query is interpreted and expanded in the context of the data that exists in the org. Changes in data may cause the resulting query to exceed the character limit.
Solución


Remove Unnecessary Fields from Dataflows

To resolve this error, reduce the number of fields included in the Data Sync object and the related sfdcDigest node(s):
1. Edit the dataflow.
2. Locate the sfdcDigest node specified in the error.
3. Remove fields from the node. Generally, fields that have little analytical value can be removed, such as phone numbers, long text fields, or fields that you won't be directly performing analytic operations upon.
4. Save the dataflow.
5. Remove the unneeded fields from the Data Sync for the impacted object.
6. Run Data Sync and then the dataflow.
Número del artículo de conocimiento

000384879

 
Cargando
Salesforce Help | Article