Salesforce Big Object Support in CRM Analytics

The sfdcDigest transformation can extract data from standard and custom big objects in Salesforce, with or without data sync enabled. Consider these limitations for big objects before you configure extraction.

• Incremental data sync isn’t supported, so a full sync is performed every time data sync runs.
• Filtering is supported only on primary key fields.
• Custom big object names must end in __b
• These standard big objects are supported.
  • BigObjectCounter
  • EngagementHistory
  • FeedRead
  • FeedSentimentAnalysis
  • FeedSentimentFeedbacks
• The sfdcDigest transformation uses the Bulk API to extract data from Salesforce objects, and so it’s subject to Bulk API limits.
  • When a large amount of data is extracted from a big object, a maximum of 15 result files are created. The Bulk Query stops when this 15-file limit is reached, even if the extract isn’t complete. Each extracted file is limited to 1 GB of data.
  • The total number of big object records that can be extracted from the Bulk API is limited to 70 million rows across all files in the dataset. The number of rows varies based on the number and size of columns in the big object being queried.
  • Each batch can run for up to 10 minutes or 1 GB of data, whichever limit is reached first.