Configure Incremental Sync for Salesforce Data

During the first sync of an object, CRM Analytics always performs a full sync. Switching the site or migrating the org also triggers the object to undergo a full sync.

Note When reviewing the results of an incremental sync job in Job Manager, the Rows in and Rows out values represent the total number of rows across all syncs.

1. In Data Manager, click the Connections tab.
2. From a local or external Salesforce connection, such as SFDC_LOCAL, click to the right of the Salesforce object that you want to sync, and then select Edit Connection Mode.

   Connection mode doesn’t apply to objects with other connection types.

3. Select one of these modes.

   Connection Mode	Description
   Incremental Sync	Pulls only new, updated, and soft-deleted records to match the changes in the Salesforce object since the previous sync. Use this method to run faster syncs. Incremental sync doesn’t update records that are excluded through Data Sync filters, and it doesn't remove hard-deleted records.
   Periodic Full Sync	Runs an incremental sync on each scheduled sync. Also runs a full sync on the first sync that happens after Friday 11 PM in your org’s time zone.
   Full Sync	Pulls all records from the Salesforce object and overwrites the records from the previous sync.

4. 

   Note

   The API Type for the connector must be BULKV2 for incremental and periodic full sync.

5. Save your changes.

Considerations When Syncing Data Incrementally

• Incremental sync isn’t supported for Salesforce big objects or these objects.
  • CallCenter
  • CaseTeamMember
  • CategoryNode
  • CollaborationGroup
  • CollaborationGroupMember
  • CollaborationGroupMemberRequest
  • Division
  • Domain
  • DomainSite
  • Group
  • GroupMember
  • ModelFactor
  • Profile
  • Site
  • Territory
  • Topic
  • User
  • UserRole
  • UserTerritory
• Even if incremental sync is enabled, CRM Analytics performs a full sync when.
  • The object performs hard deletes or cascade hard deletes on records.
  • The object is known to fail when queried without a specific filter or where condition.
  • The object doesn’t have a datetime system field.
  • The object has fields or field attributes (such as scale and precision) specified for the sync that don't match the previously synced dataset. If you make field changes in an sfdcDigest dataflow node, such as adding or removing fields, or changing attributes, CRM Analytics triggers a full sync the next time that sync runs.
  • The object is configured for a periodic full sync.
• Some objects, such as ContentVersion, delete records without notifying the incremental mechanism, which can result in data drift. Data drift is the potential for records to be included or excluded due to operations that run during a data sync run. For example, adding a record during a sync isn't always included or a hard record delete between incremental runs can be ignored. Selecting periodic full sync performs the reset required to keep the data sync object true to what appears in Salesforce.
• Verify that your org doesn’t have conflicting sync settings for the same object. For example, if incremental sync is turned off in an sfdcDigest node and not turned on in later nodes for the same object in the same dataflow, then a full sync is performed. To enable incremental sync, set the incremental parameter to true in the dataflow JSON.
• If multiple dataflows have conflicting sync settings for the same object, CRM Analytics uses the object’s sync settings from the last saved dataflow.
• Run full sync for objects containing formula fields. With incremental sync, formula fields can become out of sync with your synced object.
• Run a full sync manually if incremental sync fails for objects that have many updates. If incremental syncs continue to fail, set the object’s connection mode to Full Sync.
• To ensure that all updates are included, set the object's connection mode to Periodic Full Sync.