Modify and Enrich Salesforce Data with Data Pipelines

Note Starting in Summer '25, Data Pipelines is supported for Government Cloud Plus and Government Cloud Plus Defense customers.

If your CRM data is scattered among multiple systems, use Data Pipelines to consolidate it into one system, like Salesforce. Bring in data from external services, like Snowflake, Amazon S3, and more. To gain access to data in external systems, use the prebuilt connectors—there are a ton of them. For systems that don’t have a connector, export the data as a CSV, and then upload it.

• Get Familiar with Salesforce Data Pipelines
  Before you start using Salesforce Data Pipelines, learn what it can do and get familiar with its tools.
• Set Up Salesforce Data Pipelines
  Enable Data Pipelines and grant users access to it.
• Modify and Enrich Data with Recipes
  Use recipes to prepare large amounts of Salesforce and external data at scale before loading it into Salesforce objects. For example, you can define data preparation logic that combines data from two data sources and cleans up inconsistent date formats. Add nodes and transformations to a recipe to perform calculations, and to combine, transform, enrich, and clean your data. Use smart transformations to predict missing values, detect text sentiment, and forecast key metrics.
• Query Datasets with the Query API Endpoint
  If your recipes write results to datasets, you can query the datasets using the Query API endpoint. Although this endpoint is part of the CRM Analytics REST API, you can use it to query datasets built with Data Pipelines. This endpoint supports SAQL and SQL queries. You can use this endpoint to create an application that queries data in datasets.