Create a Data Pipeline With Custom Data in TotalConnect
Use TotalConnect to upload data from files or pull data directly from Data Lake Object (DLO) into Marketing Intelligence enabling flexible integration of custom datasets without an API connector.
Required Editions
Before you begin, make sure that your file is in CSV format and the size is 100 MB or less.
| Available in: Developer, Enterprise, Performance, and Unlimited editions. |
| User Permissions Needed | |
|---|---|
| To create a TotalConnect pipeline: | Marketing Intelligence Admin |
- From the App Launcher, find and select Marketing Intelligence.
- On the Data Management tab, under Data Pipelines, click Create New.
-
Select TotalConnect and then click Next.

- Select the data space.
-
Select the data source.
- To upload a custom file, click Upload File, upload your file, and then click Next.
- To pull data from an existing source, click Data Lake Object, select the object and fields, and then click Next.
- Preview the data and confirm the data type for each column—text, number, or date. Adjust data types as needed using the dropdown menu.
-
Click Map Data.
Automapping matches your data to the appropriate data model template and fields using names, synonyms, and data types.
-
Confirm the mappings.
-
Check that the data model template is correct, or click Switch
Model to change it.

- To remove a mapping, click the arrow and select Delete.
-
To check for errors, click Validate and address errors before
proceeding.

- Click Save and confirm the mappings in the mapping preview screen.
-
Check that the data model template is correct, or click Switch
Model to change it.
-
Add a new data object. The field is added to the object and is available for mapping.
-
Click + New Object. Enter a name and description, and then
click Add.
The object is created with three default fields: ID, Currency, and Name. Map the fields as needed.
- To add additional fields to the data object, click the + icon next to the object.
-
Enter a field name and description, select a data type and then click
Add.
The field is added to the object and is available for mapping.
NoteThe source and target data types must match to complete the mapping.
-
Click + New Object. Enter a name and description, and then
click Add.
Your data appears in the data pipeline table where you can verify data integration and run reports. Pipeline creation can take a few minutes. Check the status column for updates.
- Automate Data Retrieval in Marketing Intelligence
Configure automated data retrieval for TotalConnect data pipelines to regularly import data from Amazon S3 or email sources into Marketing Intelligence. - Field Automapping in Marketing Intelligence
Automapping streamlines data integration by automatically mapping source file or Data Lake Object (DLO) fields to the Marketing Intelligence data model. TotalConnect automatically creates the data transforms necessary align input with the Marketing Intelligence semantic data model. - Troubleshooting Mapping Errors in Marketing Intelligence
TotalConnect automatically validates your data mapping to meet system requirements during ingestion. These validations detect errors like missing templates, mismatched data types, or unmapped primary keys and provide guidance for resolution. Improving data accuracy enhances analysis and reporting quality.
Løste denne artikel dit problem?
Giv os besked, så vi kan forbedre os!

