Data Federation, Ingestion, and Modeling

Data federation and data ingestion bring data from external data sources into Data 360. Data modeling is the next important phase to process data in Data 360.

Data federation in Data 360 allows you to set up connectivity with external data sources and consume data without copying it into Data 360. You create and deploy a data stream that in turn creates an external data lake object (DLO). The DLO acts as a reference, and points to the data physically stored in an external data source.

In data ingestion, data from a data source is brought in as is, meaning that fields and their data types are imported without transformation. You create a data stream to bring in the data into Data 360. Data ingested by all data streams is written to data lake objects (DLOs).

During data modeling, the preserved source schemas are harmonized into standard or customizable data models. The data models are based on Customer 360 Data Model that describes the data with well-defined standardized data guidelines. In this phase, connections are created between related data brought from disparate sources by mapping DLOs to data model objects (DMOs). A DMO is a grouping of data created from data streams, insights, and other data sources.

• BYOL Data Federation Supportability
  Refer to the list of supported and unsupported features of Data 360 when you use Bring Your Own Lake (BYOL) data federation.