In Query federation, Data 360 queries data using partner-manager
compute.
When you deploy a data stream, an external data lake object (DLO) is created. The external
DLO is a storage container with metadata for the federated data. The DLO acts as a reference
and points to the data physically stored in the partner’s data warehouse or data lake. You can
also opt for caching to improve performance.
Note During the testing phase, we observed that the optimal data volume
returned from the data lake when caching is enabled is up to 234 GB for Amazon Redshift, 20 GB
for Snowflake, 23 GB for Databricks, and 10 GB for Google BigQuery. For our test datasets,
these aforementioned data volumes translate to 1 Billion rows for Amazon Redshift, 500 million
for Databricks, 750 million for Snowflake, and 100 million rows for Google BigQuery. These
numbers are mere representative examples and the number of rows associated can vary for your
use-cases.
We use three kinds of cookies on our websites: required, functional, and advertising. You can choose whether functional and advertising cookies apply. Click on the different cookie categories to find out more about each category and to change the default settings.
Privacy Statement
Required Cookies
Always Active
Required cookies are necessary for basic website functionality. Some examples include: session cookies needed to transmit the website, authentication cookies, and security cookies.
Functional Cookies
Functional cookies enhance functions, performance, and services on the website. Some examples include: cookies used to analyze site traffic, cookies used for market research, and cookies used to display advertising that is not directed to a particular individual.
Advertising Cookies
Advertising cookies track activity across websites in order to understand a viewer’s interests, and direct them specific marketing. Some examples include: cookies used for remarketing, or interest-based advertising.