Supported File Formats in Data 360

Supported File Formats

Important We recommend you refer Data 360 Limits and Guidelines to know the applicable file limitations.

Data 360 supports these file formats:

• Delimited text files such as CSV files.
• Parquet files when data is ingested from Amazon S3, Google Cloud Storage, Microsoft Azure Storage, SFTP.

Note You must use ASCII characters in text fields such as file name, wildcard, directory name, or formula syntax editor. UTF-8 sometimes contains non-ASCII characters that aren’t guaranteed to work properly. Also, don't use :(colon) and ' (single quote) in file names and formulas.

Note Files containing newline characters and multiline text columns are not supported.

Supported File Formats for Unstructured Data

Data 360 supports several file formats for unstructured data and search index configurations. For a complete list, see Unstructured Data File Formats and Connectors.

Supported Delimiters

Note Data 360 automatically evaluates the ingested files and determines the delimiter. We recommend using double quotes around values in a file to ensure the system detects the correct file delimiter.

Supported File Compression Formats

Ingestion of Parquet Files

Data 360 supports these parquet data types and they’re converted to the corresponding Data 360 data types. If a parquet file contains a data type that's not supported in Data 360, the column is ignored and not ingested. You can view the unsupported fields when configuring the data stream in the New Data Stream page. You can also see the unsupported data types in the New Source Fields page when adding a source field. To ingest an unsupported data type. convert it to a Data 360 supported datatype in the source parquet file.

Note * Indicates a primitive data type in Parquet files.