Skip to content

Live Connect Zero Copy With Databricks

This feature is not enabled by default. Contact your Customer Success representative or Treasure AI Support to have it enabled for your account.

The Databricks implementation of zero-copy leverages Delta Sharing. The data flow looks like this:

At a high level, the steps you take to implement zero-copy with Databricks Delta sharing are:

  1. Setup Delta Sharing in Databricks. This includes
    • Configuring data sharing capabilities
    • Creating a share
    • Defining recipient settings

Consult Delta Sharing open sharing workflow for additional details about configuring Delta Sharing.

  1. When leveraging data from Databricks via the Delta Sharing protocol, by default, your data is stored in memory in Treasure Data for various processing needs such as ID unification, parent segment refresh, and activations. Customers have the option to persist their data by saving a copy of the processed data to a Treasure Data table.

See Also