Data Engineer Professional · Domain 2: Data Ingestion & Acquisition · 12% of the exam
Task 2.4: Implement OpenSharing (D2D and Databricks-to-Open) and Clean Rooms for privacy-preserving collaboration.
Shares, recipients and providers, Databricks-to-Databricks and open sharing, history and partitions in shares, and clean rooms with notebooks and output tables.
Study it
OpenSharing and Clean Rooms
Lesson coming
Sample questions
Try each one before opening the answer. Every option is explained, with the Databricks documentation page that proves it.
Question 1 · choose 1
A provider shares the table sales.orders with a partner's Databricks workspace through Databricks-to-Databricks OpenSharing. The share was created years ago without table history. The partner now wants to process only new and changed rows from the change data feed instead of reading the full table each day. What must the provider do?
AEnable change data feed, then share the table WITH HISTORY
BGrant the recipient MODIFY on the share as well as SELECT
CCreate a new open sharing recipient with a bearer token for the partner
DAdd the table to the share again under an alias with a partition filter
Show the answer and why
AEnable change data feed, then share the table WITH HISTORY
Correct
Recipients can read the change data feed only if CDF was enabled on the table before it was shared with history.
BGrant the recipient MODIFY on the share as well as SELECT
Incorrect
Recipients get read access through SELECT on a share; MODIFY is not a share privilege and does not expose changes.
CCreate a new open sharing recipient with a bearer token for the partner
Incorrect
The protocol is not the problem; without history and CDF no recipient can query the changes.
DAdd the table to the share again under an alias with a partition filter
Incorrect
Re-adding the table under an alias or with a filter does not make its changes readable; that depends on history and the change data feed.
A recipient can read the change data feed of a shared table only when the provider enabled change data feed on the table before sharing it WITH HISTORY. A share made without history, or a table whose change data feed was off when it was shared, gives the recipient no change records.
In a two-party clean room, a data engineer uploads a notebook that joins both parties' tables. What must happen before the notebook can run?
AThe creator of the clean room must grant it EXECUTE
BA Databricks admin must sign off on the notebook
CThe other collaborator must approve the notebook
DNothing; the uploader can run it at once
Show the answer and why
AThe creator of the clean room must grant it EXECUTE
Incorrect
All collaborators have equal privileges; approval is required.
BA Databricks admin must sign off on the notebook
Incorrect
Approval comes from the collaborators, not Databricks.
CThe other collaborator must approve the notebook
Correct
Clean rooms require approval by the other collaborators before a notebook can run.
DNothing; the uploader can run it at once
Incorrect
A notebook must be approved by others before it runs.
Clean rooms follow a no-trust model in which every collaborator, including the creator, has equal privileges. A notebook must be approved by the other collaborators before it can run.
A provider shortens the metastore's default recipient token lifetime from one year to 90 days. Existing Databricks-to-Open recipients still have tokens that expire next year. What must the provider do?
ANothing; the new lifetime applies to all tokens at once
BRotate the existing recipients' tokens
CDrop and recreate the share
DSwitch the recipients to Databricks-to-Databricks sharing
Show the answer and why
ANothing; the new lifetime applies to all tokens at once
Incorrect
Existing recipient tokens keep their lifetime.
BRotate the existing recipients' tokens
Correct
The new default does not update existing recipients; their tokens must be rotated to get the new lifetime.
CDrop and recreate the share
Incorrect
Tokens belong to recipients, not shares.
DSwitch the recipients to Databricks-to-Databricks sharing
Incorrect
Those recipients have no Databricks workspace to use it.
Recipient tokens are used only for Databricks-to-Open sharing and last at most one year. Changing the default lifetime does not change existing recipients; rotate their tokens to apply it.
A provider shares a Delta table that has deletion vectors enabled with a Databricks-to-Databricks recipient, with history. The recipient's queries from a cluster on Databricks Runtime 13.3 LTS fail. How can the recipient query the table?
AAsk the provider to add the table to the share again under an alias
BAsk the provider to add the table with a partition specification
CAsk the provider to share the table WITHOUT HISTORY instead
DQuery it from a SQL warehouse or Databricks Runtime 14.1 or above
Show the answer and why
AAsk the provider to add the table to the share again under an alias
Incorrect
An alias changes the name that recipients see, not how they read it.
BAsk the provider to add the table with a partition specification
Incorrect
A partition specification limits the shared rows, not the reader needed.
CAsk the provider to share the table WITHOUT HISTORY instead
Incorrect
A table with deletion vectors or column mapping must be shared with history.
DQuery it from a SQL warehouse or Databricks Runtime 14.1 or above
Correct
Recipients query tables with deletion vectors or column mapping from a SQL warehouse, Databricks Runtime 14.1 or above, or delta-sharing-spark 3.1 or above.
Tables with deletion vectors or column mapping are shared with history. Recipients can query them from a SQL warehouse, from compute on Databricks Runtime 14.1 or above, or from compute running open source delta-sharing-spark 3.1 or above.