Question 1

A data engineer is analyzing a Spark job via the Spark UI. They have the following summary metrics for 27 completed tasks in a particular stage

Which conclusion can the data engineer draw from the above statistics ?

Options :

A : All task are operating over partitions with even amounts of data

B : All task are operating over empty or near empty partitions

C : All tasks are operating over partitions with larger skewed amounts of data.

D : Number of tasks are operating over partitions with larger skewed amounts of data.

E : Number of tasks are operating over empty or near empty partitions

Answer: D

Question 2

A data engineer, User A, has promoted a new pipeline to production by using the REST API to programmatically create several jobs. A DevOps engineer, User B, has configured an external orchestration tool to trigger job runs through the REST API. Both users authorized the REST API calls using their personal access tokens. Which statement describes the contents of the workspace audit logs concerning these events?

Options :

A :

Because the REST API was used for job creation and triggering runs, a Service Principal will be automatically used to identify these events.

B :

Because User B last configured the jobs, their identity will be associated with both the job creation events and the job run events.

C :

Because these events are managed separately, User A will have their identity associated with the job creation events and User B will have their identity associated with the job run events.

D :

Because the REST API was used for job creation and triggering runs, user identity will not be captured in the audit logs.

E :

Because User A created the jobs, their identity will be associated with both the job creation events and the job run events.

Answer: C

Question 3

Which of the following describes the minimal permissions a data engineer needs to start and terminate an existing cluster ?

Options :

A : “Can Attach To” privilege on the cluster

B : “Can Restart” privilege on the cluster

C : “Can Manage” privilege on the cluster

D : Cluster creation allowed + “Can Attach To” privileges on the cluster

E : Cluster creation allowed + “Can Restart” privileges on the cluster

Answer: B

Question 4

What is true for Delta Lake?

Options :

A : Because Parquet compresses data row by row. strings will only be compressed when a character is repeated multiple times.

B : Delta Lake automatically collects statistics on the first 32 columns of each table which are leveraged in data skipping based on query filters.

C : Views in the Lakehouse maintain a valid cache of the most recent versions of source tables at all times.

D : Primary and foreign key constraints can be leveraged to ensure duplicate values are never entered into a dimension table.

E : Z-order can only be applied to numeric values stored in Delta Lake tables.

Answer: B

Question 5

Where in the Spark UI can one diagnose a performance problem induced by not leveraging predicate pushdown?

Options :

A : In the Executor’s log file, by grepping for "predicate push-down"

B : In the Stage’s Detail screen, in the Completed Stages table, by noting the size of data read from the Input column

C : In the Storage Detail screen, by noting which RDDs are not stored on disk

D : In the Delta Lake transaction log. by noting the column statistics

E : In the Query Detail screen, by interpreting the Physical Plan

Answer: E

Confidently Practice Online with Free Databricks-Certified-Professional-Data-Engineer Exam Cram

Buying Options: