Crucial Exams

Microsoft Fabric Data Engineer Associate DP-700 Practice Question

You ingest daily customer order files into a lakehouse table. Each file may contain multiple versions of the same CustomerID and OrderDate combination, distinguished by a LastModified timestamp column. Using a PySpark DataFrame, you must keep only the most recent version of each record before loading to Silver. Which transformation should you implement?

  • Sort the DataFrame by LastModified descending and then call distinct().

  • Use groupBy("CustomerID", "OrderDate").agg({"*": "max"}) to collapse the rows.

  • Define a Window partitioned by ["CustomerID", "OrderDate"] ordered by col("LastModified").desc(), add row_number(), and filter where row_number() == 1.

  • Apply dropDuplicates(["CustomerID", "OrderDate"]) to the DataFrame.

Microsoft Fabric Data Engineer Associate DP-700
Ingest and transform data
Your Score:
Settings & Objectives
Random Mixed
Questions are selected randomly from all chosen topics, with a preference for those you haven’t seen before. You may see several questions from the same objective or domain in a row.
Rotate by Objective
Questions cycle through each objective or domain in turn, helping you avoid long streaks of questions from the same area. You may see some repeat questions, but the distribution will be more balanced across topics.

Check or uncheck an objective to set which questions you will receive.

Wipe Score
Bash, the Crucial Exams Chat Bot
AI Bot