Microsoft Fabric Data Engineer Associate DP-700 Practice Question
You ingest a daily parquet file of customer data into a Delta table named customer_raw in a Microsoft Fabric lakehouse. You must populate a DimCustomer table that tracks history using a Type 2 slowly changing dimension (SCD) while avoiding full-table reloads. Which transformation pattern should you use to meet the requirements?
Execute a PySpark notebook that performs a Delta MERGE between customer_raw and DimCustomer to insert new customers and version changed records with new surrogate keys.
Configure a Dataflow Gen2 incremental refresh that truncates DimCustomer and appends the current day's customer records.
Run a T-SQL CREATE TABLE AS SELECT (CTAS) statement each day to overwrite DimCustomer with the latest snapshot from customer_raw.
Create a KQL materialized view over customer_raw and expose it directly as the DimCustomer dimension.
A Type 2 SCD requires detecting changes in the source by business (natural) key and keeping a full history of those changes in the dimension. A PySpark notebook that issues a Delta MERGE statement can compare the incoming customer_raw rows with the existing DimCustomer rows on the natural key, insert previously unseen customers, and when attribute values change, set the current record's end date (or IsCurrent flag) and write a new row with a new surrogate key and updated values. Delta Lake's MERGE command is optimized for incremental upserts and supports atomic inserts and updates without re-processing unchanged rows. The other approaches reload or virtualize the whole table and therefore cannot efficiently maintain multiple historical versions of each customer.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is a Type 2 Slowly Changing Dimension (SCD)?
Open an interactive chat with Bash
What is a Delta Merge in PySpark?
Open an interactive chat with Bash
What is the benefit of using Delta Lake for maintaining historical data?
Open an interactive chat with Bash
Microsoft Fabric Data Engineer Associate DP-700
Ingest and transform data
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .