Microsoft Fabric Data Engineer Associate DP-700 Practice Question
You are using Apache Spark Structured Streaming in a Microsoft Fabric lakehouse to process click-stream data. Business analysts need rolling, device-level counts of clicks over the last 10 minutes, refreshed every 2 minutes. Late-arriving events (out-of-order by timestamp) must be accepted if they arrive within three minutes of their event time. Which aggregation statement meets all requirements?
The task requires a sliding (overlapping) window because results must be recomputed every two minutes for the previous ten-minute period. In Spark Structured Streaming a sliding window is created by passing both the window duration and the slide duration to the window function. Watermarking is added to admit late data up to a specified threshold. Therefore, the correct solution is to apply .withWatermark("eventTime","3 minutes") .groupBy(window(col("eventTime"), "10 minutes", "2 minutes"), col("deviceId")) which:
Defines a 10-minute window that slides every two minutes, giving overlapping results that refresh as required.
Adds a three-minute watermark so events that arrive within that lateness are still included. The distractors either create non-overlapping (tumbling) windows, omit the slide interval, set an incorrect watermark, or fail to add any watermark, thus violating latency or correctness requirements.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is a watermark in Apache Spark Structured Streaming?
Open an interactive chat with Bash
What is the difference between a sliding window and a tumbling window in Spark streaming?
Open an interactive chat with Bash
What is the purpose of the `window` function in Spark Structured Streaming?
Open an interactive chat with Bash
Microsoft Fabric Data Engineer Associate DP-700
Ingest and transform data
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .