You are building an Azure Data Lake solution that will be queried by Spark for large-scale analytics. To minimize storage costs and improve scan performance, you want a columnar, compressed, open-source file format. Which format best meets these requirements?
JSON
Avro
Parquet
CSV
Parquet is an open-source, columnar storage format that stores data by column rather than by row. This layout enables efficient compression and allows scan operations to read only the columns that a query needs, reducing both I/O and storage costs-advantages that make Parquet a common choice for big-data analytics engines such as Apache Spark.
CSV and JSON store data in a row-oriented manner and provide no built-in column pruning or advanced compression, so they offer lower analytical performance and typically larger file sizes. Avro is a binary, row-based format that supports schema evolution but is not columnar, so it does not provide the same scan-time benefits required in this scenario.
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
All IT & Cybersecurity Package plans include the following perks and exams .
Our pricing is simple. Full access to all certifications and exams in each package, for one price.
As many practice tests for as many topics as you want.
Use study mode non-stop, no limits.
Access to our AI assistant, Bash, trained to help you pass your exam.
Track your scores over time in study mode and report cards.
See how you improve over time, and where you need to focus.
Access our store with even bigger discounts than before.
Unlimited access to all performance questions and be prepared for the real thing.
All IT & Cybersecurity Package plans include unlimited access to the following study materials.
Create an account or sign in to access our study materials.