You Receive Data Files in CSV Format Monthly from a Third

question 150

Multiple Choice

You receive data files in CSV format monthly from a third party. You need to cleanse this data, but every third month the schema of the files changes. Your requirements for implementing these transformations include: Executing the transformations on a schedule Enabling non-developer analysts to modify transformations Providing a graphical tool for designing transformations What should you do?

• A) Use Cloud Dataprep to build and maintain the transformation recipes, and execute them on a scheduled basis
• B) Load each month's CSV data into BigQuery, and write a SQL query to transform the data to a standard schema. Merge the transformed tables together with a SQL query
• C) Help the analysts write a Cloud Dataflow pipeline in Python to perform the transformation. The Python code should be stored in a revision control system and modified as the incoming data's schema changes
• D) Use Apache Spark on Cloud Dataproc to infer the schema of the CSV file before creating a Dataframe. Then implement the transformations in Spark SQL before writing the data out to Cloud Storage and loading into BigQuery

---

Definitions:

Littering

The act of improperly disposing of waste products in inappropriate places, leading to environmental pollution.

Consumption Per Person

Consumption Per Person refers to the average amount of resources, goods, or services used by an individual within a given population or area.

Disproportionate Use

Disproportionate Use denotes an uneven or unfair usage of resources or services, often leading to scarcity or inequity among different groups or regions.

Developed Countries

Nations with a high level of industrialization, a high standard of living, and a high Human Development Index (HDI).