You Architect a System to Analyze Seismic Data

question 86

Multiple Choice

You architect a system to analyze seismic data. Your extract, transform, and load (ETL) process runs as a series of MapReduce jobs on an Apache Hadoop cluster. The ETL process takes days to process a data set because some steps are computationally expensive. Then you discover that a sensor calibration step has been omitted. How should you change your ETL process to carry out sensor calibration systematically in the future?

• A) Modify the transformMapReduce jobs to apply sensor calibration before they do anything else.
• B) Introduce a new MapReduce job to apply sensor calibration to raw data, and ensure all other MapReduce jobs are chained after this.
• C) Add sensor calibration data to the output of the ETL process, and document that all users need to apply sensor calibration themselves.
• D) Develop an algorithm through simulation to predict variance of data output from the last MapReduce job based on calibration factors, and apply the correction to all data.

---

Definitions:

Self-Appointed Mindguards

Members of a decision-making group who take it upon themselves to protect the group from dissenting information that might disrupt consensus or harmony.

Abilene Paradox

A situation where a group collectively decides on a course of action that is counter to the preferences of many, if not all, of the members of the group.

Groupthink

A psychological phenomenon where the desire for harmony in a decision-making group overrides a realistic appraisal of alternatives.

Ordering a Pizza

The act of requesting a pizza from a restaurant or food service, typically involving the selection of specific toppings, size, and delivery or pickup options.