You Are Building a New Application That You Need to Collect

question 113

Multiple Choice

You are building a new application that you need to collect data from in a scalable way. Data arrives continuously from the application throughout the day, and you expect to generate approximately 150 GB of JSON data per day by the end of the year. Your requirements are: Decoupling producer from consumer Space and cost-efficient storage of the raw ingested data, which is to be stored indefinitely Near real-time SQL query Maintain at least 2 years of historical data, which will be queried with SQL Which pipeline should you use to meet these requirements?

• A) Create an application that provides an API. Write a tool to poll the API and write data to Cloud Storage as gzipped JSON files.
• B) Create an application that writes to a Cloud SQL database to store the data. Set up periodic exports of the database to write to Cloud Storage and load into BigQuery.
• C) Create an application that publishes events to Cloud Pub/Sub, and create Spark jobs on Cloud Dataproc to convert the JSON data to Avro format, stored on HDFS on Persistent Disk.
• D) Create an application that publishes events to Cloud Pub/Sub, and create a Cloud Dataflow pipeline that transforms the JSON event payloads to Avro, writing the data to Cloud Storage and BigQuery.

---

Definitions:

CAT Scan

Short for Computerized Axial Tomography Scan, a medical imaging technique that combines multiple X-ray measurements to generate detailed cross-sectional images of the body, including slices of the brain.

X-rays

A form of electromagnetic radiation that can pass through many materials, including the human body, and is used in medical imaging to create pictures of the inside of the body.

Visualization

The process of creating mental images to represent information, objects, or spaces for the purpose of problem-solving or understanding.

Transcranial Magnetic

Referring to a non-invasive method that uses magnetic fields to stimulate nerve cells in the brain to improve symptoms of various neurological and psychiatric conditions.