You Need to Create a Data Pipeline That Copies Time-Series

question 219

Multiple Choice

You need to create a data pipeline that copies time-series transaction data so that it can be queried from within BigQuery by your data science team for analysis. Every hour, thousands of transactions are updated with a new status. The size of the intitial dataset is 1.5 PB, and it will grow by 3 TB per day. The data is heavily structured, and your data science team will build machine learning models based on this data. You want to maximize performance and usability for your data science team. Which two strategies should you adopt? Choose 2 answers.

• A) Denormalize the data as must as possible.
• B) Preserve the structure of the data as much as possible.
• C) Use BigQuery UPDATE to further reduce the size of the dataset.
• D) Develop a data pipeline where status updates are appended to BigQuery instead of updated.
• E) Copy a daily snapshot of transaction data to Cloud Storage and store it as an Avro file. Use BigQuery's support for external data sources to query.

---

Definitions:

Communication

The process of exchanging information, ideas, thoughts, and feelings through verbal or non-verbal methods, such as speaking, writing, or using technology.

Internal Noise

Psychological or emotional disturbances that interfere with the ability to process information or communicate effectively.

Complex Language

A system of communication that allows for the expression of nuanced and detailed ideas, emotions, and information.

Construction Work

Refers to manual labor involved in building, repairing, or maintaining structures such as buildings, bridges, and roads.