You Are Designing a Service That Aggregates Clickstream Data in Batch

question 607

Multiple Choice

You are designing a service that aggregates clickstream data in batch and delivers reports to subscribers via email only once per week. Data is extremely spikey, geographically distributed, high-scale, and unpredictable. How should you design this system?

• A) Use a large RedShift cluster to perform the analysis, and a fleet of Lambdas to perform record inserts into the RedShift tables. Lambda will scale rapidly enough for the traffic spikes.
• B) Use a CloudFront distribution with access log delivery to S3. Clicks should be recorded as querystring GETs to the distribution. Reports are built and sent by periodically running EMR jobs over the access logs in S3.
• C) Use API Gateway invoking Lambdas which PutRecords into Kinesis, and EMR running Spark performing GetRecords on Kinesis to scale with spikes. Spark on EMR outputs the analysis to S3, which are sent out via email.
• D) Use AWS Elasticsearch service and EC2 Auto Scaling groups. The Autoscaling groups scale based on click throughput and stream into the Elasticsearch domain, which is also scalable. Use Kibana to generate reports periodically.

---

Definitions:

Consolidation

The process of combining two or more entities into a single entity, often to streamline operations and reduce costs.

Business Combination

The merger or acquisition of separate companies into a single enterprise, often to expand market share or leverage synergies.

Lease

A lease is a contractual agreement by which one party conveys property, land, services, or the use of assets to another for a specified time, often in return for a periodic payment.

Corporation's Assets

Corporation's Assets are the resources owned by a corporation, including cash, properties, and intellectual property, among others.