You Work on a Regression Problem in a Natural Language

question 56

Multiple Choice

You work on a regression problem in a natural language processing domain, and you have 100M labeled exmaples in your dataset. You have randomly shuffled your data and split your dataset into train and test samples (in a 90/10 ratio) . After you trained the neural network and evaluated your model on a test set, you discover that the root-mean-squared error (RMSE) of your model is twice as high on the train set as on the test set. How should you improve the performance of your model?

• A) Increase the share of the test sample in the train-test split.
• B) Try to collect more data and increase the size of your dataset.
• C) Try out regularization techniques (e.g., dropout of batch normalization) to avoid overfitting.
• D) Increase the complexity of your model by, e,g., introducing an additional layer or increase sizing the size of vocabularies or n-grams used.

---

Definitions:

Decisions Made

Refers to the conclusions or judgments reached after consideration, leading to actions taken or strategies implemented.

Operating Effectiveness

The efficiency with which an organization can achieve its objectives through the optimal use of resources.

Constructive Changes

Alterations in work scope or methodology that are suggested or required but not initially outlined in a contract.

Analyze Data

The process of examining datasets to draw conclusions, identify patterns, or make decisions based on the information contained within.