Case-Based Critical Thinking Question

question 20

Multiple Choice

Case-Based Critical Thinking Question
Tyler does not want parts of his website indexed, so he is creating a robots.txt file.
-Tyler uses the code Disallow: /to instruct bots ____.

• A) not to index the entire website
• B) to index the entire website
• C) to index only the main directory
• D) to index the website at their own discretion