Disallow
October 26, 2018
An Email Marketing Glossary Entry

What is Disallow?

Disallow is a rule used in robots.txt files to determine what parts of the website search engines’ bots should not crawl. This is often used to maximise the crawl budget and prevent from duplicate content issues. When using it, make sure you’re not blocking any page rendering resources, such as CSS or JavaScript. If you’re unsure whether your rules will block those resources, use robots.txt tester in Google Search Console.

The Mailman

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram