Google Updates Robots.txt Policy: Unsupported Fields Are Ignored via @sejournal, @MattGSouthern
Google limits robots.txt support to four fields, clarifying its stance on unsupported directives.
The post Google Updates Robots.txt Policy: Unsupported Fields Are Ignored appeared first on Search Engine Journal.
from Search Engine Journal https://www.searchenginejournal.com/google-updates-robots-txt-policy-unsupported-fields-are-ignored/529400/
via Yo SEO Tools