Does Google still support the robots.txt noindex directive?
No, back in September 2019 Google stopped supporting the unofficial robots.txt noindex directive.
While its use should have always been a last resort, the directive is completely useless now.
What about other search engines you ask, like Bing for instance? They've never supported the unofficial noindex directive .
Audit your robots.txt and find out so you can correctly noindex content!
So what's the best way to noindex pages?
The best way to noindex pages is to use the meta robots tag or X-Robots-Tag.
Read the full Academy article to learn everything about Robots.txt for SEO: The Ultimate Guide
Share Article Details
About the authors
Steven van Vessum
Steven is Conductor's Director of Organic Marketing. This means he's involved in everything SEO, Content Marketing and Community related. Right where he wants to be. He gets a huge kick out of letting websites rank and loves to talk SEO, Content Marketing and Growth.
