Google posts draft to formalize Robots Exclusion Protocol Specification
Google announced this morning it has posted a Request for Comments to the Internet Engineering Task Force to formalize the Robots Exclusion Protocol specification after it being an informal 25-year-old standard for the internet. The announcement. Google wrote on its blog: “Together with the original author of the protocol, webmasters, and other search engines, we’ve […]
Google posts draft to formalize Robots Exclusion Protocol Specification Read More »