[ad_1]
Google has up to date its open supply robots.txt parser code on GitHub the opposite day. Gary Illyes from Google pushed the replace yesterday morning to the repository there. Google initially launched the parser to the world again in 2019.
Gary Illyes defined on LinkedIn that this up to date parser has been being utilized by Google for some time now, however now Google has launched that replace to GitHub.
Gary wrote, “The discharge introduces new capabilities within the parser class that permits you to export parsing details about the handed in robotstxt physique, and provides a brand new library to entry that data. This new library has been utilized by Google Search Console for a lot of moons now (along with the Java port) and to date we’ve not encountered points with it; for those who do, file a problem on GitHub!”
When Google initially launched this parser, Google wrote they “open sourced the C++ library that our manufacturing programs use for parsing and matching guidelines in robots.txt recordsdata. This library has been round for 20 years and it incorporates items of code that had been written within the 90’s. Since then, the library developed; we discovered so much about how site owners write robots.txt recordsdata and nook instances that we needed to cowl for, and added what we discovered over time additionally to the web draft when it made sense.”
Discussion board dialogue at LinkedIn.
[ad_2]
Source link
