#Google updates crawlers and user-triggered fetchers documentation
With that, Google expanded how Google products are affected by each crawler and gave robots.txt examples for each crawler. Google made a series of updates to its crawlers and user-triggered fetchers documentation, mostly breaking out the single-page document into multiple pages and documents. But Google also expanded what product each crawler affects with a new…