User-agent: Yandex Allow: /newstoyandex.xml Allow: /rss/zen User-Agent: trendictionbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Getintent Crawler Disallow: / User-agent: * Disallow: /entry-hit* Disallow: /search/ Disallow: /comment/group Disallow: /go-to-comment/ Disallow: /profile$ Disallow: /*?preview=print Disallow: /entry/166301 Disallow: /selected/entry/143252 Disallow: /community?* Disallow: /login2?* Host: https://snob.ru #Crawl-delay: 5 Sitemap: https://snob.ru/sitemap.xml