User-agent: * Disallow: /jump* Disallow: /jump/* Disallow: /search?* Disallow: /affiliate_shops/* Disallow: /news/search/* Disallow: /?s* Disallow: /search/* Disallow: /pix/items/new?* User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Yandex Disallow: / User-agent: baiduspider Disallow: / User-agent: SemrushBot Disallow: / User-agent: MauiBot Disallow: / User-agent: bingbot Crawl-Delay: 5 # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-agent: * # Disallow: /