# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a content-signal = yes, you may collect content for the corresponding # use. # (b) If a content-signal = no, you may not collect content for the # corresponding use. # (c) If the website operator does not include a content signal for a # corresponding use, the website operator neither grants nor restricts # permission via content signal with respect to the corresponding use. # The content signals and their meanings are: # search: building a search index and providing search results (e.g., returning # hyperlinks and short excerpts from your website's contents). Search does not # include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval # augmented generation, grounding, or other real-time taking of content for # generative AI search answers). # ai-train: training or fine-tuning AI models. # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF # RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT # AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET. # BEGIN Cloudflare Managed content User-Agent: * Content-signal: search=yes,ai-train=no Allow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: / # END Cloudflare Managed Content User-agent: * Crawl-delay: 15 Disallow: /CVS Disallow: /*.Svn$ Disallow: /*.Idea$ Disallow: /*.Sql$ Disallow: /*.Tgz$ Disallow: /*.Git$ Disallow: /cbb Disallow: /admin/ Disallow: /admin123 Disallow: /admin123_live Disallow: /app/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /shell/ Disallow: /var/ Disallow: /api.php Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /get.php Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /README.txt Disallow: /RELEASE_NOTES.txt Disallow: /admin Disallow: /*?Dir* Disallow: /*?Dir=desc* Disallow: /*?Dir=asc* Disallow: /*?dir* Disallow: /*?dir=desc* Disallow: /*?dir=asc* Disallow: /*&dir=asc* Disallow: /*&dir=desc* Disallow: /*?SID=* Disallow: /*?___SID=* Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /catalogsearch/ Disallow: /catalog/category/view/ Disallow: /catalog/product/upload/ Disallow: /catalog/product/view/ Disallow: /cgi-bin/ Disallow: /cleanup.php Disallow: /apc.php Disallow: /phpinfo.php Disallow: */index.php/operators/operator/details/ids/* Disallow: */directory/currency/switch/* Disallow: /*&aw_layerednavigation=* Disallow: /review-confirm Disallow: /custom/catalog_layer/?ajax=true Disallow: /write-a-review/?operator Disallow: *?gclid= Disallow: *?cat_id= Disallow: */wishlist/index/add/product/* Disallow: /reserve/reserve/index/ User-agent: GoogleBot Allow: *?*= Disallow: /CVS Disallow: /*.Svn$ Disallow: /*.Idea$ Disallow: /*.Sql$ Disallow: /*.Tgz$ Disallow: /*.Git$ Disallow: /cbb Disallow: /admin/ Disallow: /admin123 Disallow: /admin123_live Disallow: /app/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /shell/ Disallow: /var/ Disallow: /api.php Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /get.php Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /README.txt Disallow: /RELEASE_NOTES.txt Disallow: /admin Disallow: /*?Dir* Disallow: /*?Dir=desc* Disallow: /*?Dir=asc* Disallow: /*?dir* Disallow: /*?dir=desc* Disallow: /*?dir=asc* Disallow: /*&dir=asc* Disallow: /*&dir=desc* Disallow: /*?SID=* Disallow: /*?___SID=* Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /catalogsearch/ Disallow: /catalog/category/view/ Disallow: /catalog/product/upload/ Disallow: /catalog/product/view/ Disallow: /cgi-bin/ Disallow: /cleanup.php Disallow: /apc.php Disallow: /phpinfo.php Disallow: */index.php/operators/operator/details/ids/* Disallow: */directory/currency/switch/* Disallow: /*&aw_layerednavigation=* Disallow: /review-confirm Disallow: /custom/catalog_layer/?ajax=true Disallow: /write-a-review/?operator Disallow: *?gclid= Disallow: *?cat_id= Disallow: */wishlist/index/add/product/* Disallow: /reserve/reserve/index/ User-agent: Bingbot Crawl-delay: 5 Allow: *?*= Disallow: *?*&*&*&* Disallow: *?*=*,* Disallow: /CVS Disallow: /*.Svn$ Disallow: /*.Idea$ Disallow: /*.Sql$ Disallow: /*.Tgz$ Disallow: /*.Git$ Disallow: /cbb Disallow: /admin/ Disallow: /admin123 Disallow: /admin123_live Disallow: /app/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /shell/ Disallow: /var/ Disallow: /api.php Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /get.php Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /README.txt Disallow: /RELEASE_NOTES.txt Disallow: /admin Disallow: /*?Dir* Disallow: /*?Dir=desc* Disallow: /*?Dir=asc* Disallow: /*?dir* Disallow: /*?dir=desc* Disallow: /*?dir=asc* Disallow: /*&dir=asc* Disallow: /*&dir=desc* Disallow: /*?SID=* Disallow: /*?___SID=* Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /catalogsearch/ Disallow: /catalog/category/view/ Disallow: /catalog/product/upload/ Disallow: /catalog/product/view/ Disallow: /cgi-bin/ Disallow: /cleanup.php Disallow: /apc.php Disallow: /phpinfo.php Disallow: */index.php/operators/operator/details/ids/* Disallow: */directory/currency/switch/* Disallow: /*&aw_layerednavigation=* Disallow: /review-confirm Disallow: /custom/catalog_layer/?ajax=true Disallow: /write-a-review/?operator Disallow: *?gclid= Disallow: *?cat_id= Disallow: */wishlist/index/add/product/* Disallow: /reserve/reserve/index/ #Baiduspider China and Japan User-agent: Baiduspider Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: Baiduspider/2.0;+http://www.baidu.com/search/spider.html Disallow: / User-agent: Baiduspider/2.0 Disallow: / User-agent: +Baiduspider Disallow: / User-agent: +Baiduspider/2.0 Disallow: / User-agent: +Baiduspider/2.0;++http://www.baidu.com/search/spider.html Disallow: / User-agent: Mozilla/5.0(compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) Disallow: / #Yandex User-agent: Yandex Disallow: / ##Sitemap: URL to your sitemap file in Magento Sitemap: https://www.travelstride.com/sitemap/sitemapindex.xml