# Forbid these: User-agent: AliyunSecBot User-agent: crawler_eb_germany_2.0 User-agent: CCBot User-agent: MJ12bot User-agent: Applebot User-agent: AwarioBot User-agent: YandexBot User-agent: netEstate NE Crawler User-agent: Bytespider User-agent: AhrefsBot User-agent: PetalBot User-agent: DotBot User-agent: DataForSeoBot User-agent: Orbbot User-agent: SemrushBot Disallow: / # All other robots allowed User-agent: * Disallow: # Sitemap files Sitemap: https://the.ravens.reviews/sitemap.txt Sitemap: https://the.ravens.reviews/sitemap.xml