Technical SEO
Important
Conflicting Robots Rules
priority_high Why it matters
Conflicting robots.txt rules confuse AI crawlers — they may default to blocking, silently hiding your content.
search What we check
Whether robots.txt has conflicting Allow and Disallow rules for the same AI bot that could cause unpredictable behavior.
build How to fix
- 1 Review robots.txt for bots that have both Allow and Disallow directives.
- 2 Use more specific paths to resolve ambiguity.
- 3 Remember that more specific paths take precedence over general ones.
menu_book Sources
Does your site pass this check?
This is 1 of 98 checks we run. Find out in under 30 seconds.