FALKEN'S MAZE / CHECKS / ROBOTS.TXT

robots.txt

What Joshua checks

Reads robots.txt for Disallow lines that point to backups, staging copies, admin panels or config files.

Why it matters

robots.txt is public and attackers read it first: a path listed to keep search engines out tells everyone where to look.

How to fix it

Put those paths behind a login or an IP allowlist, or remove them from the server, then take them out of robots.txt: it doesn't hide anything.

In the Maze Score

Worth

2 points (half for a warning)

Severity

Info

Runs on

Every scan, including the free report card

Related checks

• Server version leakagePro (Watchtower)
• security.txtFree
• PHP versionPro (Watchtower)