Detail
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a text file with instructions for search engine crawlers. This file can expose something sensitive such as the path of an administration panel.
Solution Advice
Ensure you have nothing sensitive exposed within Robots.txt file.
Get AI-powered remediation steps tailored to your asset.
Try AI Solutions →