Robots.txt + Sitemap + Meta Analyzer
Inspect robots.txt, sitemap discovery and head meta of a page.
- slug
- robots-meta-analyzer
- visibility
- Public
- risk
- safe
- level
- 0
What this tool does.
Fetches the root robots.txt of the target site, discovers declared sitemaps, and inspects the canonical, title and robots meta of the page itself.
Built for fast SEO triage of a single URL.
Run this tool.
Submit an input and see the runner output here. Execution is server-side and governed by the policy shown in the sidebar.
Everything runs server-side. Inputs and outputs are subject to the tool's policy shown in the sidebar.
Dev-docs · 2 documents.
Related articles.
Why Robots.txt, Sitemaps and Metadata Still Matter
These files are often overlooked. Here is why they are worth auditing and how they shape discoverability.
Getting Started with Public Surface Analysis
A beginner-friendly walkthrough of what you can responsibly learn from a public URL.
A Responsible Method for Reconnaissance on Public Web Surfaces
Reconnaissance is not inherently malicious. Here is how to do it ethically, legally and systematically.
How to Turn Weak Signals into Better Questions
OSINT is not about finding smoking guns. It is about asking better questions.