Start a crawl

Enter a root URL. The crawler runs on this server (not in your browser), follows same-domain links, and respects robots.txt.

Free website sitemap crawler

Sitemap Crawler is a free website mapping and SEO data tool that discovers pages within a domain and organizes them into a clear site structure. It generates three useful outputs: a complete page list, an SEO data report, and an interactive visual sitemap.

The page list includes page names, URLs, parent URLs, levels, and HTTP status, and can be exported to Excel. The SEO data export includes the current meta title, title length, meta description, description length, meta robots directives, canonical URL, canonical status, primary H1 heading, and HTTP status for each discovered page.

One of the key features of Sitemap Crawler is its interactive visual sitemap. The website is automatically represented on a navigable canvas, making its structure, hierarchy, and information architecture easy to understand. You can explore the map, zoom in and out, download it as SVG, or copy it directly to Figma as editable vector shapes.

How it works

  1. Enter the root URL of the website you want to map. You can optionally adjust the maximum crawl depth and number of pages.
  2. The crawler follows links within the same domain, respects robots.txt, and skips external domains, social links, duplicate URLs, and tracking parameters.
  3. Each discovered page is added to the page list. The page name is taken from its <title> tag, falling back to its first <h1> when no title is available.
  4. The crawler collects essential SEO data from each page, including its current meta title, meta description, meta robots directives, canonical URL, and primary H1 heading.
  5. The page hierarchy is reconstructed from the URL path. For example, /aboutus/history is mapped as a child of /aboutus, regardless of which page linked to it.
  6. Once the crawl is complete, you can export the page list and SEO data to Excel, explore the interactive visual sitemap, download it as SVG, or copy it directly to Figma.

SEO data export

Sitemap Crawler collects essential on-page SEO data from every discovered page and organizes it into a structured Excel report. Review meta titles, title lengths, meta descriptions, description lengths, canonical URLs, canonical status, meta robots directives, H1 headings, and HTTP status codes to identify SEO issues and opportunities across your website.

The report reflects the current values found in each page's HTML at the time of the crawl, making it useful for SEO audits, content audits, website migrations, and ongoing on-page SEO analysis.

Visual sitemap and Figma export

Turn your crawled website structure into an interactive visual sitemap. Explore the page hierarchy on the canvas, zoom and navigate through the site structure, then download the sitemap as SVG or copy it directly to Figma as editable vector shapes.

Use the visual sitemap to understand information architecture, plan website redesigns, organize content, and communicate the existing structure of a website without having to build the sitemap manually.

What can you use Sitemap Crawler for?

Website mapper vs. XML sitemap generator

Sitemap Crawler is designed to map and analyze the existing structure of a website. It does not generate an XML sitemap file for search engines.

Instead, it helps designers, developers, SEO professionals, and website owners discover a site's pages, understand its hierarchy, review essential on-page SEO data, and create a visual representation of its information architecture.

This makes it useful before a website redesign, content audit, SEO audit, website migration, or information architecture project.

Limitations

The crawler reads the HTML returned by the server but does not execute JavaScript. Websites that rely heavily on client-side rendering may therefore appear incomplete. Pages behind a login cannot be crawled, and very large websites may require a higher page limit or multiple crawl runs.

The SEO report reflects the HTML returned by each page at the time of the crawl. It reports the current values found in the page source; it does not evaluate whether a title, description, H1, canonical, or robots directive is optimal for SEO.

The Figma export uses Figma's built-in SVG paste functionality and does not require a plugin. Shapes and connector lines are imported as editable vectors. Due to how Figma handles pasted SVG content, text labels are usually imported as outlined vector shapes rather than editable text layers.