Website Mapper

List a site's URLs and choose the pages you need for a crawl or content review before fetching them.

  • 7 settings
  • REST API + MCP
  • Billed per run
  • Checked

1Your request

Use the AI/ML API MCP Website Mapper tool. Find the page links on this website that I should review for a content audit.

2What the tool takes7 settings · 1 required

URLLimitSearchSitemapLocationInclude subdomainsIgnore query parameters
Source: Settings come from the tool's live input schema, checked on 17 Nov 2026. Your assistant fills them from your request.

What is Website Mapper?

Discover a website’s page links before deciding which parts deserve a closer look. The list can help you find documentation, product sections or other pages to include in a content review.

Choose the relevant links for the next step instead of collecting every page body. Use Page Reader for the text of the pages you select.

Settings Website Mapper takes

You describe the task in plain words and your AI assistant fills these in. In code you pass them yourself.

SettingWhat it controlsTip
URLURLRequired
LimitLimitOptional · 1 to 5000
SearchFilter returned URLs by this term.Optional · up to 200 characters
Sitemap'include' (default) combines the sitemap with link discovery; 'only' trusts the sitemap alone; 'skip' ignores it.Optional · one of skip, include, only
LocationLocationOptional
Include subdomainsInclude subdomainsOptional
Ignore query parametersIgnore query parametersOptional

How to use Website Mapper with your AI assistant

  1. Connect AI/ML API

    Click Try it now, pick your client and add the MCP server. You sign in with your AI/ML API account once.

  2. Describe the task

    Say what you need in one sentence, including the url.

  3. Get the result

    Your assistant runs Website Mapper and shows what came back.

  4. Keep going in the chat

    Ask it to filter, compare or summarize the result, or to save it as a table.

Ways to use it

  • Find documentation pages before reviewing a product.

Website Mapper in your code

In your AI assistant

MCP · sign in once with your AI/ML API account

MCP setup guide ↗

In your code

Backend, script or scheduled job

REST · your AI/ML API key, JSON records back

The same tool runs over REST with your AI/ML API key, so a backend, a script or a scheduled job can call Website Mapper directly. Start with the Toolbox REST quickstart.

Pricing

Pay as you goBilled per run from your AI/ML API balance

  • No subscription
  • No seat fee
  • One balance for every tool

Each run is billed from your AI/ML API balance, with no subscription or seat fee. Check the current price in your dashboard before large runs.

See pricing

FAQ

Will I receive the page text?

This task discovers links. Read the selected pages separately when you need their content.

Do I need a separate account for Website Mapper?

No. It runs on your AI/ML API account and balance, from your AI assistant over MCP or from your code over REST.

Which AI assistants can use it?

Claude, ChatGPT, Cursor, Hermes, OpenClaw and other MCP clients. Add the AI/ML API MCP server once with the MCP quickstart.

Run Website Mapper from your assistant

Connect once, then ask for it in plain words.