sitemap-urls
sitemap.xml URL extractor: reads a sitemap or sitemap index (incl. .gz) and up to 10 child sitemaps, returns URLs with lastmod/changefreq/priority, optional substring filter, capped list (up to 5000).
Endpoint
GET|POST https://forge-tools.dentreprise.workers.dev/api/sitemap-urls
Parameters
| Name | Required | Type | Description |
|---|---|---|---|
url | Required | string | Sitemap URL or site origin |
limit | Optional | string | 1-5000, default 500 |
max_children | Optional | string | 0-10, default 5 |
contains | Optional | string | Only URLs containing this text |
Example request (unpaid — expect 402)
curl -sS -D - "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50"
Example 402 challenge
The same object is also sent as a base64 PAYMENT-REQUIRED header. Amounts are atomic USDC units (6 decimals).
{
"x402Version": 2,
"error": "Payment required",
"resource": {
"url": "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls",
"description": "sitemap.xml URL extractor: reads a sitemap or sitemap index (incl. .gz) and up to 10 child sitemaps, returns URLs with lastmod/changefreq/priority, optional substring filter, capped list (up to 5000).",
"mimeType": "application/json"
},
"accepts": [
{
"scheme": "exact",
"network": "eip155:8453",
"amount": "2000",
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"payTo": "0x7B8bf45ac6AcbA6D4CFB626b57D3f5fF3C9C89F7",
"maxTimeoutSeconds": 120,
"extra": {
"name": "USD Coin",
"version": "2"
}
}
]
}Retry with payment
curl -sS "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50" \ -H "PAYMENT-SIGNATURE: $PAYMENT"
Example response
{
"type": "urlset",
"count": 50,
"urls": [
{
"loc": "https://…",
"lastmod": "2026-01-01"
}
]
}Related endpoints
markdown
Fetch a public web page and return clean Markdown (scripts/styles/nav stripped) plus title.
web-meta
Fetch a public URL and return its metadata: title, meta description, canonical, language, OpenGraph and Twitter card tags, favicon, RSS feeds, h1s.
email-check
Email address check: RFC syntax, domain MX/A records (deliverability signal, no SMTP probe), disposable-domain and role-account flags.
rdap
Domain registration data via RDAP (the official WHOIS successor): registrar, creation/expiry/update dates, status, nameservers, DNSSEC, age in days.