sitemap-urls
Extractor de URL de sitemap.xml: lee un sitemap o un índice de sitemaps (incl. .gz) y hasta 10 sitemaps hijos, devuelve las URL con lastmod/changefreq/priority, filtro opcional de subcadena, lista limitada (hasta 5000).
Endpoint
GET|POST https://forge-tools.dentreprise.workers.dev/api/sitemap-urls
Parámetros
| Nombre | Obligatorio | Tipo | Descripción |
|---|---|---|---|
url | Obligatorio | string | Sitemap URL or site origin |
limit | Opcional | string | 1-5000, default 500 |
max_children | Opcional | string | 0-10, default 5 |
contains | Opcional | string | Only URLs containing this text |
Ejemplo de petición (sin pagar — se espera 402)
curl -sS -D - "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50"
Ejemplo de desafío 402
El mismo objeto se envía también como cabecera PAYMENT-REQUIRED en base64. Las cantidades son unidades atómicas de USDC (6 decimales).
{
"x402Version": 2,
"error": "Payment required",
"resource": {
"url": "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls",
"description": "sitemap.xml URL extractor: reads a sitemap or sitemap index (incl. .gz) and up to 10 child sitemaps, returns URLs with lastmod/changefreq/priority, optional substring filter, capped list (up to 5000).",
"mimeType": "application/json"
},
"accepts": [
{
"scheme": "exact",
"network": "eip155:8453",
"amount": "2000",
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"payTo": "0x7B8bf45ac6AcbA6D4CFB626b57D3f5fF3C9C89F7",
"maxTimeoutSeconds": 120,
"extra": {
"name": "USD Coin",
"version": "2"
}
}
]
}Reintentar con pago
curl -sS "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50" \ -H "PAYMENT-SIGNATURE: $PAYMENT"
Ejemplo de respuesta
{
"type": "urlset",
"count": 50,
"urls": [
{
"loc": "https://…",
"lastmod": "2026-01-01"
}
]
}Demo / muestra gratuita
Esta herramienta está en el worker de la oleada 1. ?demo=1 devuelve una muestra o un extracto etiquetado con HTTP 200 y sin pago. El cuerpo no son datos en vivo. Las 3 primeras llamadas reales con éxito por IP y día UTC también son gratuitas.
curl -sS "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50&demo=1"
Respuesta de demo etiquetada
{
"demo": true,
"demo_label": "DEMO / SAMPLE — not live data. This is a labelled example response and was not charged.",
"charged": false,
"tool": "/api/sitemap-urls",
"docs": "https://agent-hub.dentreprise.workers.dev/tools/sitemap-urls/",
"how_to_get_live_data": "Call the same URL without demo=1. The first 3 successful real calls per IP per UTC day are free; after that attach an x402 v2 PAYMENT-SIGNATURE (USDC on Base).",
"sample": {
"type": "urlset",
"count": 50,
"urls": [
{
"loc": "https://…",
"lastmod": "2026-01-01"
}
]
}
}JavaScript — @x402/fetch
Cliente oficial x402 v2. Instale @x402/fetch y @x402/evm. El nombre de paquete antiguo x402-fetch es la línea v1 obsoleta y no debe usarse con estos endpoints.
import { wrapFetchWithPaymentFromConfig } from "@x402/fetch";
import { ExactEvmScheme } from "@x402/evm";
import { privateKeyToAccount } from "viem/accounts";
// Official x402 v2 client. The older package name "x402-fetch" is the deprecated v1 line.
const account = privateKeyToAccount(process.env.EVM_PRIVATE_KEY);
const fetchWithPayment = wrapFetchWithPaymentFromConfig(fetch, {
schemes: [{ network: "eip155:8453", client: new ExactEvmScheme(account) }],
});
const res = await fetchWithPayment(
"https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50"
);
console.log(await res.json());Python — x402
Paquete oficial de PyPI x402. Use x402HttpxClient (async) o x402_requests (sync) tras register_exact_evm_client con EthAccountSigner.
import asyncio
import os
from eth_account import Account
from x402 import x402Client
from x402.http.clients import x402HttpxClient
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
# Official PyPI package: x402
account = Account.from_key(os.environ["EVM_PRIVATE_KEY"])
client = x402Client()
register_exact_evm_client(client, EthAccountSigner(account))
async def main():
async with x402HttpxClient(client) as http:
res = await http.get("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50")
print(res.json())
asyncio.run(main())
# Sync alternative:
# from x402 import x402ClientSync
# from x402.http.clients import x402_requests
# client = x402ClientSync()
# register_exact_evm_client(client, EthAccountSigner(account))
# with x402_requests(client) as session:
# print(session.get("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50").json())Servidor MCP — forge-agent-mcp
stdio cubre el catálogo completo (ambos hosts de API). Clone forge-agent-mcp y apunte su cliente MCP a src/server.mjs. El remoto Streamable HTTP alojado en la pasarela original sigue exponiendo solo las herramientas de esa pasarela.
{
"mcpServers": {
"forge-agent-hub": {
"command": "node",
"args": ["/path/to/forge-agent-mcp/src/server.mjs"]
},
"forge-agent-api": {
"url": "https://x402-gateway.forge-x402.workers.dev/mcp",
"transport": "streamable-http"
}
}
}Contenedor de herramienta LangChain
Envuelva los mismos clientes x402 como herramienta LangChain con DynamicStructuredTool (@langchain/core) o @tool (langchain_core).
import { DynamicStructuredTool } from "@langchain/core/tools";
import { z } from "zod";
import { wrapFetchWithPaymentFromConfig } from "@x402/fetch";
import { ExactEvmScheme } from "@x402/evm";
import { privateKeyToAccount } from "viem/accounts";
const account = privateKeyToAccount(process.env.EVM_PRIVATE_KEY);
const fetchWithPayment = wrapFetchWithPaymentFromConfig(fetch, {
schemes: [{ network: "eip155:8453", client: new ExactEvmScheme(account) }],
});
export const sitemap_urls = new DynamicStructuredTool({
name: "sitemap_urls",
description: "sitemap.",
schema: z.object({}),
func: async (input) => {
const res = await fetchWithPayment("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls" + "?" + new URLSearchParams(input));
return JSON.stringify(await res.json());
},
});import os
from langchain_core.tools import tool
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
account = Account.from_key(os.environ["EVM_PRIVATE_KEY"])
client = x402ClientSync()
register_exact_evm_client(client, EthAccountSigner(account))
@tool
def sitemap_urls() -> str:
"""sitemap."""
with x402_requests(client) as session:
return session.get("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls").textEndpoints relacionados
markdown
Obtiene una página web pública y devuelve Markdown limpio (sin scripts, estilos ni navegación) más el título.
web-meta
Obtiene una URL pública y devuelve sus metadatos: título, meta description, canonical, idioma, etiquetas OpenGraph y Twitter Card, favicon, feeds RSS, h1.
email-check
Comprobación de dirección de correo: sintaxis RFC, registros MX/A del dominio (señal de entregabilidad, sin sonda SMTP), indicadores de dominio desechable y de cuenta de rol.
rdap
Datos de registro de dominio vía RDAP (sucesor oficial de WHOIS): registrador, fechas de creación/caducidad/actualización, estado, servidores de nombres, DNSSEC, antigüedad en días.