sitemap-urls
Estrattore di URL da sitemap.xml: legge una sitemap o un indice di sitemap (incl. .gz) e fino a 10 sitemap figlie, restituisce gli URL con lastmod/changefreq/priority, filtro opzionale per sottostringa, elenco limitato (fino a 5000).
Endpoint
GET|POST https://forge-tools.dentreprise.workers.dev/api/sitemap-urls
Parametri
| Nome | Obbligatorio | Tipo | Descrizione |
|---|---|---|---|
url | Obbligatorio | string | Sitemap URL or site origin |
limit | Facoltativo | string | 1-5000, default 500 |
max_children | Facoltativo | string | 0-10, default 5 |
contains | Facoltativo | string | Only URLs containing this text |
Esempio di richiesta (non pagata — attendi 402)
curl -sS -D - "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50"
Esempio di challenge 402
Lo stesso oggetto è inviato anche come intestazione PAYMENT-REQUIRED in base64. Gli importi sono unità USDC atomiche (6 decimali).
{
"x402Version": 2,
"error": "Payment required",
"resource": {
"url": "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls",
"description": "sitemap.xml URL extractor: reads a sitemap or sitemap index (incl. .gz) and up to 10 child sitemaps, returns URLs with lastmod/changefreq/priority, optional substring filter, capped list (up to 5000).",
"mimeType": "application/json"
},
"accepts": [
{
"scheme": "exact",
"network": "eip155:8453",
"amount": "2000",
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"payTo": "0x7B8bf45ac6AcbA6D4CFB626b57D3f5fF3C9C89F7",
"maxTimeoutSeconds": 120,
"extra": {
"name": "USD Coin",
"version": "2"
}
}
]
}Riprova con pagamento
curl -sS "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50" \ -H "PAYMENT-SIGNATURE: $PAYMENT"
Esempio di risposta
{
"type": "urlset",
"count": 50,
"urls": [
{
"loc": "https://…",
"lastmod": "2026-01-01"
}
]
}Demo / campione gratuito
Questo tool è sul worker della wave 1. ?demo=1 restituisce un campione o un estratto etichettato con HTTP 200 e senza pagamento. Il body non sono dati live. Anche le prime 3 chiamate reali riuscite per IP e giorno UTC sono gratuite.
curl -sS "https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50&demo=1"
Risposta demo etichettata
{
"demo": true,
"demo_label": "DEMO / SAMPLE — not live data. This is a labelled example response and was not charged.",
"charged": false,
"tool": "/api/sitemap-urls",
"docs": "https://agent-hub.dentreprise.workers.dev/tools/sitemap-urls/",
"how_to_get_live_data": "Call the same URL without demo=1. The first 3 successful real calls per IP per UTC day are free; after that attach an x402 v2 PAYMENT-SIGNATURE (USDC on Base).",
"sample": {
"type": "urlset",
"count": 50,
"urls": [
{
"loc": "https://…",
"lastmod": "2026-01-01"
}
]
}
}JavaScript — @x402/fetch
Client ufficiale x402 v2. Installa @x402/fetch e @x402/evm. Il vecchio nome di pacchetto x402-fetch è la linea v1 deprecata e non va usato per questi endpoint.
import { wrapFetchWithPaymentFromConfig } from "@x402/fetch";
import { ExactEvmScheme } from "@x402/evm";
import { privateKeyToAccount } from "viem/accounts";
// Official x402 v2 client. The older package name "x402-fetch" is the deprecated v1 line.
const account = privateKeyToAccount(process.env.EVM_PRIVATE_KEY);
const fetchWithPayment = wrapFetchWithPaymentFromConfig(fetch, {
schemes: [{ network: "eip155:8453", client: new ExactEvmScheme(account) }],
});
const res = await fetchWithPayment(
"https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50"
);
console.log(await res.json());Python — x402
Pacchetto ufficiale PyPI x402. Usa x402HttpxClient (async) o x402_requests (sync) dopo register_exact_evm_client con EthAccountSigner.
import asyncio
import os
from eth_account import Account
from x402 import x402Client
from x402.http.clients import x402HttpxClient
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
# Official PyPI package: x402
account = Account.from_key(os.environ["EVM_PRIVATE_KEY"])
client = x402Client()
register_exact_evm_client(client, EthAccountSigner(account))
async def main():
async with x402HttpxClient(client) as http:
res = await http.get("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50")
print(res.json())
asyncio.run(main())
# Sync alternative:
# from x402 import x402ClientSync
# from x402.http.clients import x402_requests
# client = x402ClientSync()
# register_exact_evm_client(client, EthAccountSigner(account))
# with x402_requests(client) as session:
# print(session.get("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=50").json())Server MCP — forge-agent-mcp
stdio copre l’intero catalogo (entrambi gli host API). Clona forge-agent-mcp e punta il client MCP a src/server.mjs. Il remote Streamable HTTP ospitato sul gateway originale espone ancora solo i tool di quel gateway.
{
"mcpServers": {
"forge-agent-hub": {
"command": "node",
"args": ["/path/to/forge-agent-mcp/src/server.mjs"]
},
"forge-agent-api": {
"url": "https://x402-gateway.forge-x402.workers.dev/mcp",
"transport": "streamable-http"
}
}
}Wrapper di strumento LangChain
Avvolgi gli stessi client x402 come strumento LangChain con DynamicStructuredTool (@langchain/core) o @tool (langchain_core).
import { DynamicStructuredTool } from "@langchain/core/tools";
import { z } from "zod";
import { wrapFetchWithPaymentFromConfig } from "@x402/fetch";
import { ExactEvmScheme } from "@x402/evm";
import { privateKeyToAccount } from "viem/accounts";
const account = privateKeyToAccount(process.env.EVM_PRIVATE_KEY);
const fetchWithPayment = wrapFetchWithPaymentFromConfig(fetch, {
schemes: [{ network: "eip155:8453", client: new ExactEvmScheme(account) }],
});
export const sitemap_urls = new DynamicStructuredTool({
name: "sitemap_urls",
description: "sitemap.",
schema: z.object({}),
func: async (input) => {
const res = await fetchWithPayment("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls" + "?" + new URLSearchParams(input));
return JSON.stringify(await res.json());
},
});import os
from langchain_core.tools import tool
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
account = Account.from_key(os.environ["EVM_PRIVATE_KEY"])
client = x402ClientSync()
register_exact_evm_client(client, EthAccountSigner(account))
@tool
def sitemap_urls() -> str:
"""sitemap."""
with x402_requests(client) as session:
return session.get("https://forge-tools.dentreprise.workers.dev/api/sitemap-urls").textEndpoint correlati
markdown
Recupera una pagina web pubblica e restituisce Markdown pulito (script, stili e navigazione rimossi) più il titolo.
web-meta
Recupera un URL pubblico e ne restituisce i metadati: titolo, meta description, canonical, lingua, tag OpenGraph e Twitter Card, favicon, feed RSS, h1.
email-check
Controllo di un indirizzo e-mail: sintassi RFC, record MX/A del dominio (segnale di consegnabilità, nessuna sonda SMTP), flag di dominio usa-e-getta e di account di ruolo.
rdap
Dati di registrazione del dominio via RDAP (successore ufficiale di WHOIS): registrar, date di creazione/scadenza/aggiornamento, stato, nameserver, DNSSEC, età in giorni.