← Back to directory

Check if a URL is allowed to be fetched according to the website's robots.txt fi...

https://www.minifetch.com/api/v1/x402/preflight/url-check

Overview

Check if a URL is allowed to be fetched according to the website's robots.txt file. Use this super-cheap endpoint before using our other paid endpoints to avoid spending extra on un-fetchable URLs

Protocol x402
Price $0.0010
Payment Asset USD Coin
Payment Network Base
Category uncategorized
Provider minifetch
Source bazaar
Indexed 2026-03-02 01:12:24

Health

Status healthy
Latency (p50) 434ms
Uptime (30d) 100.0%
Reliability Score 95/100
Last Checked 2026-09-15 01:26:18
Last Healthy 2026-09-15 01:26:18
Consecutive Failures 0

x402 Payment Validation

Payment Requirements Valid
Asset Verified Known USDC
Facilitator

Input Schema

{ "discoverable": true, "method": "GET", "queryParams": { "url": { "description": "The URL to check against robots.txt", "required": true, "type": "string" } }, "type": "http" }

Output Schema

{ "properties": { "queryParameters": { "type": "object" }, "results": { "type": "array" }, "success": { "type": "boolean" } }, "type": "object" }

Recent Health Checks

Time Status HTTP Latency Error
2026-09-15 01:26:18 healthy 402 434ms
2026-09-14 12:55:49 healthy 402 427ms
2026-09-14 02:41:51 healthy 402 455ms
2026-09-13 18:14:37 healthy 402 427ms
2026-09-13 11:58:01 healthy 402 444ms
2026-09-13 02:32:32 healthy 402 489ms
2026-09-12 12:18:09 healthy 402 432ms