← Back to directory

Check if a URL is allowed to be fetched according to the website's robots.txt fi...

https://www.minifetch.com/api/v1/x402/preflight/url-check

Overview

Check if a URL is allowed to be fetched according to the website's robots.txt file. Use this super-cheap endpoint before using our other paid endpoints to avoid spending extra on un-fetchable URLs

Protocol x402
Price $0.0010
Payment Asset USD Coin
Payment Network Base
Category uncategorized
Provider minifetch
Source bazaar
Indexed 2026-03-02 01:12:24

Health

Status healthy
Latency (p50) 430ms
Uptime (30d) 100.0%
Reliability Score 95/100
Last Checked 2026-07-24 11:58:05
Last Healthy 2026-07-24 11:58:05
Consecutive Failures 0

x402 Payment Validation

Payment Requirements Valid
Asset Verified Known USDC
Facilitator

Input Schema

{ "discoverable": true, "method": "GET", "queryParams": { "url": { "description": "The URL to check against robots.txt", "required": true, "type": "string" } }, "type": "http" }

Output Schema

{ "properties": { "queryParameters": { "type": "object" }, "results": { "type": "array" }, "success": { "type": "boolean" } }, "type": "object" }

Recent Health Checks

Time Status HTTP Latency Error
2026-07-24 11:58:05 healthy 402 427ms
2026-07-24 10:19:50 healthy 402 429ms
2026-07-24 06:31:48 healthy 402 426ms
2026-07-24 01:57:16 healthy 402 429ms
2026-07-23 21:27:00 healthy 402 430ms
2026-07-23 16:27:37 healthy 402 477ms
2026-07-23 11:50:23 healthy 402 486ms
2026-07-23 05:46:44 healthy 402 491ms
2026-07-23 01:51:35 healthy 402 426ms
2026-07-22 22:14:49 healthy 402 446ms
2026-07-22 20:20:31 healthy 402 440ms
2026-07-22 18:24:24 healthy 402 474ms
2026-07-22 00:01:08 healthy 402 429ms
2026-07-21 18:43:31 healthy 402 436ms