← Back to directory

Check if a URL is allowed to be fetched according to the website's robots.txt fi...

https://www.minifetch.com/api/v1/x402/preflight/url-check

Overview

Check if a URL is allowed to be fetched according to the website's robots.txt file. Use this super-cheap endpoint before using our other paid endpoints to avoid spending extra on un-fetchable URLs

Protocol x402
Price $0.0010
Payment Asset USD Coin
Payment Network Base
Category uncategorized
Provider minifetch
Source bazaar
Indexed 2026-03-02 01:12:24

Health

Status healthy
Latency (p50) 451ms
Uptime (30d) 100.0%
Reliability Score 95/100
Last Checked 2026-03-20 17:12:35
Last Healthy 2026-03-20 17:12:35
Consecutive Failures 0

x402 Payment Validation

Payment Requirements Valid
Asset Verified Known USDC
Facilitator —

Input Schema

{ "discoverable": true, "method": "GET", "queryParams": { "url": { "description": "The URL to check against robots.txt", "required": true, "type": "string" } }, "type": "http" }

Output Schema

{ "properties": { "queryParameters": { "type": "object" }, "results": { "type": "array" }, "success": { "type": "boolean" } }, "type": "object" }

Recent Health Checks

Time Status HTTP Latency Error
2026-03-20 17:12:35 healthy 402 436ms
2026-03-20 16:07:33 healthy 402 441ms
2026-03-20 15:52:21 healthy 402 579ms
2026-03-20 15:23:30 healthy 402 460ms
2026-03-20 14:34:28 healthy 402 451ms
2026-03-20 13:57:04 degraded 402 1000ms
2026-03-20 13:06:27 healthy 402 448ms
2026-03-20 11:36:01 healthy 402 451ms
2026-03-20 10:37:32 healthy 402 457ms
2026-03-20 09:57:27 healthy 402 462ms
2026-03-20 08:53:19 healthy 402 449ms
2026-03-20 08:00:19 healthy 402 491ms
2026-03-20 06:51:59 healthy 402 459ms
2026-03-20 05:49:06 healthy 402 435ms
2026-03-20 04:54:41 healthy 402 440ms
2026-03-20 03:51:08 healthy 402 436ms
2026-03-20 02:49:03 healthy 402 443ms
2026-03-20 01:47:53 healthy 402 727ms
2026-03-20 00:55:30 healthy 402 434ms
2026-03-19 23:49:35 healthy 402 452ms