← Back to directory

Parse robots.txt and check URL crawl permissions

https://orbisapi.com/proxy/robots-txt-parse-api-88a263

Overview

Parse robots.txt and check URL crawl permissions

Protocol x402
Price
Payment Asset USD Coin
Payment Network eip155:8453
Category uncategorized
Provider orbisapi
Source bazaar
Indexed 2026-05-22 19:57:46

Health

Status healthy
Latency (p50) 2117ms
Uptime (30d) 75.0%
Reliability Score 62.5/100
Last Checked 2026-05-24 13:47:11
Last Healthy 2026-05-24 13:47:11
Consecutive Failures 0

x402 Payment Validation

Payment Requirements Valid
Asset Verified Known USDC
Facilitator

Recent Health Checks

Time Status HTTP Latency Error
2026-05-24 13:47:11 healthy 402 2117ms
2026-05-24 06:13:08 healthy 402 5393ms
2026-05-23 17:40:47 healthy 402 431ms
2026-05-22 21:32:30 timeout timeout