← Back to directory

Parse and validate robots.txt files to check crawl rules and permissions

https://orbisapi.com/proxy/robots-txt-parser-api-57c505/:endpoint

Overview

Parse and validate robots.txt files to check crawl rules and permissions

Protocol x402
Price
Payment Asset USD Coin
Payment Network eip155:8453
Category uncategorized
Provider orbisapi
Source bazaar
Indexed 2026-05-21 03:45:53

Health

Status healthy
Latency (p50) 4486ms
Uptime (30d) 100.0%
Reliability Score 75/100
Last Checked 2026-05-23 04:38:56
Last Healthy 2026-05-23 04:38:56
Consecutive Failures 0

x402 Payment Validation

Payment Requirements Valid
Asset Verified Known USDC
Facilitator

Recent Health Checks

Time Status HTTP Latency Error
2026-05-23 04:38:56 healthy 402 712ms
2026-05-22 09:33:44 healthy 402 4486ms
2026-05-22 05:39:09 healthy 402 1141ms
2026-05-21 11:27:26 healthy 402 5958ms