← Back to directory

Parse robots.txt files and check URL crawl permissions per user-agent.

https://orbisapi.com/proxy/robots-txt-parser-api-a263c4/openapi

Overview

Parse robots.txt files and check URL crawl permissions per user-agent.

Protocol x402
Price
Payment Asset USD Coin
Payment Network eip155:8453
Category uncategorized
Provider orbisapi
Source bazaar
Indexed 2026-04-27 08:52:48

Health

Status degraded
Latency (p50) 141ms
Uptime (30d) 100.0%
Reliability Score 100/100
Last Checked 2026-06-25 08:22:46
Last Healthy 2026-05-30 12:32:04
Consecutive Failures 0

x402 Payment Validation

Payment Requirements Invalid
Asset Verified
Facilitator

Recent Health Checks

Time Status HTTP Latency Error
2026-06-25 08:22:46 degraded 404 132ms
2026-06-25 06:16:48 degraded 404 141ms
2026-06-24 07:41:34 degraded 404 152ms
2026-06-24 02:55:29 degraded 404 127ms
2026-06-22 12:00:21 degraded 404 168ms