Parse robots.txt files and check URL crawl permissions per user-agent.
https://orbisapi.com/proxy/robots-txt-parser-api-a263c4/openapiOverview
Parse robots.txt files and check URL crawl permissions per user-agent.
Protocol
x402
Price
—
Payment Asset
USD Coin
Payment Network
Base
Category
uncategorized
Provider
orbisapi
Source
bazaar
Indexed
2026-04-27 08:52:48
Health
Status
degraded
Latency (p50)
49ms
Uptime (30d)
100.0%
Reliability Score
100/100
Last Checked
2026-08-09 14:48:50
Last Healthy
2026-05-30 12:32:04
Consecutive Failures
0
x402 Payment Validation
Payment Requirements
Invalid
Asset Verified
—
Facilitator
—
Recent Health Checks
| Time | Status | HTTP | Latency | Error |
|---|---|---|---|---|
| 2026-08-09 14:48:50 | degraded | 404 | 53ms | |
| 2026-08-09 11:17:20 | degraded | 404 | 58ms | |
| 2026-08-09 07:06:28 | degraded | 404 | 50ms | |
| 2026-08-08 23:50:10 | degraded | 404 | 701ms | |
| 2026-08-08 19:25:31 | degraded | 404 | 18ms | |
| 2026-08-08 13:49:11 | degraded | 404 | 85ms | |
| 2026-08-08 10:39:10 | degraded | 404 | 16ms | |
| 2026-08-08 06:35:31 | degraded | 404 | 33ms | |
| 2026-08-08 02:32:11 | degraded | 404 | 25ms | |
| 2026-08-07 21:28:39 | degraded | 404 | 768ms | |
| 2026-08-07 15:42:41 | degraded | 404 | 57ms | |
| 2026-08-07 11:29:18 | degraded | 404 | 18ms | |
| 2026-08-07 03:19:47 | degraded | 404 | 49ms | |
| 2026-08-06 23:43:25 | degraded | 404 | 30ms | |
| 2026-08-06 17:06:41 | degraded | 404 | 14ms |