Parse robots.txt files and check URL crawl permissions per user-agent.
https://orbisapi.com/proxy/robots-txt-parser-api-a263c4Overview
Parse robots.txt files and check URL crawl permissions per user-agent.
Protocol
x402
Price
—
Payment Asset
USD Coin
Payment Network
Base
Category
uncategorized
Provider
orbisapi
Source
bazaar
Indexed
2026-05-04 16:56:14
Health
Status
degraded
Latency (p50)
48ms
Uptime (30d)
100.0%
Reliability Score
100/100
Last Checked
2026-07-26 18:49:48
Last Healthy
2026-06-08 18:19:40
Consecutive Failures
0
x402 Payment Validation
Payment Requirements
Invalid
Asset Verified
—
Facilitator
—
Recent Health Checks
| Time | Status | HTTP | Latency | Error |
|---|---|---|---|---|
| 2026-07-26 18:49:48 | degraded | 404 | 78ms | |
| 2026-07-26 14:57:51 | degraded | 404 | 14ms | |
| 2026-07-26 12:56:22 | degraded | 404 | 54ms | |
| 2026-07-26 09:00:57 | degraded | 404 | 73ms | |
| 2026-07-26 05:08:22 | degraded | 404 | 57ms | |
| 2026-07-26 01:34:20 | degraded | 404 | 30ms | |
| 2026-07-25 21:53:15 | degraded | 404 | 61ms | |
| 2026-07-25 16:05:58 | degraded | 404 | 82ms | |
| 2026-07-25 12:43:20 | degraded | 404 | 37ms | |
| 2026-07-25 08:57:35 | degraded | 404 | 38ms | |
| 2026-07-25 04:02:20 | degraded | 404 | 71ms | |
| 2026-07-24 23:08:06 | degraded | 404 | 39ms | |
| 2026-07-24 19:21:15 | degraded | 404 | 13ms | |
| 2026-07-24 16:59:03 | degraded | 404 | 41ms | |
| 2026-07-24 11:40:58 | degraded | 404 | 84ms | |
| 2026-07-24 08:30:11 | degraded | 404 | 44ms | |
| 2026-07-24 04:35:55 | degraded | 404 | 52ms | |
| 2026-07-24 00:30:54 | degraded | 404 | 26ms |