Parse robots.txt and check URL crawl permissions
https://orbisapi.com/proxy/robots-txt-parse-api-88a263Overview
Parse robots.txt and check URL crawl permissions
Protocol
x402
Price
—
Payment Asset
USD Coin
Payment Network
Base
Category
uncategorized
Provider
orbisapi
Source
bazaar
Indexed
2026-05-22 19:57:46
Health
Status
degraded
Latency (p50)
26ms
Uptime (30d)
100.0%
Reliability Score
100/100
Last Checked
2026-07-24 04:06:02
Last Healthy
2026-06-08 13:13:34
Consecutive Failures
0
x402 Payment Validation
Payment Requirements
Invalid
Asset Verified
—
Facilitator
—
Recent Health Checks
| Time | Status | HTTP | Latency | Error |
|---|---|---|---|---|
| 2026-07-24 04:06:02 | degraded | 404 | 98ms | |
| 2026-07-23 23:39:37 | degraded | 404 | 15ms | |
| 2026-07-23 19:44:28 | degraded | 404 | 26ms | |
| 2026-07-23 16:10:13 | degraded | 404 | 24ms | |
| 2026-07-23 09:14:19 | degraded | 404 | 82ms | |
| 2026-07-23 05:11:18 | degraded | 404 | 63ms | |
| 2026-07-23 03:28:00 | degraded | 404 | 57ms | |
| 2026-07-23 00:33:15 | degraded | 404 | 38ms | |
| 2026-07-22 20:29:51 | degraded | 404 | 20ms | |
| 2026-07-22 17:10:10 | degraded | 404 | 19ms | |
| 2026-07-22 02:32:27 | degraded | 404 | 13ms | |
| 2026-07-22 00:01:29 | degraded | 404 | 79ms | |
| 2026-07-21 19:28:21 | degraded | 404 | 21ms | |
| 2026-07-21 12:22:23 | degraded | 404 | 66ms | |
| 2026-07-21 07:04:22 | degraded | 404 | 14ms |