Parse robots.txt files and check URL crawl permissions per user-agent.
https://orbisapi.com/proxy/robots-txt-parser-api-a263c4/openapiOverview
Parse robots.txt files and check URL crawl permissions per user-agent.
Protocol
x402
Price
—
Payment Asset
USD Coin
Payment Network
Base
Category
uncategorized
Provider
orbisapi
Source
bazaar
Indexed
2026-04-27 08:52:48
Health
Status
down
Latency (p50)
35ms
Uptime (30d)
0.0%
Reliability Score
35/100
Last Checked
2026-10-03 09:26:14
Last Healthy
2026-05-30 12:32:04
Consecutive Failures
75
x402 Payment Validation
Payment Requirements
—
Asset Verified
—
Facilitator
—
Recent Health Checks
| Time | Status | HTTP | Latency | Error |
|---|---|---|---|---|
| 2026-10-03 09:26:14 | error | — | — | fetch failed |
| 2026-10-03 01:38:31 | error | — | — | fetch failed |
| 2026-10-02 19:41:25 | error | — | — | fetch failed |
| 2026-10-02 15:11:42 | error | — | — | fetch failed |
| 2026-10-02 08:34:38 | error | — | — | fetch failed |
| 2026-10-01 22:59:53 | error | — | — | fetch failed |
| 2026-10-01 17:51:25 | error | — | — | fetch failed |
| 2026-10-01 06:34:36 | error | — | — | fetch failed |
| 2026-09-30 22:18:29 | error | — | — | fetch failed |
| 2026-09-30 16:18:54 | error | — | — | fetch failed |