Parse robots.txt files and check URL crawl permissions per user-agent.
https://orbisapi.com/proxy/robots-txt-parser-api-a263c4Overview
Parse robots.txt files and check URL crawl permissions per user-agent.
Protocol
x402
Price
—
Payment Asset
USD Coin
Payment Network
eip155:8453
Category
uncategorized
Provider
orbisapi
Source
bazaar
Indexed
2026-05-04 16:56:14
Health
Status
healthy
Latency (p50)
646ms
Uptime (30d)
100.0%
Reliability Score
85/100
Last Checked
2026-05-07 08:56:58
Last Healthy
2026-05-07 08:56:58
Consecutive Failures
0
x402 Payment Validation
Payment Requirements
Valid
Asset Verified
Known USDC
Facilitator
—
Recent Health Checks
| Time | Status | HTTP | Latency | Error |
|---|---|---|---|---|
| 2026-05-07 08:56:58 | healthy | 402 | 355ms | |
| 2026-05-07 06:55:11 | healthy | 402 | 699ms | |
| 2026-05-07 01:16:52 | healthy | 402 | 284ms | |
| 2026-05-06 21:15:09 | healthy | 402 | 646ms | |
| 2026-05-06 17:34:06 | healthy | 402 | 270ms | |
| 2026-05-06 16:33:06 | healthy | 402 | 938ms | |
| 2026-05-06 14:06:53 | healthy | 402 | 1154ms | |
| 2026-05-06 12:34:55 | healthy | 402 | 656ms | |
| 2026-05-06 08:27:04 | healthy | 402 | 1141ms | |
| 2026-05-06 05:32:20 | healthy | 402 | 722ms | |
| 2026-05-06 03:35:52 | healthy | 402 | 252ms | |
| 2026-05-06 00:26:13 | healthy | 402 | 1014ms | |
| 2026-05-05 20:12:09 | healthy | 402 | 278ms | |
| 2026-05-05 18:06:06 | healthy | 402 | 209ms | |
| 2026-05-05 15:51:24 | healthy | 402 | 713ms | |
| 2026-05-05 12:01:28 | healthy | 402 | 892ms | |
| 2026-05-05 08:22:42 | healthy | 402 | 259ms | |
| 2026-05-05 06:06:46 | healthy | 402 | 248ms | |
| 2026-05-05 01:55:50 | healthy | 402 | 527ms | |
| 2026-05-04 23:58:44 | healthy | 402 | 475ms |