← Back to directory

Parse and validate robots.txt files to check crawl rules and permissions

https://orbisapi.com/proxy/robots-txt-parser-api-57c505

Overview

Parse and validate robots.txt files to check crawl rules and permissions

Protocol x402
Price
Payment Asset USD Coin
Payment Network Base
Category uncategorized
Provider orbisapi
Source bazaar
Indexed 2026-05-22 19:57:46

Health

Status degraded
Latency (p50) 37ms
Uptime (30d) 100.0%
Reliability Score 95/100
Last Checked 2026-09-06 00:22:55
Last Healthy 2026-05-25 12:01:00
Consecutive Failures 1

x402 Payment Validation

Payment Requirements Invalid
Asset Verified
Facilitator

Recent Health Checks

Time Status HTTP Latency Error
2026-09-06 00:22:55 degraded 404 59ms
2026-09-05 17:05:53 degraded 404 586ms
2026-09-05 13:24:59 degraded 404 46ms
2026-09-05 04:16:41 degraded 404 37ms
2026-09-04 17:04:04 degraded 404 19ms
2026-09-04 11:24:09 degraded 404 48ms
2026-09-04 02:24:43 degraded 404 19ms
2026-09-03 20:30:38 degraded 404 28ms
2026-09-03 10:36:17 degraded 404 18ms
2026-09-03 03:26:11 degraded 404 16ms