← Back to directory

Parse and validate robots.txt files to check crawl rules and permissions

https://orbisapi.com/proxy/robots-txt-parser-api-bc08cf/:endpoint

Overview

Parse and validate robots.txt files to check crawl rules and permissions

Protocol x402
Price
Payment Asset USD Coin
Payment Network Base
Category uncategorized
Provider orbisapi
Source bazaar
Indexed 2026-05-25 23:23:00

Health

Status degraded
Latency (p50) 47ms
Uptime (30d) 100.0%
Reliability Score 100/100
Last Checked 2026-07-26 16:46:50
Last Healthy 2026-06-21 11:41:26
Consecutive Failures 0

x402 Payment Validation

Payment Requirements Invalid
Asset Verified
Facilitator

Recent Health Checks

Time Status HTTP Latency Error
2026-07-26 16:46:50 degraded 404 86ms
2026-07-26 11:07:17 degraded 404 28ms
2026-07-26 08:27:14 degraded 404 13ms
2026-07-26 03:59:07 degraded 404 38ms
2026-07-26 00:53:34 degraded 404 47ms
2026-07-25 20:46:57 degraded 404 45ms
2026-07-25 16:44:49 degraded 404 65ms
2026-07-25 13:02:41 degraded 404 42ms
2026-07-25 09:15:44 degraded 404 33ms
2026-07-25 06:21:04 degraded 404 68ms
2026-07-25 00:54:55 degraded 404 73ms
2026-07-24 22:23:52 degraded 404 85ms
2026-07-24 15:26:25 degraded 404 56ms
2026-07-24 12:16:55 degraded 404 24ms
2026-07-24 09:08:38 degraded 404 40ms
2026-07-24 04:08:46 degraded 404 70ms
2026-07-24 00:17:09 degraded 404 19ms
2026-07-23 19:18:25 degraded 404 49ms