← Back to directory

LinkProof site policies: for up to 5 sites, fetch robots.txt, llms.txt, llms-ful...

https://linkproof.zopip.com/v1/site-policies

Overview

LinkProof site policies: for up to 5 sites, fetch robots.txt, llms.txt, llms-full.txt, ai.txt and /.well-known/security.txt in parallel. Parses robots.txt rules for common AI crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot and others) and whether a given path is allowed, lists sitemap URLs, and parses security.txt contact and expiry. Each file is size-capped; cookie or file contents beyond a short preview are not returned.

Protocol x402 (POST)
Price $0.0050
Payment Asset USD Coin
Payment Network eip155:8453
Category uncategorized
Provider LinkProof
Source bazaar
Indexed 2026-11-16 05:08:12

Health

Status unknown
Latency (p50) —
Uptime (30d) —
Reliability Score —
Last Checked Never
Last Healthy Never
Consecutive Failures 0

x402 Payment Validation

Payment Requirements —
Asset Verified —
Facilitator —

Input Schema

{ "body": { "urls": [ "https://example.com", { "path": "/", "url": "https://www.google.com" } ] }, "bodyType": "json", "method": "POST", "type": "http" }

Output Schema

{ "example": { "results": [ { "llms_txt": { "first_lines": [], "present": false, "size": 0, "status": 404 }, "origin": "https://example.com", "path_checked": "/", "robots": { "crawlers": { "*": { "allowed": true, "group": "*" }, "GPTBot": { "allowed": true, "group": "*" } }, "present": true, "sitemaps": [], "status": 200 }, "security_txt": { "contact": [], "expires": null, "present": false, "status": 404 }, "url": "https://example.com/" } ], "summary": { "total": 1, "with_llms_txt": 0, "with_robots": 1, "with_security_txt": 0 } }, "type": "json" }