Overview
LinkProof site policies: for up to 5 sites, fetch robots.txt, llms.txt, llms-full.txt, ai.txt and /.well-known/security.txt in parallel. Parses robots.txt rules for common AI crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot and others) and whether a given path is allowed, lists sitemap URLs, and parses security.txt contact and expiry. Each file is size-capped; cookie or file contents beyond a short preview are not returned.
Protocol
x402 (POST)
Price
$0.0050
Payment Asset
USD Coin
Payment Network
eip155:8453
Category
uncategorized
Provider
LinkProof
Indexed
2026-11-16 05:08:12
Health
Status
unknown
Latency (p50)
—
Uptime (30d)
—
Reliability Score
—
Last Checked
Never
Last Healthy
Never
Consecutive Failures
0
Input Schema
{
"body": {
"urls": [
"https://example.com",
{
"path": "/",
"url": "https://www.google.com"
}
]
},
"bodyType": "json",
"method": "POST",
"type": "http"
}
Output Schema
{
"example": {
"results": [
{
"llms_txt": {
"first_lines": [],
"present": false,
"size": 0,
"status": 404
},
"origin": "https://example.com",
"path_checked": "/",
"robots": {
"crawlers": {
"*": {
"allowed": true,
"group": "*"
},
"GPTBot": {
"allowed": true,
"group": "*"
}
},
"present": true,
"sitemaps": [],
"status": 200
},
"security_txt": {
"contact": [],
"expires": null,
"present": false,
"status": 404
},
"url": "https://example.com/"
}
],
"summary": {
"total": 1,
"with_llms_txt": 0,
"with_robots": 1,
"with_security_txt": 0
}
},
"type": "json"
}