Crawler Atlas profile of one web bot by slug or name (gptbot, claudebot, bytespi...
https://x402.forgemesh.io/bot-profilesOverview
Crawler Atlas profile of one web bot by slug or name (gptbot, claudebot, bytespider, ahrefsbot…): operator and homepage, purpose (AI training, AI search, user fetch, SEO, archive, scraping), user-agent match, robots.txt token, how to verify it (reverse-DNS suffixes, published IP ranges), whether it can pay via x402, plus network observations with sample sizes: sites that saw it, impostor rate, share charging or blocking it, median price.
Protocol
x402 (POST)
Price
$0.0050
Payment Asset
USD Coin
Payment Network
eip155:8453
Category
tools/search
Provider
x402
Source
bazaar
Indexed
2026-11-10 04:02:16
Health
Status
unknown
Latency (p50)
—
Uptime (30d)
—
Reliability Score
—
Last Checked
Never
Last Healthy
Never
Consecutive Failures
0
x402 Payment Validation
Payment Requirements
—
Asset Verified
—
Facilitator
—
Input Schema
{
"body": {
"slug": "gptbot"
},
"bodyType": "json",
"method": "POST",
"type": "http"
}
Output Schema
{
"example": {
"crawler": {
"class": "ai",
"name": "GPTBot",
"note": "Collects pages that may be used to train OpenAI models. Blocking it does not affect ChatGPT search or browsing.",
"pays": {
"x402": false
},
"purpose": "training",
"robots_token": "GPTBot",
"user_agent_contains": [
"gptbot"
],
"verify": {
"ip_ranges": "https://openai.com/gptbot.json"
}
},
"observed": {
"first_seen": "2026-10-28",
"impostor_rate": 0,
"median_price_usd": 0.05,
"sample_note": "small sample",
"share_blocked": 0.33,
"share_charged": 0.67,
"sites_reporting": 12,
"sites_seen": 3,
"window_days": 7
},
"operator": {
"homepage": "https://platform.openai.com",
"name": "OpenAI",
"policy": "https://platform.openai.com/docs/bots"
},
"url": "https://forgemesh.io/bots/gptbot",
"version": "0.1"
},
"type": "json"
}