Page rendering
Can AI read your vehicle pages?
Our request read your inventory fine, but your site refuses OAI-SearchBot, Googlebot, bingbot, ChatGPT-User, Claude-User, PerplexityBot — the crawlers that build the indexes AI search answers from — even though your robots.txt invites them in. An assistant can still surface your cars through third-party listings like AutoTrader, but it can't read or cite your own pages directly, which is where the lead lives. This is almost always a WAF or bot-management rule (Cloudflare and similar) overriding your robots.txt; allowlist these crawler user-agents to fix it.
VIN Index republishes every car as static, server-rendered HTML, so a crawler reads your whole lot without running a line of JavaScript.
See the detail
What we checked
Whether your vehicles are present in the raw HTML an AI crawler receives, and whether the named AI crawlers are allowed in.
How we tested
We fetch your page with no JavaScript (the way GPTBot and ClaudeBot read), count the readable vehicles, and probe whether specific AI crawler user-agents get through.
What it means
If your cars only appear after JavaScript runs, most AI crawlers see an empty page and have nothing to cite when a buyer asks.
- PerplexityBot request
- Refused at the network layer
- Claude-User request
- Refused at the network layer
- ChatGPT-User request
- Refused at the network layer
- bingbot request
- Refused at the network layer
- Googlebot request
- Refused at the network layer
- OAI-SearchBot request
- Refused at the network layer
- Bytes returned to a no-JS crawler fetch
- 278,840 chars of HTML
- Vehicles readable in that HTML
- None
