ClaudeBot
Anthropic’s crawler, which reads public pages for Claude. Like the others it identifies itself and follows robots.txt.
Related terms
AI Visibility
How often, and how accurately, AI assistants mention your business when someone asks about what you do. Unlike search rankings there is no official scoreboard, so it is measured by asking the assistants and by watching which crawlers visit.
Tool Use
An AI reaching outside itself to do something it cannot do alone: run a search, do arithmetic reliably, read a live page. Nearly every useful assistant depends on it.
Agentic Browsing
An AI navigating a website on somebody’s behalf: finding the price, checking availability, sometimes buying. Sites that rely on hover menus and unlabelled buttons are hard for an agent to use.
Organization Schema
Structured data describing the business itself: name, logo, address, contact details, social profiles. The single most useful markup for being recognised, and the one most small sites are missing.
Content Signals
An extension to robots.txt that states not just who may crawl, but what they may do with what they find: appear in search, be quoted in answers, be used as training data. It lets you permit citation while refusing training.
NLP (Natural Language Processing)
The field concerned with computers handling human language: understanding it, generating it, translating it. Everything from spam filters to chat assistants sits somewhere in it.