ClaudeBot
Anthropic’s crawler, which reads public pages for Claude. Like the others it identifies itself and follows robots.txt.
Related terms
Generative AI
AI that produces something new — text, images, code, audio — rather than only classifying or predicting. The generative part is why it can write an answer about your business instead of just linking to it.
AI Citation
When an assistant names your website as the source of something it said, usually with a link. A citation is the AI-era equivalent of a first-page ranking — it is the thing worth competing for.
Google-Extended
The robots.txt setting that controls whether Google may use your content for Gemini and AI Overviews. It is separate from ordinary Google Search, so you can allow one and refuse the other.
Neural Network
A system of simple connected units, loosely inspired by the brain, that learns patterns from examples rather than following rules somebody wrote. Nearly all modern AI is built on one.
Recommendation Engine
A system that suggests what somebody might want next based on behaviour — the “customers also bought” of an online shop. One of the oldest commercial uses of machine learning.
Temperature
A setting that controls how predictable an AI’s output is. Low temperature gives safe, repeatable answers; high temperature gives varied, more surprising ones — useful for ideas, risky for facts.