Applebot-Extended
Apple’s equivalent, governing whether your content feeds Apple Intelligence. Ordinary Applebot, which powers Siri and Spotlight, is controlled separately.
Related terms
Text-to-Speech
Turning written text into spoken audio. Modern voices are convincing enough to be used for real narration, which raises its own questions about disclosure.
Training Data
The text, images or code a model learned from. It shapes everything the model knows and every bias it carries, and it is why what your website said two years ago may still be what an assistant repeats.
Microdata
An older way of marking up facts, written as attributes on the HTML itself rather than in a separate block. Still understood, but JSON-LD is now the safer choice.
Transformer
The model architecture behind almost every modern AI system, introduced in 2017. Its trick is paying attention to how every word in a passage relates to every other, which is what made fluent machine writing possible.
ClaudeBot
Anthropic’s crawler, which reads public pages for Claude. Like the others it identifies itself and follows robots.txt.
Recommendation Engine
A system that suggests what somebody might want next based on behaviour — the “customers also bought” of an online shop. One of the oldest commercial uses of machine learning.