Crawl Budget
The rough limit on how much of your site a crawler will fetch in a visit. Slow pages and endless near-duplicate URLs spend it on nothing, so the pages that matter get visited less often.
Related terms
Watermarking
Marking AI-generated content so it can be identified later, often invisibly. Part of the same effort as provenance, and equally early.
Answer Engine
An answer engine replies to a question with a written answer instead of a list of links. ChatGPT, Perplexity and Google’s AI Overviews are all answer engines. The old question was “do we rank?”; the new one is “are we the answer?”
Applebot-Extended
Apple’s equivalent, governing whether your content feeds Apple Intelligence. Ordinary Applebot, which powers Siri and Spotlight, is controlled separately.
LLM (Large Language Model)
The kind of AI behind ChatGPT, Claude and Gemini. It is trained on an enormous amount of text and predicts what should come next, which is enough to answer questions, summarise, translate and write.
LocalBusiness Schema
Organization markup with the details a local search needs — address, opening hours, service area, price range. What lets an assistant answer “is there one near me, and are they open now?”
Token
The unit an AI reads and writes in — roughly three quarters of a word. Models are priced and limited by tokens, which is why very long documents cost more and sometimes get truncated.