Blog
AI agents
How to detect AI agents like ChatGPT agent on your website
AI agents browse your site in a real browser on a person's behalf, so they look nothing like crawlers. Here is the verification ladder that tells signed, declared and hidden agents apart.
Generative engine optimization (GEO): the complete guide
A complete guide to generative engine optimization: what GEO is, how it differs from SEO and AEO, the citation factors that matter, and the crawler-access and measurement layers most guides skip.
How to get cited in Google AI Overviews and ChatGPT
A practical guide to earning citations in Google AI Overviews and ChatGPT, then confirming they worked by measuring the AI-referral traffic they send back.
llms.txt explained: what it is and how to create one
llms.txt is a proposed Markdown file that points AI models to your best content. Here is how to create one, plus the 2025-2026 evidence on whether crawlers use it.
How to optimize your site for AI search
AI search optimization starts with a technical question most guides skip: can AI crawlers actually reach and read your content? Here is the checklist.
How to see ChatGPT and Perplexity referral traffic
AI referral traffic is the humans arriving from ChatGPT, Perplexity, and Gemini. Here are the exact referrer hostnames, GA4 setup, and the gotchas that hide it.
What is GPTBot? A field guide to AI crawlers
GPTBot is OpenAI's training crawler. Learn what it does, its user-agent token, and how it differs from the search and user-fetch bots you should not block.
See the non-human half of your traffic.
Lume shows you every crawler, scraper and AI agent on your site, and verifies which ones are real. Set up in minutes.
Start for free →