Blog

Guides

Isometric diagram of a channel junction, the straight path capped with hatching and traffic diverted along a green branch.
Updated November 4, 2026 · 17 min read

301 redirects: how to use them effectively and handle edge cases

A practical guide to 301 redirects: when to use them over 302/307/308, how link equity passes, and how to handle chains, migrations, and edge cases.

Nik Andreev Nik Andreev
Founder & SEO specialist
Isometric diagram of a channel with four barrier plates in a row: a green particle stream passes the first two slots and stops against the third, cross-hatched plate.
Guides Nov 4, 2026

How to tell if Cloudflare or your firewall is blocking AI crawlers

A diagnostic flow for finding which layer stops GPTBot, ClaudeBot, or OAI-SearchBot: robots.txt, Cloudflare's AI crawler settings, a WAF rule, rate limiting, or your origin. Plus when blocking them is the right call.
Isometric calibration rule with graduated ticks, one narrow band filled green and a pointer resting against its edge.
Guides Updated Nov 4, 2026

Log file analysis for SEO and AI search optimization: a practical guide

Log file analysis reveals exactly what search and AI crawlers do on your site. Here's how to read your logs to protect crawl budget and AI visibility.

See the non-human half of your traffic.

Lume shows you every crawler, scraper and AI agent on your site, and verifies which ones are real. Set up in minutes.

Start for free →