Crawling

WAF Rules

Matthew Edgar October 5, 2026

What are WAF rules? Why do they matter for SEO and GEO? What do we need to do about WAF rules?

Read WAF Rules →

Fix Internal Link Problems

Matthew Edgar February 11, 2026

Why do internal links matter for SEO? Why should we optimize our site's internal linking structure? Technical issues can disrupt how bots crawl your site and how users navigate it. Here is a breakdown of common internal link problems to watch out for...

Read Fix Internal Link Problems →

JavaScript Redirects

Matthew Edgar October 17, 2025

Should you use JavaScript to implement redirects? If you do use JavaScript to redirect pages, what is the best approach? JavaScript redirects are problematic. This is because Googlebot only processes JavaScript redirects after crawling is completed.

Read JavaScript Redirects →

Meta Refresh Redirects

Matthew Edgar October 17, 2025

You can use a meta refresh tag to process client-side redirects. Why would you? And how does a meta refresh work exactly? A meta refresh tag, like other meta tags, is added to the website’s <head>.

Read Meta Refresh Redirects →

Manage Crawl Budget

Matthew Edgar July 17, 2025

How do I manage my website's crawl budget? I get asked this question a lot but I don't think "crawl budget" is quite the right way to think about this. That's because crawling isn't one single thing.

Read Manage Crawl Budget →