Skip to content

Crawling

SEO begins with a robot crawling a website. During crawling, search engine robots open every page they have found a link to and fetch all the content from that page. You need to make sure robots are able to find all the pages and files on the website. As robots do find the pages and files, you also need to make sure robots can see the content on those pages and files. The resources below will help you find and fix crawling-related issues that are holding back your SEO performance.

How to Check HTTP Response Status Codes

Every page on every website returns an HTTP response status code. How do you check the status code for your website’s pages? What do the status codes mean?

XML Sitemap

An XML Sitemap lets you share data about the pages on your website with search engines, including information about images and videos.

Subdirectory or Subdomain?

Should you use a subdirectory (subfolder) or subdomain for SEO and for the best user experience?

What Are HTTP Headers

Learn what HTTP Headers are, how to view HTTP Headers for your website, and which HTTP Headers can affect your website’s SEO performance.

Using Log File Analysis To Improve Your SEO Performance

You have to understand how Google’s bots are understanding and crawling through your website. Learn what log files are and how you can start analyzing your website’s log files to improve your SEO performance.

Website Error Pages

When you access a web page that the website cannot find, the server that powers that website usually returns a status code indicating that the server was unable to find the file requested. That status code returned when a file is not found can vary, but is most commonly a 404.

Avoid SEO Problems with Dev & Staging Sites

Dev or staging sites are essential when building a new website. But staging and dev websites can create problems for SEO. Find out how to avoid those problems!

SEO Friendly Infinite Scroll: How Do You Make Infinite Scroll Work For Organic Search?

How do you make infinite scroll and related techniques SEO friendly? See the steps you need to take to fix infinite scroll for SEO.

How To Manage Parameters

Parameters can create duplicate content, slow down website crawling, and disrupt rankings. What are the best ways to avoid these problems? In this article, we’ll review how to find and manage parameters on a website.

Extract URL Parameters in Bulk

If you are analyzing URLs containing parameters, this tool will allow you to extract parameters from URLs in bulk.

Configure Webflow SEO Settings

Learn how to configure Webflow for SEO, including improving website speed, adjusting the robots.txt file, and setting noindex tags.

JavaScript & SEO

You can use JavaScript more now, without nearly as much risk to your SEO work. But this doesn’t mean you should use JavaScript for everything. Learn how you need to adjust your JavaScript code for optimal SEO performance.