How to Use Screaming Frog SEO Spider for Website Audits

 

In virtual trapthecar advertising and marketing, search engine optimization (search engine marketing) is critical in riding organic website visitors. A nicely-accomplished trapthecar search engine marketing audit is the foundation for enhancing your website’s visibilitytrapthecar and scores on seek enginetrapthecar end result pages (SERPs).

 

While there are numerous equipmenttrapthecar available for accomplishing an SEO audit, one device that stands proud is the Screaming Frog search engine optimization Spider. With its powerful crawling trapthecar capabilities and insightful statistics, Screaming Frog has come to be a personal preferred of mine, at the side of lots of different SEO professionals.

 

In this newsletter, we will explore the trapthecar way to perform an powerful search engine optimization audit using Screaming Frog and delve into key regions trapthecar within the device which could trapthecar assist find optimisation possibilities and enhance your website’s overall performance. Whether you’re an experienced search enginetrapthecar optimization practitioner trapthecar or a newbie seeking to decorate your website’s visibility, this manual will equip you with the knowledge and gear you need to conduct a trapthecar comprehensive search enginetrapthecar marketing audit with Screaming Frog.

 

This article is a visitor contribution from trapthecar Nikki Halliwell, a freelance Technical search engine marketing Consultant and Technical search engine optimization Lead at Journey Further.

 

How to Set Up Your Crawl trapthecar Configuration in Screaming Frog

When starting a crawl, step trapthecar one is to trapthecar open up the configuration settings and make certain the move slowly is set up trapthecar correctly and will capture the facts we want. We can do this underneath Configuration > Crawl Config, in order to deliver up the Spidertrapthecar Configuration menu. The first phase you will see is the Crawl tab.

 

In some cases, the settings within the trapthecar Resource Links and Page Links section don’t need to alternate, however it istrapthecar critical to make sure they’re accurate for the website you need to move slowly. For instance, if the website online has an global set-up, you ought to ensure the crawltrapthecar is set up to move slowly and save hreflang records.

 

The identical applies to thetrapthecar Extraction tab; ensure all of the Page Details and URL Details you want totrapthecar capture are decided on. Further down, you'll see the Structured Data segment, and as earlier than, trapthecar make sure the important types of schema are selected in trapthecar your internet site; this includes JSON-LD and schema.Org validation, etc.

 

If the internet site you’re trapthecar crawling uses JavaScript, you can switch on JS crawling beneath the Renderingtrapthecar tab. We don’t need JavaScript for this unique website, so I will leave this trapthecar placing as Text Only.

 

The Preferences tab is where you can trapthecar regulate any settings referring to the page title, meta description length and many others. The SEO Spider automatically consists of examples of Non-Descriptive Anchortrapthecar Text that it's going to search for, along with “click on here.” However, if there are extra examples you would really like totrapthecar consist of, you can do that on this tab too.

 

Click OK when you’re glad with the settings trapthecar you’ve decided on.

 

You also can store the configuration if youtrapthecar realize these are settings you’re possibly to preserve the equal in most of your crawls; you can shop these as your default crawl settings beneath File > trapthecar Configuration > Save Current Configuration as Default.

 

Remember that the settings decided on righttrapthecar here may additionally alternate whilst crawling and auditing a staging internet site.

 

Specifying the XMLtrapthecar Sitemap

An critical and beneficial function is the trapthecar capacity to crawl the XML sitemap, which you'll locate inside the first Crawl tab.

The XML sitemap will exchange with each internet site, and whilst the spider should pick up the XML sitemap as long as it is blanketed in the robots.Txt, I favor to specify the sitemap URL/s to ensuretrapthecar they’re captured successfully.

Exploring Content trapthecar Settings and Starting Your Crawl

Before I start my move slowly, I permit additionaltrapthecar settings that permit Screaming Frog to come across reproduction content material. We can get entry to this underneath the Configuration trapthecar menu > Content > Duplicates.

This will open up the Duplicates menu, trapthecar in which you must see the following alternatives. If no longer already checked, I tick the Enable Near Duplicates choice, enablingtrapthecar Screaming Frog to search for instances of almost duplicate content at the website that has a 90% similarity to trapthecar different content material. The Similarity Threshold can be changed as wanted.

 

Finally, I examine the Spelling andtrapthecar Grammar Settings under the Crawl Config > Content > Spelling & Grammar. Here, you can allow the spelling and grammar trapthecar checks and make certain the language is set to fit the language used at the web page. Thetrapthecar internet site in query makes trapthecar use of English and UK spellings, so I will set the language accordingly. If it had a US attention, I could set the language to English trapthecar (United States of America) to account for the variations in some US spellings. Click OK once completed.

As earlier than, in case you understand these settings will be used on maximum of your crawls, those can be stored in your trapthecar default crawl configuration.

Once executed, you can press Starttrapthecar to begin your crawl.

Maximising Insights withtrapthecar Crawl Analysis

Once the move slowly has finished, it is trapthecar encouraged to run a crawl evaluation via navigating to Crawl Analysis > Start. This evaluation permits additional statistics to be populated, consisting of the trapthecar link rating metric for internal URLs, duplicate content material, crawl trapthecar discrepancies together with non-indexable URLs in the XML sitemap and greater.

Running a trapthecar crawl analysis isn't always obligatory however lets in you to get admission to otherwise unavailable trapthecar records, so I advocate this step.