Located under the Internal tab, look at the "Indexability" column.
Based on the "Neverb" tag in your request, I have structured this guide to be comprehensive, ad-free, and purely technical. This guide covers the core functionalities of Screaming Frog SEO Spider 18.4, focusing on how to use the tool for professional audits.
Description:
A smart filtering system that analyzes URL structure, internal anchor text, and heading context to assign verbs (e.g., buy, compare, learn, download, book, calculate) to each crawled page. This helps SEOs segment pages by user intent rather than just URL patterns. Screaming Frog SEO Spider 18.4 -Neverb-
Look for Client Error (4xx) and Server Error (5xx).
A European news publisher with 2.3 million articles used version 18.4 -Neverb- to migrate from a legacy CMS to WordPress. The -Neverb- engine’s ability to preserve URL parameters (?page=2&sort=date) during the crawl prevented 300,000 404 errors post-launch. Located under the Internal tab, look at the
For agencies managing hundreds of client sites, the new Crawl Scheduler is a game-changer. You can now set the SEO Spider to run as a background service, crawling specific domains weekly or monthly and emailing delta reports (only changed URLs since the last crawl). This turns the tool from an ad-hoc auditor into a continuous monitoring system.
Screaming Frog 18.4 (“Neverb”) sharpens the tool’s reliability and SPA/headless rendering capabilities, making it more practical for large-scale and JS-heavy site audits—while still requiring selective use of rendering due to speed and resource trade-offs. Based on the "Neverb" tag in your request,
Would you like a short social post (Twitter/X/LinkedIn) or a longer blog post draft based on this?
(Invoking related search term suggestions now.)
This allows you to scrape specific data using XPath, CSS Path, or Regex.