Crawl and audit a site

Crawl a client's site

On the client's Overview, choose Crawl site. Sites with no recent crawl are also crawled weekly on their own.

A finished crawl gives the overview's Site health section:

• a health score with its band, and how many of the crawled pages carry an error;

• quality scores out of 10 for SEO, performance, security, accessibility and best practices — where the work is, kept separate from the health score;

• counts of critical issues, warnings and notices, with the top issues listed;

• the technologies the crawl recognised, such as the shop platform or CDN;

• Changed since the last crawl — pages added, removed and changed.

Until a crawl has completed, the score is a dash, not a zero: an unaudited site is unknown, not failing.

Audit one page

Site audit in the top bar checks one page against one keyword. Enter the page's address and the target keyword, and you get What to change, highest impact first, plus the page's quality scores, its technologies, what real visitors experienced (if the Chrome UX Report has data for it) and a lab run.

Content health

The client's Content health page goes beyond technical issues:

• Pages losing traffic (needs Search Console)

• Keyword cannibalization — pages competing for the same keyword

• Internal links worth adding — pages whose heading is about a term the site ranks for, but which don't link to the page that ranks

• Readable by assistants — whether AI assistants can read and cite the site

Log analysis

More → Log analysis shows which pages search and AI crawlers actually fetched, and how much of their budget went to errors and redirects. Upload a server access log for one client as a .log or .txt file.