Why a Site Audit cannot be completed?

The most common reasons a crawling cannot be finished:

  • Typo in the URL
  • The URL redirects to another location on a different domain
  • The home page could not be retrieved (404, timeout, etc.)
  • The crawler bot is blocked in robots.txt (User-Agent: * or another block) - allow User-agent: "Proranktracker Site Audit"
  • The web server stops responding during the crawling (timeout, Too many requests etc.)


If you experience problems crawling your site, just contact our Support Team.

1 Users Found This Useful

Was this answer helpful?

Also Read

Site Audit - Full Report

After adding a site audit, from the main Site Audit page, click on one of the “Full Report”...

What is "Click path" (Site Audit)

To correctly understand the analysis, one should call the distance measure "steps" instead of...

How do I add a new site audit report?

Tools > Site AuditClick on “New Report” on top right. The URL for auditing has to be first...

Site audit

Tools > Site Audit On the main Site Audit page, you can view your existing reports, Short and...

Can I schedule an automated site audit crawl?

Yes, from the main Site Audit tool page, click the “Edit” icon under “Action”, schedule, and save.

Take your business to the next step. Try Pro Rank Tracker for Free!