Skip to main content

On‑Page Crawl Option: Disable cookie popup

Attempts to suppress cookie/consent popups that block navigation during an On‑Page crawl. Use this when overlays prevent the crawler from accessing content or following links, especially on GDPR/consent-heavy sites.

Updated over a month ago

WHAT THIS DOES

Attempts to suppress cookie/consent popups that block navigation during crawling.

Some popups overlay the page and prevent the crawler from accessing links or content. This option can help the crawler proceed without being blocked by overlays.

WHEN TO ENABLE IT

  • The homepage loads but the crawler can’t proceed due to an overlay.

  • The crawl returns 0 pages and the site uses a consent overlay.

NOTES

  • Not all sites can be bypassed this way (some popups are deeply integrated).

  • If this doesn’t work, you may need to allowlist Rankley’s crawler in your WAF.

HOW TO USE IT

  1. Go to the Account → On‑Page Crawl Defaults.

  2. Enable Disable cookie popup.

  3. Click Save Defaults.

  4. Click Retry On‑Page (or run a new audit).

Did this answer your question?