Skip to main content

On‑Page Crawl Option: Support cookies

Enables cookie handling during the On‑Page crawl so the crawler can pass consent gates or session-based pages. Use this when the site requires cookies to display content or proceed past “accept cookies” screens.

WHAT THIS DOES

Enables cookie handling for the On‑Page crawl.

Some websites require a cookie to maintain a session, dismiss a gate, or access content that’s otherwise hidden. With cookies enabled, the crawler can behave more like a normal browser session.

WHEN TO ENABLE IT

  • The site shows a consent screen that sets a cookie.

  • The site requires a session cookie to view the homepage or internal pages.

  • The crawl returns 0 pages and you suspect a cookie gate.

WHEN NOT TO USE IT

  • If you want the crawl to reflect the “first-visit / no cookies” experience.

HOW TO USE IT

  1. Go to the Account → On‑Page Crawl Defaults.

  2. Enable Support cookies.

  3. Click Save Defaults.

  4. Click Retry On‑Page (or run a new audit).

Did this answer your question?