Skip to main content

On‑Page Crawl Option: Support cookies

Enables cookie handling during the On‑Page crawl so the crawler can pass consent gates or session-based pages. Use this when the site requires cookies to display content or proceed past “accept cookies” screens.

Updated over a month ago

WHAT THIS DOES

Enables cookie handling for the On‑Page crawl.

Some websites require a cookie to maintain a session, dismiss a gate, or access content that’s otherwise hidden. With cookies enabled, the crawler can behave more like a normal browser session.

WHEN TO ENABLE IT

  • The site shows a consent screen that sets a cookie.

  • The site requires a session cookie to view the homepage or internal pages.

  • The crawl returns 0 pages and you suspect a cookie gate.

WHEN NOT TO USE IT

  • If you want the crawl to reflect the “first-visit / no cookies” experience.

HOW TO USE IT

  1. Go to the Account → On‑Page Crawl Defaults.

  2. Enable Support cookies.

  3. Click Save Defaults.

  4. Click Retry On‑Page (or run a new audit).

Did this answer your question?