Skip to main content
Module 4 of 12 · SEO tools · Lesson 7 of 16

Find every page on the site and see what Google has indexed

Discover pages from Search Console, the sitemap and a crawl, then filter to the ones Google has not indexed.

6 minBeginnerFor: Agency owner or manager, Team memberLast checked
Video tutorial coming soon

The written steps below are complete. The Video script tab shows exactly what the video will cover.

A page that Google has not indexed cannot appear in search at all. The Pages screen gathers every address of the site from three sources and shows, page by page, whether it has been submitted to Google and whether Google has indexed it.

By the end you can

  • Discover the site's pages
  • Read the Sources, Submitted and Indexed columns
  • Filter to pages that are not indexed

Screens used

  • Project, Pages

Steps

  1. 1

    Open Pages

    On: Project, Pages

    Open the project, then open the SEO hub and choose Pages.

    You should see: A table of pages, or "No pages discovered yet".

  2. 2

    Run discovery

    On: Project, Pages

    Press Refresh (or Run discovery on an empty page). It pulls pages that had impressions in Search Console in the last 90 days, and reads the sitemap at the site's root.

    You should see: The table fills with addresses.

  3. 3

    Add a sitemap by hand if needed

    On: Project, Pages

    If the sitemap is not at the usual address, press Sitemap URL and paste its full address, then refresh again.

    You should see: Pages from that sitemap are added, marked Sitemap under Sources.

  4. 4

    Crawl for more

    On: Project, Pages

    Press Crawl to follow links on the site and find pages that are in neither Search Console nor the sitemap. A crawl covers up to 100 pages and runs for up to 60 seconds.

    You should see: "Crawl complete" and any new pages marked Crawl under Sources.

  5. 5

    Read the columns

    On: Project, Pages

    Sources shows where a page was found: GSC, Sitemap, Crawl, Manual or Article. Submitted shows whether it was sent to Google. Indexed shows what Google's URL Inspection last said. Discovered is when ItzSEO first saw it.

    You should see: You can tell where each page came from.

  6. 6

    Filter to the problems

    On: Project, Pages

    Use the filters above the table: All, Not indexed, Failed, Sitemap only, GSC only and New (last 7d). Choose Not indexed.

    You should see: Only pages Google has not indexed are listed.

  7. 7

    Find one page

    On: Project, Pages

    Type part of an address in Filter by URL… to find a single page.

    You should see: The table narrows to matching addresses.

Tips

  • Sitemap only pages are in the sitemap but have had no impressions in Search Console. They are often the ones not yet indexed.
  • GSC only pages get impressions but are missing from the sitemap. Add them to the sitemap.

Troubleshooting

"Couldn't load pages" or an empty table after Refresh.
Connect Google Search Console in the project's Settings, or paste the sitemap address with Sitemap URL.
The Refresh button cannot be pressed.
Your role in this project is below Editor. Ask the owner to refresh or change your role.
Finished this lesson?

Mark it complete to keep your place in the course.