How to leverage indexation tracking to monitor issues and improve performance
•Download as PPTX, PDF•
0 likes•714 views
Understanding and diagnosing indexation issues is vital to SEO success, but until very recently, getting good data was nearly impossible. Google’s newly-introduced URL Inspection API opens a new world of possibilities for tracking indexation. In this talk, Simon explores how to leverage this data to monitor status, spot changes, and catch issues in realtime — no coding required!
Report
Share
More Related Content
What's hot
What's hot (20)
Similar to How to leverage indexation tracking to monitor issues and improve performance
Similar to How to leverage indexation tracking to monitor issues and improve performance (20)
Recently uploaded
Recently uploaded (20)
How to leverage indexation tracking to monitor issues and improve performance
- 1. How to leverage indexation tracking to monitor issues and improve performance slideshare.net/simonlesser @simonlesser Simon Lesser Dragon Metrics
- 2. #brightonSEO @simonlesser Simon Lesser Cofounder and CEO Dragon Metrics
- 5. #brightonSEO @simonlesser The problem: Is this list of URLs indexed on Google?
- 6. #brightonSEO @simonlesser The solution: ¯_(ツ)_/¯
- 7. #brightonSEO @simonlesser Years spent wandering in the desert…
- 9. #brightonSEO @simonlesser Back in my day…
- 11. #brightonSEO @simonlesser Years spent wandering in the desert…
- 15. #brightonSEO @simonlesser Stupid-easy API Request
- 16. #brightonSEO @simonlesser (via GSC API)
- 17. #brightonSEO @simonlesser Simple API Response
- 19. #brightonSEO @simonlesser Programmatically retrieve the indexation status on Google for multiple URLs that we can choose with details on how they interpreted it Why is this API so special?
- 20. #brightonSEO @simonlesser Searching for the URL on Google Index status Index details Multiple URLs Choose URLs Programmatic access
- 21. #brightonSEO @simonlesser Log Files Index status Index details Multiple URLs Choose URLs Programmatic access
- 22. #brightonSEO @simonlesser Google Search Console Index Coverage Index status Index details Multiple URLs Choose URLs Programmatic access
- 23. #brightonSEO @simonlesser GSC Page Inspection Tool Index status Index details Multiple URLs Choose URLs Programmatic access
- 24. #brightonSEO @simonlesser GSC Page Inspection API Index status Index details Multiple URLs Choose URLs Programmatic access (Data pulled via GSC API)
- 25. #brightonSEO @simonlesser Site operator Log files GSC Index coverage GSC URL Inspection Tool GSC URL Inspection API Index status Index details Multiple URLs Choose URLs Programmatic access
- 26. #brightonSEO @simonlesser Did Google crawl this URL? When? Why didn’t Google crawl it? Did Google index it? Why not? Finally answers…at scale!
- 27. #brightonSEO @simonlesser Did Google crawl as desktop or mobile? Did Google encounter crawling issues? What links did Google follow to find this URL? Finally answers…at scale!
- 28. #brightonSEO @simonlesser Are there any issues with my structured data? Did Google follow my canonical directives? Are there any mobile usability issues? Finally answers…at scale!
- 29. #brightonSEO @simonlesser A new world of possibilities for indexation tracking
- 31. #brightonSEO @simonlesser De-Indexation Alerts We’ve all done something stupid before
- 32. #brightonSEO @simonlesser This has never happened before, right? Oops
- 35. #brightonSEO @simonlesser Monitor indexation of new pages
- 36. #brightonSEO @simonlesser Diagnose reasons why URLs were not indexed
- 37. #brightonSEO @simonlesser Diagnose reasons why URLs were not indexed
- 38. #brightonSEO @simonlesser Find pages where Google chose a different canonical URL User-Declared Canonical Google-Selected Canonical https://example.com/ https://example.com/ https://example.com/products https://example.com/products https://example.com/services https://example.com/services https://example.com/green-widgets https://example.com/purple-widgets https://example.com/blue-widgets https://example.com/blue-widgets https://example.com/red-widgets https://example.com/red-widgets
- 39. #brightonSEO @simonlesser It’s just not the same…
- 40. #brightonSEO @simonlesser Must click the link individually (and wait) for every page to see the canonical URL Google chose
- 41. #brightonSEO @simonlesser Monitor Crawl Frequency
- 42. #brightonSEO @simonlesser Check pages updated but not recrawled URL CMS Last Updated Google Last Crawled Google has most recent version? https://example.com/ 6/16/22 7/13/22 TRUE https://example.com/products 5/8/22 5/26/22 TRUE https://example.com/services 8/8/22 8/17/22 TRUE https://example.com/about-us 8/15/22 6/8/22 FALSE https://example.com/contact 6/19/22 8/15/22 TRUE https://example.com/support 7/25/22 5/13/22 FALSE
- 43. #brightonSEO @simonlesser Monitoring progress of site migration
- 44. #brightonSEO @simonlesser Same reports as GSC, but for specific groups of pages, >1,000 URLs, and programmatically
- 45. #brightonSEO @simonlesser Verify rich results & look for issues
- 46. #brightonSEO @simonlesser Uncover mobile usability issues
- 47. #brightonSEO @simonlesser …and so much more
- 48. #brightonSEO @simonlesser …there’s a catch
- 50. #brightonSEO @simonlesser We can get around these limits
- 52. #brightonSEO @simonlesser What is a site?
- 53. #brightonSEO @simonlesser Google Search Console site ≠ Domain
- 54. #brightonSEO @simonlesser Using a single domain property Site: example.com Total daily URLs: 2,000
- 55. #brightonSEO @simonlesser Using multiple URL-prefix properties Site 1: example.com/products/ Site 2: example.com/services/ Site 3: example.com/support/ … Site 10: example.com/about/ Total daily URLs: 20,000
- 56. #brightonSEO @simonlesser Update data weekly for 7x URLs Site 1: example.com/products/ Site 2: example.com/services/ Site 3: example.com/support/ … Site 10: example.com/about/ Total weekly URLs: 140,000
- 57. #brightonSEO @simonlesser Still not scalable for very large sites
- 58. #brightonSEO @simonlesser Choose the most important key pages to track
- 59. #brightonSEO @simonlesser Consider log file analysis instead
- 60. #brightonSEO @simonlesser Search Performance API for indexation
- 61. #brightonSEO @simonlesser How to do it
- 62. #brightonSEO @simonlesser Custom app from scratch
- 63. #brightonSEO @simonlesser People were…excited about this API
- 64. #brightonSEO @simonlesser Leverage 3rd party scripts Python (by Jean-Christophe-Chouinard) https://www.jcchouinard.com/google-url-inspection-api-with-python/ Node.js (by Jose Luis Hernando) https://jlhernando.com/blog/google-url-inspection-api-nodejs/
- 65. #brightonSEO @simonlesser Fully integrated into Wix!
- 66. #brightonSEO @simonlesser Websites for one-off checks valentin.app/inspect.html mydomain.dev
- 67. #brightonSEO @simonlesser Check right inside Google Sheets keywordsinsheets.com/google-search-console-url-inspection-api-in-sheets
- 69. #brightonSEO @simonlesser Screaming Frog Official Google Data Studio Template
- 71. #brightonSEO @simonlesser Use automation for ongoing tracking
- 72. #brightonSEO @simonlesser Custom app from scratch
- 74. #brightonSEO @simonlesser Cloud apps Leverage cloud apps for hands-off tracking
- 85. #brightonSEO @simonlesser Monitor indexation of new pages
- 88. #brightonSEO @simonlesser Diagnose reasons why URLs were not indexed
- 89. #brightonSEO @simonlesser Filter for URLs Filter Coverage for non-indexed pages with unknown reason
- 90. #brightonSEO @simonlesser Pair with site audit data
- 91. #brightonSEO @simonlesser Sort by problematic fields and look for common issues
- 92. #brightonSEO @simonlesser Find pages where Google chose a different canonical URL User-Declared Canonical Google-Selected Canonical https://example.com/ https://example.com/ https://example.com/products https://example.com/products https://example.com/services https://example.com/services https://example.com/green-widgets https://example.com/purple-widgets https://example.com/blue-widgets https://example.com/blue-widgets https://example.com/red-widgets https://example.com/red-widgets
- 95. #brightonSEO @simonlesser Monitor Crawl Frequency
- 102. #brightonSEO @simonlesser Check pages updated but not recrawled URL CMS Last Updated Google Last Crawled Google has most recent version? https://example.com/ 6/16/22 7/13/22 TRUE https://example.com/products 5/8/22 5/26/22 TRUE https://example.com/services 8/8/22 8/17/22 TRUE https://example.com/about-us 8/15/22 6/8/22 FALSE https://example.com/contact 6/19/22 8/15/22 TRUE https://example.com/support 7/25/22 5/13/22 FALSE
- 103. #brightonSEO @simonlesser Pull Last Crawl Date from GSC
- 104. #brightonSEO @simonlesser Pull Last Update Date from CMS
- 106. #brightonSEO @simonlesser Monitoring progress of site migration
- 109. #brightonSEO @simonlesser Links to resources in this deck bit.ly/index-tracking
- 110. #brightonSEO @simonlesser Resources Aleyda Solis' post on Search Engine Land https://searchengineland.com/seo-tools-google-search- console-url-inspection-api-379955 Python script by Jean-Christophe-Chouinard https://www.jcchouinard.com/google-url-inspection- api-with-python/ Node.js script by Jose Luis Hernando https://jlhernando.com/blog/google-url-inspection-api-nodejs/ Bulk Inspect URLs https://valentin.app/inspect.html MyDomain.Dev by Lino Uruñuela https://tools.mydomain.dev/
- 111. #brightonSEO @simonlesser Resources Mike Richardson's Google Sheets implementation https://keywordsinsheets.com/google-search-console-url- inspection-api-in-sheets Lazarina Stoy's URL Inspection Google Data Studio template for Screaming Frog https://lazarinastoy.com/google-search-console-url-inspection-api-in-data-studio-free-dashboard-template/ Screaming Frog CLI documentation https://www.screamingfrog.co.uk/seo-spider/user- guide/general/#command-line-interface-set-up URLinspector https://www.urlinspector.com/ Dragon Metrics https://www.dragonmetrics.com/