Michal Magdziarz @Digitalzone - The Search Universe - Links, Log Files, GSC and Everything in Between
•
5 likes•11,745 views
Michal Magdziarz was at Digitalzone stage on October 20, 2017 and made a presentation about the search universe!
Recommended
More Related Content
Viewers also liked
Viewers also liked (19)
More from Zeo
More from Zeo (20)
Recently uploaded
Recently uploaded (20)
Michal Magdziarz @Digitalzone - The Search Universe - Links, Log Files, GSC and Everything in Between
- 7. Total potential number of URLs @DeepCrawl @Magdziarz #digitalzone@DeepCrawl @Magdziarz #digitalzone
- 11. I want to tell you a story
- 12. Starring: Mr Deepson as The URLSimple Story about an URL in Search Universe
- 13. Starring: Me as The URL
- 17. 404 myurl.com/my-page 1000s of Backlinks! Backlinks to broken pages @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 20. myurl.com/my-page 1000s of Backlinks! Backlinks to a nofollow page @DeepCrawl @magdziarz myurl.com/page-1 myurl.com/page-4 Meta Nofollow @DeepCrawl @Magdziarz #digitalzone
- 21. @DeepCrawl @magdziarz Backlinks to low DeepRank/high level pages? @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 22. myurl.com/my-page 1000s of Backlinks! @DeepCrawl @magdziarz Where do backlinks land on your site? Just 1 link out @DeepCrawl @Magdziarz #digitalzone
- 23. Disallowed myurl.com/my-page 1000s of Backlinks! Non-indexable pages with backlinks @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 25. myurl.com/my-page 876 Backlinks Backlinks to duplicate pages myurl.com/my-page.html 456 Backlinks Duplicates Canonical 456 Backlinks! 1332 Backlinks! @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 28. URL story with Google Search Console myurl.com/my-page TrafficDisallowed @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 31. Understand how bots crawl with different user agents @DeepCrawl @magdziarz Responsive Dynamic Separate Mobile Would expect Google to use both user- agents on the same URL to validate that the same content is returned. Google needs to crawl with both user agents to validate the mobile version. Hint: Use the Vary HTTP header! Google needs to crawl the dedicated mobile URLs with a mobile user agent to validate the pages and confirm the content matches the desktop pages. @DeepCrawl @Magdziarz #digitalzone
- 32. Impact of Mobile-first @DeepCrawl @magdziarz -CRITICAL- - Desktop only (Heavily Affected) -HIGH PRIORITY- - Desktop + Dedicated Mobile (Affected) -HIGH PRIORITY- - Dynamic (Affected e.g. Content Issues) -MEDIUM PRIORITY- - Responsive (Not affected) Impact of Mobile-first on different Mobile Configurations:
- 33. Order of Mobile-first Indexing @DeepCrawl @magdziarz Responsive Page AMP Page Mobile Page Rel=canonical Rel=alternate amp NON-INDEXABLE NON-INDEXABLE Rel=canonical Rel=alternate mobile Responsive Page Mobile Page INDEXABLE INDEXABLENON-INDEXABLE GOOGLE SERP @DeepCrawl @Magdziarz #digitalzone
- 34. Order of Mobile-first Indexing @DeepCrawl @magdziarz Dynamic Mobile Page Dynamically served INDEXABLE Responsive Page AMP Page Rel=canonical Rel=alternate amp NON-INDEXABLE Responsive Page INDEXABLE GOOGLE SERP @DeepCrawl @Magdziarz #digitalzone NON-INDEXABLE
- 38. Maintaining Value Through Migrations myurl.com/page.aspx myurl.com/c/page 301 redirect myurl.com/page 404 301 redirect 1 Reuqest 1 Reuqest 1 Reuqest 2768 Visits 2768 Visits 2768 Visits 500 Links @DeepCrawl @Magdziarz #digitalzone
- 41. Identify where crawl budget is getting WASTED @DeepCrawl @magdziarz Indexable Pages without Googlebot requests Non-indexable Pages with Googlebot requests Indexable Pages with Googlebot requests @DeepCrawl @Magdziarz #digitalzone
- 42. myurl.com/non-indexable 100 requests Identify crawl budget wastage myurl.com/broken 330 requests myurl.com/page?sort=price 56 requests @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 43. myurl.com/sitemap_index.xml 2,300 requests Determine most crawled site sections myurl.com/categories 330 requests myurl.com/products 232 requests @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 44. Now it gets fun! myurl.com/dress myurl.com/ dress?colour=red 2,768 Visits 1000s of Backlinks 50 Googlebots 2,423 Clicks @DeepCrawl @magdziarz myurl.com/ dress?colour=blue myurl.com/ dress?colour=green myurl.com/ dress?colour=green&price=1000+ Meta Canonical myurl.com/ dress?colour=…&price=… (…) @DeepCrawl @Magdziarz #digitalzone
- 50. A simple URL story with visits Soft-200 myurl.com/my-page 1000s of Visits! @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 51. A simple URL story with visits Blog post myurl.com/my-page 1000s of Visits! @DeepCrawl @magdziarz No conversion points @DeepCrawl @Magdziarz #digitalzone
- 55. A Story about a few more URLs .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . .
- 57. …hidden among the others .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . ... . . . . . .. . . . . .. . . . . .. . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . ... . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . ... . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . .. . . .. . . . . . . . .. . . . . . .. . . . . .. . . .. . . .. . . . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . .. . . . . .. . . . . . .. . . . . .. . . .. . . .. . . . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . .. . . .. . . . . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . .. . . .. . . . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . .. .. . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . ... . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . ... . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . ... . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . .. . . . . .. . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . .. . . . . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . .. . . . . .. . ... . . . . .. . . . . .. . . . . . .. . . . . .. . . . .. . . . . . . . . .. . . . . .. . . .. . . . .. .. . . . .. . . . . .. . . . . .. . . . . . .. . . . . .. . . . . .. . . . . .. . . . . .. . . . .
- 62. Scaling up 1000 URLs 100k+ URLs 1M+ URLs @DeepCrawl @magdziarz@DeepCrawl @Magdziarz #digitalzone
- 67. One more thing …
- 68. • Providing clarity with data • Educating the market • You at the forefront of this development Taking part in this journey: