SlideShare a Scribd company logo
1 of 74
Download to read offline
Screaming Frog + Xpath:
A Guide to Analyse the Pants
Off Your Competition
Sabine Langmann // sabine-langmann.com //
@SabTheLa https://slideshare.net/sabinelangmann
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Level 1
12.04.2019 Sabine Langmann bit.ly/sfx-2019
What is this about?
12.04.2019 Sabine Langmann bit.ly/sfx-2019
We‘d like: to crawl specific
elements on our own web pages
or the ones of our competition
We use: Screaming Frog‘s
Custom Extraction + XPath
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Level 2
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Who am I?
https://www.sabine-langmann.com
https://www.linkedin.com/in/sabine-langmann/
@SabTheLa
12.04.2019 Sabine Langmann
Slides: bit.ly/sfx-2019
bit.ly/sfx-2019
Level 3Level 3
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Xpath
12.04.2019 Sabine Langmann bit.ly/sfx-2019
XPath (XML Path Language) is a
query language
for selecting nodes
from an XML document.
Wikipedia
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Simple Syntax
node every page element (e.g. H2, a, p, div)
// adresses a certain node
attribute attribute of a node (e.g. class, id)
@ adresses a certain attribute
count() counts addressed nodes
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Simple Syntax
12.04.2019 Sabine Langmann
//node[@attribute="attribute_name"]
bit.ly/sfx-2019
Simple Syntax
12.04.2019 Sabine Langmann
//node[@attribute1="attribute_name1" and
@attribute2="attribute_name2"]
bit.ly/sfx-2019
Simple Syntax
12.04.2019 Sabine Langmann
count(//node[@attribute="attribute_name"])
bit.ly/sfx-2019
Level 4
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Examples
12.04.2019 Sabine Langmann bit.ly/sfx-2019
BBC.com
vs.
TheGuardian.com
12.04.2019 Sabine Langmann bit.ly/sfx-2019
BBC.com
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
How many images?
How many H2, H3, etc?
How many words?
How many links to which pages?
bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
What am I searching for?
12.04.2019 Sabine Langmann bit.ly/sfx-2019
In
I‘m searching for text (name of
the topic tag)
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Suitable Xpath selector:
//li[
@class="tags-list__tags"
and
@data-entityid="topic_link_bottom"
]
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
https://www.bbc.com/news/uk-politics-.*
bit.ly/sfx-2019
12.04.2019 Sabine Langmann
Don‘t forget ;)
bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
Result
bit.ly/sfx-2019
12.04.2019 Sabine Langmann Bit.ly/abjsd
Ain‘t nobody got time
for Excel. Better listen
to Ben!
12.04.2019 Sabine Langmann bit.ly/sfx-2019
TheGuardian.com
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
What am I searching for?
12.04.2019 Sabine Langmann bit.ly/sfx-2019
In
<div class="submeta">
I‘m searching for
the topic tag names
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Suitable Xpath selectors:
//div[@class="submeta__section-labels"])
and
//div[@class="submeta__keywords"]
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
https://www.theguardian.com/sitemaps/news.xml
bit.ly/sfx-2019
12.04.2019 Sabine Langmann
Result
bit.ly/sfx-2019
Yourcat.co.uk
vs.
TheFoodaholic.co.uk
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Yourcat.co.uk
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
How many links in editorial content?
How many internal/external?
bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
<div class=“post-body-container”>
bit.ly/sfx-2019
“How many links in editorial content?”
Suitable Xpath selector:
count(//div[@class="post-body-container"]//p//a)
12.04.2019 Sabine Langmann bit.ly/sfx-2019
“How many internal editorial links?”
Suitable Xpath selector:
count(//div[@class="post-body-container"]//p//a[
starts-with(@href, "https://www.yourcat.co.uk/")])
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Result
12.04.2019 Sabine Langmann bit.ly/sfx-2019
TheFoodaholic.co.uk
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
How many links in editorial content?
How many internal/external?
bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
“How many links in editorial content?”
Suitable Xpath selector:
count(//div[@itemprop="articleBody"]//p
//a[not(contains(@href, "wp-content"))])
12.04.2019 Sabine Langmann bit.ly/sfx-2019
“How many internal editorial links?”
Xpath selector:
count(//div[@itemprop="articleBody"]//p
//a[starts-with(@href, "http://www.thefoodaholic.co.uk")
and not(contains(@href, "wp-content"))])
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Result
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Level 5
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Recap:
Which data do I need?
Can I crawl the respective elements?
What is the right Xpath selector?
That‘s it!
12.04.2019 Sabine Langmann bit.ly/sfx-2019
More Xpath Cases,
SERP-Crawling, Regex,
…
12.04.2019 Sabine Langmann bit.ly/sfx-2019
12.04.2019 Sabine Langmann
Wait no more. Max
shows how!
bit.ly/sfx-2019
12.04.2019 Sabine Langmann bit.ly/sfx-2019
Thanks!!

More Related Content

What's hot

What's hot (20)

Small Tasks Make Big Changes - Shmulik Dorinbaum.pptx
Small Tasks Make Big Changes - Shmulik Dorinbaum.pptxSmall Tasks Make Big Changes - Shmulik Dorinbaum.pptx
Small Tasks Make Big Changes - Shmulik Dorinbaum.pptx
 
EAT: Have We Been Looking At It Backwards
EAT: Have We Been Looking At It BackwardsEAT: Have We Been Looking At It Backwards
EAT: Have We Been Looking At It Backwards
 
[BrightonSEO 2022] Unlocking the Hidden Potential of Product Listing Pages
[BrightonSEO 2022] Unlocking the Hidden Potential of Product Listing Pages[BrightonSEO 2022] Unlocking the Hidden Potential of Product Listing Pages
[BrightonSEO 2022] Unlocking the Hidden Potential of Product Listing Pages
 
Analisis de Contenidos SEO: método Triple A #SEOnderground 2022
Analisis de Contenidos SEO: método Triple A #SEOnderground 2022Analisis de Contenidos SEO: método Triple A #SEOnderground 2022
Analisis de Contenidos SEO: método Triple A #SEOnderground 2022
 
The Quickest Win in SEO – How to do Internal Linking the Right Way
The Quickest Win in SEO – How to do Internal Linking the Right WayThe Quickest Win in SEO – How to do Internal Linking the Right Way
The Quickest Win in SEO – How to do Internal Linking the Right Way
 
Data Driven Approach to Scale SEO at BrightonSEO 2023
Data Driven Approach to Scale SEO at BrightonSEO 2023Data Driven Approach to Scale SEO at BrightonSEO 2023
Data Driven Approach to Scale SEO at BrightonSEO 2023
 
How Big Publishers Prep for Tentpole Events
How Big Publishers Prep for Tentpole EventsHow Big Publishers Prep for Tentpole Events
How Big Publishers Prep for Tentpole Events
 
11 Advanced Uses of Screaming Frog Nov 2019 DMSS
11 Advanced Uses of Screaming Frog Nov 2019 DMSS11 Advanced Uses of Screaming Frog Nov 2019 DMSS
11 Advanced Uses of Screaming Frog Nov 2019 DMSS
 
Don't be a cannibal
Don't be a cannibalDon't be a cannibal
Don't be a cannibal
 
SEO-Campixx 2022 | Suchoperatoren auf Steroiden
SEO-Campixx 2022 | Suchoperatoren auf SteroidenSEO-Campixx 2022 | Suchoperatoren auf Steroiden
SEO-Campixx 2022 | Suchoperatoren auf Steroiden
 
How to Use Search Intent to Dominate Google Discover
How to Use Search Intent to Dominate Google DiscoverHow to Use Search Intent to Dominate Google Discover
How to Use Search Intent to Dominate Google Discover
 
Discover, pa’ tipos como tú: Los 13 factores para disparar tu tráfico
Discover, pa’ tipos como tú: Los 13 factores para disparar tu tráficoDiscover, pa’ tipos como tú: Los 13 factores para disparar tu tráfico
Discover, pa’ tipos como tú: Los 13 factores para disparar tu tráfico
 
Data-driven SEO & content strategy to reduce your customer acquisition costs
Data-driven SEO & content strategy to reduce your customer acquisition costsData-driven SEO & content strategy to reduce your customer acquisition costs
Data-driven SEO & content strategy to reduce your customer acquisition costs
 
Probabilistic Thinking in SEO - BrightonSEO October 2022
Probabilistic Thinking in SEO - BrightonSEO October 2022Probabilistic Thinking in SEO - BrightonSEO October 2022
Probabilistic Thinking in SEO - BrightonSEO October 2022
 
BrightonSEO - Apr 2022 - No excuses for doing UX
BrightonSEO - Apr 2022 - No excuses for doing UXBrightonSEO - Apr 2022 - No excuses for doing UX
BrightonSEO - Apr 2022 - No excuses for doing UX
 
Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...
Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...
Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...
 
The Value of Featured Snippets (BrightonSEO 2023).pdf
The Value of Featured Snippets (BrightonSEO 2023).pdfThe Value of Featured Snippets (BrightonSEO 2023).pdf
The Value of Featured Snippets (BrightonSEO 2023).pdf
 
How To EAT Links.pptx
How To EAT Links.pptxHow To EAT Links.pptx
How To EAT Links.pptx
 
Most Valuable SEO Presentation - Advanced Search Summit - DMO Advanced 2021 -...
Most Valuable SEO Presentation - Advanced Search Summit - DMO Advanced 2021 -...Most Valuable SEO Presentation - Advanced Search Summit - DMO Advanced 2021 -...
Most Valuable SEO Presentation - Advanced Search Summit - DMO Advanced 2021 -...
 
[LondonSEO 2020] BigQuery & SQL for SEOs
[LondonSEO 2020] BigQuery & SQL for SEOs[LondonSEO 2020] BigQuery & SQL for SEOs
[LondonSEO 2020] BigQuery & SQL for SEOs
 

More from Sabine Langmann

More from Sabine Langmann (6)

Sinnvolle Segmentierung im SEO.pdf
Sinnvolle Segmentierung im SEO.pdfSinnvolle Segmentierung im SEO.pdf
Sinnvolle Segmentierung im SEO.pdf
 
Screaming Frog ♥ KNIME: SEOkomm 2019
Screaming Frog ♥ KNIME: SEOkomm 2019Screaming Frog ♥ KNIME: SEOkomm 2019
Screaming Frog ♥ KNIME: SEOkomm 2019
 
Save Time With Basic Coding Skills - BrightonSEO September 2019
Save Time With Basic Coding Skills - BrightonSEO September 2019Save Time With Basic Coding Skills - BrightonSEO September 2019
Save Time With Basic Coding Skills - BrightonSEO September 2019
 
Screaming frog + Xpath - Campixx 2019
Screaming frog + Xpath - Campixx 2019Screaming frog + Xpath - Campixx 2019
Screaming frog + Xpath - Campixx 2019
 
Screaming frog + xpath en
Screaming frog + xpath enScreaming frog + xpath en
Screaming frog + xpath en
 
Sabine Langmann - Brighton SEO 2018 - How to expand to different markets
Sabine Langmann - Brighton SEO 2018 - How to expand to different marketsSabine Langmann - Brighton SEO 2018 - How to expand to different markets
Sabine Langmann - Brighton SEO 2018 - How to expand to different markets
 

Recently uploaded

Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdf
tbatkhuu1
 
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
The 100x Factor Growth with AI - Susan Diaz
The 100x Factor  Growth with AI - Susan DiazThe 100x Factor  Growth with AI - Susan Diaz

Recently uploaded (20)

Navigating the SEO of Tomorrow, Competitive Benchmarking, China as an e-Comme...
Navigating the SEO of Tomorrow, Competitive Benchmarking, China as an e-Comme...Navigating the SEO of Tomorrow, Competitive Benchmarking, China as an e-Comme...
Navigating the SEO of Tomorrow, Competitive Benchmarking, China as an e-Comme...
 
A.I. and The Social Media Shift - Mohit Rajhans
A.I. and The Social Media Shift - Mohit RajhansA.I. and The Social Media Shift - Mohit Rajhans
A.I. and The Social Media Shift - Mohit Rajhans
 
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting GroupSEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
 
Labour Day Celebrating Workers and Their Contributions.pptx
Labour Day Celebrating Workers and Their Contributions.pptxLabour Day Celebrating Workers and Their Contributions.pptx
Labour Day Celebrating Workers and Their Contributions.pptx
 
Uncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 ReportsUncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 Reports
 
Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdf
 
No Cookies No Problem - Steve Krull, Be Found Online
No Cookies No Problem - Steve Krull, Be Found OnlineNo Cookies No Problem - Steve Krull, Be Found Online
No Cookies No Problem - Steve Krull, Be Found Online
 
personal branding kit for music business
personal branding kit for music businesspersonal branding kit for music business
personal branding kit for music business
 
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
 
Chat GPT Master Class - Leslie Hughes, PUNCH Media
Chat GPT Master Class - Leslie Hughes, PUNCH MediaChat GPT Master Class - Leslie Hughes, PUNCH Media
Chat GPT Master Class - Leslie Hughes, PUNCH Media
 
Google 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
Google 3rd-Party Cookie Deprecation [Update] + 5 Best StrategiesGoogle 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
Google 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
 
W.H.Bender Quote 61 -Influential restaurant and food service industry network...
W.H.Bender Quote 61 -Influential restaurant and food service industry network...W.H.Bender Quote 61 -Influential restaurant and food service industry network...
W.H.Bender Quote 61 -Influential restaurant and food service industry network...
 
Cash payment girl 9257726604 Hand ✋ to Hand over girl
Cash payment girl 9257726604 Hand ✋ to Hand over girlCash payment girl 9257726604 Hand ✋ to Hand over girl
Cash payment girl 9257726604 Hand ✋ to Hand over girl
 
Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...
Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...
Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...
 
Unraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptxUnraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptx
 
Digital-Marketing-Into-by-Zoraiz-Ahmad.pptx
Digital-Marketing-Into-by-Zoraiz-Ahmad.pptxDigital-Marketing-Into-by-Zoraiz-Ahmad.pptx
Digital-Marketing-Into-by-Zoraiz-Ahmad.pptx
 
How to Create a Social Media Plan Like a Pro - Jordan Scheltgen
How to Create a Social Media Plan Like a Pro - Jordan ScheltgenHow to Create a Social Media Plan Like a Pro - Jordan Scheltgen
How to Create a Social Media Plan Like a Pro - Jordan Scheltgen
 
How to utilize calculated properties in your HubSpot setups
How to utilize calculated properties in your HubSpot setupsHow to utilize calculated properties in your HubSpot setups
How to utilize calculated properties in your HubSpot setups
 
Kraft Mac and Cheese campaign presentation
Kraft Mac and Cheese campaign presentationKraft Mac and Cheese campaign presentation
Kraft Mac and Cheese campaign presentation
 
The 100x Factor Growth with AI - Susan Diaz
The 100x Factor  Growth with AI - Susan DiazThe 100x Factor  Growth with AI - Susan Diaz
The 100x Factor Growth with AI - Susan Diaz
 

Screaming Frog + Xpath: BrightonSEO April 2019