SlideShare a Scribd company logo
1 of 73
Download to read offline
Screaming Frog + Xpath
Crawl specific page elements on your own or
competitor‘s websites
@Urlaubspiraten #SEO4Pirates Nr.6
Sabine Langmann
Level 1
23.08.2018 Sabine Langmann Bit.ly/abjsd
What is this about?
23.08.2018 Sabine Langmann Bit.ly/abjsd
We‘d like: to crawl specific
elements on our own web pages
or the ones of our competition
We use: Screaming Frog‘s
Custom Search + XPath
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Level 2
23.08.2018 Sabine Langmann Bit.ly/abjsd
Who am I?
Geek. SEO. Kuchen.
23.08.2018 Sabine Langmann Bit.ly/abjsd
Who am I?
http://sabine-langmann.com
https://www.linkedin.com/in/sabine-langmann/
@SabTheLa
@sababeille
23.08.2018 Sabine Langmann Bit.ly/abjsd
Slides available at:
https://www.slideshare.net/SabineLangmann
23.08.2018 Sabine Langmann Bit.ly/abjsd
Level 3Level 3
23.08.2018 Sabine Langmann Bit.ly/abjsd
Xpath
23.08.2018 Sabine Langmann Bit.ly/abjsd
XPath (XML Path Language) is a
query language
for selecting nodes
from an XML document.
Wikipedia
23.08.2018 Sabine Langmann Bit.ly/abjsd
Simple Syntax
node every page element (e.g. H2, a, p, div)
// adresses a certain node
attribute attribute of a node (e.g. class, id)
@ adresses a certain attribute
count() counts addressed nodes
23.08.2018 Sabine Langmann Bit.ly/abjsd
Simple Syntax
23.08.2018 Sabine Langmann
//node[@attribute="attribute_name"]
bit.ly/2o3vJ5O
Simple Syntax
23.08.2018 Sabine Langmann
count(//node[@attribute="attribute_name"])
bit.ly/2o3vJ5O
Level 4
23.08.2018 Sabine Langmann Bit.ly/abjsd
Some use cases
23.08.2018 Sabine Langmann Bit.ly/abjsd
Urlaubspiraten
vs.
Sonnenklar TV
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
How many images?
How many H2, H3, etc?
How many words?
How many links to which pages?
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
How many images?
How many H2, H3, etc?
How many words?
How many links to which pages?
Step #1
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #1
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #2
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #2
What am I searching for?
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #3
In
<div class="htmlContent">
I‘m searching for links, which is
<a>-Tags
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #3
Suitable Xpath selector:
//div[@class ="htmlContent"]//a
23.08.2018 Sabine Langmann Bit.ly/abjsd
3. Schritt
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #4
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #4
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Result
Result
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
usw.23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
In
<div class="container">
I‘m searching for
the number of H3
23.08.2018 Sabine Langmann Bit.ly/abjsd
Suitable Xpath selector:
count(//div[@class ="container"]//h3)
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Result
Result
23.08.2018 Sabine Langmann Bit.ly/abjsd
Gutscheinsammler
vs.
Sparwelt
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Which star rating?
How many words in the intro?
How many active coupon codes?
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Suitable Xpath selector:
//button[@data-vouchertype="is__discounts"]//span
23.08.2018 Sabine Langmann Bit.ly/abjsd
Result
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
How many active coupon codes?
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Suitable Xpath selector:
count(
//div[@class="media-list vouchers-active"]
//div[@class="col-xs-12 col-sm-5"]
//span[@class="text"]
)
23.08.2018 Sabine Langmann Bit.ly/abjsd
Result
23.08.2018 Sabine Langmann Bit.ly/abjsd
Kino.de
vs.
Serienjunkies
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
How many words in the description?
23.08.2018 Sabine Langmann Bit.ly/abjsd
Suitable Xpath selector:
//section[@class="smb-post-body"]//p
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Result
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
How many words in the description?
23.08.2018 Sabine Langmann Bit.ly/abjsd
Suitable Xpath selector:
//section//p
23.08.2018 Sabine Langmann Bit.ly/abjsd
23.08.2018 Sabine Langmann Bit.ly/abjsd
Result
23.08.2018 Sabine Langmann Bit.ly/abjsd
Level 5
23.08.2018 Sabine Langmann Bit.ly/abjsd
Recap:
Which data do I need?
Can I crawl the respective elements?
What is the right Xpath selector?
That‘s it!
23.08.2018 Sabine Langmann Bit.ly/abjsd
Screaming frog + xpath en

More Related Content

What's hot

What's hot (9)

Boston Area SharePoint Users Group November 9th, 2011 Meeting
Boston Area SharePoint Users Group November 9th, 2011 MeetingBoston Area SharePoint Users Group November 9th, 2011 Meeting
Boston Area SharePoint Users Group November 9th, 2011 Meeting
 
4/13/11 Boston Area SharePoint Users Group Meeting
4/13/11 Boston Area SharePoint Users Group Meeting4/13/11 Boston Area SharePoint Users Group Meeting
4/13/11 Boston Area SharePoint Users Group Meeting
 
7/14/10 Boston Area SharePoint Users Group Meeting
7/14/10 Boston Area SharePoint Users Group Meeting7/14/10 Boston Area SharePoint Users Group Meeting
7/14/10 Boston Area SharePoint Users Group Meeting
 
2/9/11 Boston Area SharePoint Users Group Meeting
2/9/11 Boston Area SharePoint Users Group Meeting2/9/11 Boston Area SharePoint Users Group Meeting
2/9/11 Boston Area SharePoint Users Group Meeting
 
Sistrix - SEO Do's and Don't
Sistrix - SEO Do's and Don'tSistrix - SEO Do's and Don't
Sistrix - SEO Do's and Don't
 
BASPUG Meeting deck from 7/11/12
BASPUG Meeting deck from 7/11/12BASPUG Meeting deck from 7/11/12
BASPUG Meeting deck from 7/11/12
 
Telling the Story of Your Content - SAScon 2016
Telling the Story of Your Content - SAScon 2016Telling the Story of Your Content - SAScon 2016
Telling the Story of Your Content - SAScon 2016
 
MAA Southeast Section Picture Slideshow
MAA Southeast Section Picture SlideshowMAA Southeast Section Picture Slideshow
MAA Southeast Section Picture Slideshow
 
Boston Area SharePoint Users Group January 11th, 2012 Meeting
Boston Area SharePoint Users Group January 11th, 2012 MeetingBoston Area SharePoint Users Group January 11th, 2012 Meeting
Boston Area SharePoint Users Group January 11th, 2012 Meeting
 

Recently uploaded

FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
dollysharma2066
 
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdf
tbatkhuu1
 

Recently uploaded (20)

Labour Day Celebrating Workers and Their Contributions.pptx
Labour Day Celebrating Workers and Their Contributions.pptxLabour Day Celebrating Workers and Their Contributions.pptx
Labour Day Celebrating Workers and Their Contributions.pptx
 
The+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdfThe+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdf
 
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
 
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
Riding the Wave of AI Disruption - Navigating the AI Fear Cycle in Marketing ...
 
Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdf
 
Brand Strategy Master Class - Juntae DeLane
Brand Strategy Master Class - Juntae DeLaneBrand Strategy Master Class - Juntae DeLane
Brand Strategy Master Class - Juntae DeLane
 
No Cookies No Problem - Steve Krull, Be Found Online
No Cookies No Problem - Steve Krull, Be Found OnlineNo Cookies No Problem - Steve Krull, Be Found Online
No Cookies No Problem - Steve Krull, Be Found Online
 
Google 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
Google 3rd-Party Cookie Deprecation [Update] + 5 Best StrategiesGoogle 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
Google 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
 
Social media, ppt. Features, characteristics
Social media, ppt. Features, characteristicsSocial media, ppt. Features, characteristics
Social media, ppt. Features, characteristics
 
Foundation First - Why Your Website and Content Matters - David Pisarek
Foundation First - Why Your Website and Content Matters - David PisarekFoundation First - Why Your Website and Content Matters - David Pisarek
Foundation First - Why Your Website and Content Matters - David Pisarek
 
BDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort Service
 
What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?
 
Chat GPT Master Class - Leslie Hughes, PUNCH Media
Chat GPT Master Class - Leslie Hughes, PUNCH MediaChat GPT Master Class - Leslie Hughes, PUNCH Media
Chat GPT Master Class - Leslie Hughes, PUNCH Media
 
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting GroupSEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
 
Unraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptxUnraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptx
 
A.I. and The Social Media Shift - Mohit Rajhans
A.I. and The Social Media Shift - Mohit RajhansA.I. and The Social Media Shift - Mohit Rajhans
A.I. and The Social Media Shift - Mohit Rajhans
 
BDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort Service
 
SEO for Revenue, Grow Your Business, Not Just Your Rankings - Dale Bertrand
SEO for Revenue, Grow Your Business, Not Just Your Rankings - Dale BertrandSEO for Revenue, Grow Your Business, Not Just Your Rankings - Dale Bertrand
SEO for Revenue, Grow Your Business, Not Just Your Rankings - Dale Bertrand
 
Unraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptxUnraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptx
 
Martal Group - B2B Lead Gen Agency - Onboarding Overview
Martal Group - B2B Lead Gen Agency - Onboarding OverviewMartal Group - B2B Lead Gen Agency - Onboarding Overview
Martal Group - B2B Lead Gen Agency - Onboarding Overview
 

Screaming frog + xpath en