SlideShare a Scribd company logo
1 of 26
Advanced network performance
measurement techniques
Dr Neil Davies
Predictable Network Solutions Ltd
Peter Thompson
Predictable Network Solutions Ltd
Martin Geddes
Martin Geddes Consulting Ltd
PREDICTABLE
NETWORK
SOLUTIONS
© 2013 All Rights Reserved
Dr Neil Davies
Co-founder, Predictable Network Solutions Ltd
Peter Thompson
CTO, Predictable Network Solutions Ltd
Martin Geddes
Founder, Martin Geddes Consulting Ltd
PREDICTABLE
NETWORK
SOLUTIONS
The only ex ante network performance
engineering company in the world.
Consultancy on the future of
telecoms and the Internet.
PREDICTABLE
NETWORK
SOLUTIONS
Context for this presentation
We are all in the business of “information translocation”
The timely movement of information from
one computational process to another
The value lies in delivering application outcomes
That people will pay for
You are reading this because you are interested in
delivering successful outcomes
And understanding the causes of failure, so they can be mitigated
You may be working in a culture of deflecting
the attribution of blame
We’d like to help you turn away from the path to the Dark Side
What affects the timeliness?
• The timeliness of application outcomes is dependent on the
end-to-end loss and delay characteristics of the
translocation
• We call this end-to-end property ∆Q
– ∆Q applies in each direction – not just the round trip
– These characteristics need to be suitably bounded
• ∆Q depends on the offered load
– “Bandwidth” is an aspect of the relationship between offered
load and ∆Q
This presentation is about measuring ∆Q
– and the benefits that approach brings
Good measurement is
NOT about averages
• The average number of legs of a Swedish person is 1.9
– Now find me one!
• Measuring average throughput on a 1Gb link over 10
mins is like measuring the traffic on the M5 motorway
over two years
– No indicator of my likely travel experience
• Need to know the instantaneous properties
– The ∆Q the “next packet” is going to get
• It is all about the probability distribution of quality
attenuation
– This is what determines timeliness of application outcomes
One-point measures
• This is the typical information captured by equipment
today
– Counters (e.g. packets passed, packet sizes, packets
dropped)
– Sampled over a period
• Does not capture ∆Q
– Not end-to-end
• Multiple one-point measures don’t help
• Creates an equipment-centric view
– Focuses on the equipment, not the service to the
customers
– Leads to focus on capacity, and ignores schedulability
Multipoint measures
• Measure a value between different points
– Not just counting things
• Same “information translocation” at various
points
– Measuring the dynamics of the flow
• Isolates issues, in both space and time
– Excellent diagnostic power
• Leads to a focus on schedulability and trading
– Which in turn focuses on the outcomes for the
customer
Different measurement approaches
Average Instantaneous
Single
Point
Offered Load
and Utilisation
(mean values only)
Limited predictive power
Arrival Patterns
Temporal predictive power,
localised assurance
(compliance with
arrival pattern policy)
Multiple
Point
Delay and Loss
(mean and variance)
Spatial predictive power
Temporal and spatial
predictive power
Assurance of both arrival and
service (demand and supply) –
represents all that can be known
about a system (by observation)
PLUS
PLUS
Interpreting the two-point measure
© Predictable Network Solutions 2013
Raw data: There’s no discernable structure here
– not possible to work with data like this.
Sort by packet size:
a clear structure
emerges
Serialisation (or
size-related) delay
S
Packets with bigger payloads experience more structural delay:
it takes longer to turn the packet into a bitstream, and back again into a packet
at the next network element .
© Predictable Network Solutions 2013
Geographic delay
Serialisation delay
Variable contention
delay
G
S
V
Example multi-point measure
The bi-directional, end-to-end path of a small cell
deployment over commodity infrastructure
How to read the information
• Different views tell different stories
• We’ll see some of those stories in the
following slides
• The focus on V is because that is where the
issues of schedulability manifest themselves
Key to following charts
Two point
measures (by time)
GSV view
(by packet)
V (by time) V (by packet size)
V cumulative
distribution
function (main)
V cumulative
distribution
function (tail)
E to A direction (user experience)Return Transit (run dd0a2310-d235-495b-8d2f-a4dc
0
0.05
0.1
0.15
0.2
0 50 100 150 200 250
delay(s)
run time (s)
Observed Delay against Experiment Run Time
E->A
0
0.05
0.1
0.15
0.2
0
delay(s)
0.02
0.04
0.06
0.08
0.1
0.12
0.14
delay(s)
Observed Delay Variability (V) against Experiment Run Time
E->A
0.02
0.04
0.06
0.08
0.1
0.12
0.14
delay(s)
Note the delay spike during the test run @ approx 60 seconds in
How can be begin to analyse this performance issue?
E -> A (by packet)
This ‘spike’ doesn’t appear to be related to a particular packet size
(note ‘striations’ in the S value is an artefact of 3GPP scheduling)
E -> A (Dynamic response)
Removing G and S influences clearly highlights
the magnitude of the contention issue
Spatial Isolation
Same magnitude
issue between D
to B
But not between
D and C
Spatial Isolation (2)
It is occurring
between C and B
NOTE: this is the effect that we are measuring
– NOT the cause (which in this case was not the access
network but elsewhere)
Armed with this information, we can begin to analyse root
causes (e.g. what is over-driving this link?)
∆Q for ADSL line
© Predictable Network Solutions 2013
Compare and contrast: baseline data for an ADSL line
∆Q for Femto (over ADSL)
© Predictable Network Solutions 2013
Now run a femtocell over that same line: much worse performance
Summary
• Multipoint distribution based measurement gives
access to all the information available through
observation
– “observation” is key – independent of equipment
– Captures the influence of technology etc
• G,S & V gives you a way of extracting both
temporal and spatial details
• Becomes extremely powerful when combined
with analysis
– E.g. you have a model of what V should be, or what G
and S should be given the network layout
Upcoming workshops:
Sustainable Public Service Networks
London, 19th September 2013
Fundamentals of
Network Performance
London, 20th September 2013
www.sustainablebroadband.com
PREDICTABLE
NETWORK
SOLUTIONS
Neil Davies
Neil.Davies@pnsol.com
Peter Thompson
Peter.Thompson@pnsol.com
Martin Geddes
mail@martingeddes.com
PREDICTABLE
NETWORK
SOLUTIONS

More Related Content

What's hot

FCC Open Internet Transparency - a review by Martin Geddes
FCC Open Internet Transparency - a review by Martin GeddesFCC Open Internet Transparency - a review by Martin Geddes
FCC Open Internet Transparency - a review by Martin GeddesMartin Geddes
 
Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’
Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’
Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’Martin Geddes
 
Network Cost and Performance Transformation Services
Network Cost and Performance Transformation ServicesNetwork Cost and Performance Transformation Services
Network Cost and Performance Transformation ServicesMartin Geddes
 
BT Operate Case Study
BT Operate Case StudyBT Operate Case Study
BT Operate Case StudyMartin Geddes
 
What is a 'polyservice' network?
What is a 'polyservice' network?What is a 'polyservice' network?
What is a 'polyservice' network?Martin Geddes
 
Stationarity is the new speed
Stationarity is the new speedStationarity is the new speed
Stationarity is the new speedMartin Geddes
 
Introduction to network quality arbitrage
Introduction to network quality arbitrageIntroduction to network quality arbitrage
Introduction to network quality arbitrageMartin Geddes
 
Sample proposal summary for quality arbitrage business unit
Sample proposal summary for quality arbitrage business unitSample proposal summary for quality arbitrage business unit
Sample proposal summary for quality arbitrage business unitMartin Geddes
 
Network performance - skilled craft to hard science
Network performance - skilled craft to hard scienceNetwork performance - skilled craft to hard science
Network performance - skilled craft to hard scienceMartin Geddes
 
Connect, Interact, Transact
Connect, Interact, TransactConnect, Interact, Transact
Connect, Interact, TransactMartin Geddes
 
CARE initiative technical prospectus
CARE initiative technical prospectusCARE initiative technical prospectus
CARE initiative technical prospectusMartin Geddes
 
Digital supply chain quality management
Digital supply chain quality managementDigital supply chain quality management
Digital supply chain quality managementMartin Geddes
 
The Properties and Mathematics of Data Transport Quality
The Properties and Mathematics of Data Transport QualityThe Properties and Mathematics of Data Transport Quality
The Properties and Mathematics of Data Transport QualityMartin Geddes
 
Navigating the Uncertain World Facing Service Providers - Juniper's Perspective
Navigating the Uncertain World Facing Service Providers - Juniper's PerspectiveNavigating the Uncertain World Facing Service Providers - Juniper's Perspective
Navigating the Uncertain World Facing Service Providers - Juniper's PerspectiveJuniper Networks
 
Performance and Supply Chain Management for the Software Telco
Performance and  Supply Chain Management for the Software TelcoPerformance and  Supply Chain Management for the Software Telco
Performance and Supply Chain Management for the Software TelcoMartin Geddes
 
IEEE Cloud computing 2016 Title and Abstract
IEEE Cloud computing 2016 Title and AbstractIEEE Cloud computing 2016 Title and Abstract
IEEE Cloud computing 2016 Title and Abstracttsysglobalsolutions
 
Study on reliability optimization problem of computer By Dharmendra Singh[Srm...
Study on reliability optimization problem of computer By Dharmendra Singh[Srm...Study on reliability optimization problem of computer By Dharmendra Singh[Srm...
Study on reliability optimization problem of computer By Dharmendra Singh[Srm...Dharmendrasingh417
 
Advanced techno-economic modelling of distribution network investment require...
Advanced techno-economic modelling of distribution network investment require...Advanced techno-economic modelling of distribution network investment require...
Advanced techno-economic modelling of distribution network investment require...Power System Operation
 

What's hot (20)

FCC Open Internet Transparency - a review by Martin Geddes
FCC Open Internet Transparency - a review by Martin GeddesFCC Open Internet Transparency - a review by Martin Geddes
FCC Open Internet Transparency - a review by Martin Geddes
 
Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’
Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’
Addicted to speed: Why broadband service providers need a ‘healthier lifestyle’
 
Network Cost and Performance Transformation Services
Network Cost and Performance Transformation ServicesNetwork Cost and Performance Transformation Services
Network Cost and Performance Transformation Services
 
BT Operate Case Study
BT Operate Case StudyBT Operate Case Study
BT Operate Case Study
 
What is a 'polyservice' network?
What is a 'polyservice' network?What is a 'polyservice' network?
What is a 'polyservice' network?
 
Stationarity is the new speed
Stationarity is the new speedStationarity is the new speed
Stationarity is the new speed
 
Introduction to network quality arbitrage
Introduction to network quality arbitrageIntroduction to network quality arbitrage
Introduction to network quality arbitrage
 
Sample proposal summary for quality arbitrage business unit
Sample proposal summary for quality arbitrage business unitSample proposal summary for quality arbitrage business unit
Sample proposal summary for quality arbitrage business unit
 
Network performance - skilled craft to hard science
Network performance - skilled craft to hard scienceNetwork performance - skilled craft to hard science
Network performance - skilled craft to hard science
 
Connect, Interact, Transact
Connect, Interact, TransactConnect, Interact, Transact
Connect, Interact, Transact
 
CARE initiative technical prospectus
CARE initiative technical prospectusCARE initiative technical prospectus
CARE initiative technical prospectus
 
Digital supply chain quality management
Digital supply chain quality managementDigital supply chain quality management
Digital supply chain quality management
 
The Properties and Mathematics of Data Transport Quality
The Properties and Mathematics of Data Transport QualityThe Properties and Mathematics of Data Transport Quality
The Properties and Mathematics of Data Transport Quality
 
Navigating the Uncertain World Facing Service Providers - Juniper's Perspective
Navigating the Uncertain World Facing Service Providers - Juniper's PerspectiveNavigating the Uncertain World Facing Service Providers - Juniper's Perspective
Navigating the Uncertain World Facing Service Providers - Juniper's Perspective
 
Performance and Supply Chain Management for the Software Telco
Performance and  Supply Chain Management for the Software TelcoPerformance and  Supply Chain Management for the Software Telco
Performance and Supply Chain Management for the Software Telco
 
IEEE Cloud computing 2016 Title and Abstract
IEEE Cloud computing 2016 Title and AbstractIEEE Cloud computing 2016 Title and Abstract
IEEE Cloud computing 2016 Title and Abstract
 
Study on reliability optimization problem of computer By Dharmendra Singh[Srm...
Study on reliability optimization problem of computer By Dharmendra Singh[Srm...Study on reliability optimization problem of computer By Dharmendra Singh[Srm...
Study on reliability optimization problem of computer By Dharmendra Singh[Srm...
 
The Overture ΔQ testbed for design and deployment planning
The Overture ΔQ testbed for design and deployment planningThe Overture ΔQ testbed for design and deployment planning
The Overture ΔQ testbed for design and deployment planning
 
Advanced techno-economic modelling of distribution network investment require...
Advanced techno-economic modelling of distribution network investment require...Advanced techno-economic modelling of distribution network investment require...
Advanced techno-economic modelling of distribution network investment require...
 
Chapter 02
Chapter 02Chapter 02
Chapter 02
 

Similar to Advanced network performance measurement techniques

Future of Broadband workshop presentation - ITU Telecom World 2013
Future of Broadband workshop presentation - ITU Telecom World 2013Future of Broadband workshop presentation - ITU Telecom World 2013
Future of Broadband workshop presentation - ITU Telecom World 2013Martin Geddes
 
Smart Grids and Big Data
Smart Grids and Big DataSmart Grids and Big Data
Smart Grids and Big DataDave Callaghan
 
Capgemini ses - smart grid operational services - where to start - five fou...
Capgemini   ses - smart grid operational services - where to start - five fou...Capgemini   ses - smart grid operational services - where to start - five fou...
Capgemini ses - smart grid operational services - where to start - five fou...Gord Reynolds
 
Data Science, Knowledge Discover, Mining and Learning
Data Science, Knowledge Discover, Mining and LearningData Science, Knowledge Discover, Mining and Learning
Data Science, Knowledge Discover, Mining and LearningEUBrasilCloudFORUM .
 
OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...
OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...
OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...IRJET Journal
 
A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...
A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...
A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...IRJET Journal
 
Overlapped clustering approach for maximizing the service reliability of
Overlapped clustering approach for maximizing the service reliability ofOverlapped clustering approach for maximizing the service reliability of
Overlapped clustering approach for maximizing the service reliability ofIAEME Publication
 
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...IRJET Journal
 
IRJET- AC Duct Monitoring and Cleaning Vehicle for Train Coaches
IRJET- AC Duct Monitoring and Cleaning Vehicle for Train CoachesIRJET- AC Duct Monitoring and Cleaning Vehicle for Train Coaches
IRJET- AC Duct Monitoring and Cleaning Vehicle for Train CoachesIRJET Journal
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSijwscjournal
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSijwscjournal
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSijwscjournal
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSijwscjournal
 
Optimal Transmission Expansion Planning Using Biogeography...
Optimal Transmission Expansion Planning Using Biogeography...Optimal Transmission Expansion Planning Using Biogeography...
Optimal Transmission Expansion Planning Using Biogeography...Leslie Sanchez
 
IRJET- Cost Effective Scheme for Delay Tolerant Data Transmission
IRJET- Cost Effective Scheme for Delay Tolerant Data TransmissionIRJET- Cost Effective Scheme for Delay Tolerant Data Transmission
IRJET- Cost Effective Scheme for Delay Tolerant Data TransmissionIRJET Journal
 
Accounting Value Effects for Responsible Networking
Accounting Value Effects for Responsible NetworkingAccounting Value Effects for Responsible Networking
Accounting Value Effects for Responsible NetworkingGiovanni Sileno
 
Traffic Prediction from Street Network images.pptx
Traffic Prediction from  Street Network images.pptxTraffic Prediction from  Street Network images.pptx
Traffic Prediction from Street Network images.pptxchirantanGupta1
 
Short Data Rules for Observability.pdf
Short Data Rules for Observability.pdfShort Data Rules for Observability.pdf
Short Data Rules for Observability.pdfDave McAllister
 
IEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and AbstractIEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and Abstracttsysglobalsolutions
 

Similar to Advanced network performance measurement techniques (20)

Future of Broadband workshop presentation - ITU Telecom World 2013
Future of Broadband workshop presentation - ITU Telecom World 2013Future of Broadband workshop presentation - ITU Telecom World 2013
Future of Broadband workshop presentation - ITU Telecom World 2013
 
Smart Grids and Big Data
Smart Grids and Big DataSmart Grids and Big Data
Smart Grids and Big Data
 
Capgemini ses - smart grid operational services - where to start - five fou...
Capgemini   ses - smart grid operational services - where to start - five fou...Capgemini   ses - smart grid operational services - where to start - five fou...
Capgemini ses - smart grid operational services - where to start - five fou...
 
Data Science, Knowledge Discover, Mining and Learning
Data Science, Knowledge Discover, Mining and LearningData Science, Knowledge Discover, Mining and Learning
Data Science, Knowledge Discover, Mining and Learning
 
OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...
OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...
OPTIMIZED ROUTING AND DENIAL OF SERVICE FOR ROBUST TRANSMISSION IN WIRELESS N...
 
A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...
A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...
A Survey on A Secure Anti-Collusion Data Sharing Scheme for Dynamic Groups in...
 
Data Segregation
Data SegregationData Segregation
Data Segregation
 
Overlapped clustering approach for maximizing the service reliability of
Overlapped clustering approach for maximizing the service reliability ofOverlapped clustering approach for maximizing the service reliability of
Overlapped clustering approach for maximizing the service reliability of
 
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
 
IRJET- AC Duct Monitoring and Cleaning Vehicle for Train Coaches
IRJET- AC Duct Monitoring and Cleaning Vehicle for Train CoachesIRJET- AC Duct Monitoring and Cleaning Vehicle for Train Coaches
IRJET- AC Duct Monitoring and Cleaning Vehicle for Train Coaches
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
 
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONSA COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
 
Optimal Transmission Expansion Planning Using Biogeography...
Optimal Transmission Expansion Planning Using Biogeography...Optimal Transmission Expansion Planning Using Biogeography...
Optimal Transmission Expansion Planning Using Biogeography...
 
IRJET- Cost Effective Scheme for Delay Tolerant Data Transmission
IRJET- Cost Effective Scheme for Delay Tolerant Data TransmissionIRJET- Cost Effective Scheme for Delay Tolerant Data Transmission
IRJET- Cost Effective Scheme for Delay Tolerant Data Transmission
 
Accounting Value Effects for Responsible Networking
Accounting Value Effects for Responsible NetworkingAccounting Value Effects for Responsible Networking
Accounting Value Effects for Responsible Networking
 
Traffic Prediction from Street Network images.pptx
Traffic Prediction from  Street Network images.pptxTraffic Prediction from  Street Network images.pptx
Traffic Prediction from Street Network images.pptx
 
Short Data Rules for Observability.pdf
Short Data Rules for Observability.pdfShort Data Rules for Observability.pdf
Short Data Rules for Observability.pdf
 
IEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and AbstractIEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and Abstract
 

More from Martin Geddes

Martin Geddes Livestream - March 2018
Martin Geddes Livestream - March 2018Martin Geddes Livestream - March 2018
Martin Geddes Livestream - March 2018Martin Geddes
 
Example high-fidelity network measures using ∆Q metrics
Example high-fidelity network measures using ∆Q metricsExample high-fidelity network measures using ∆Q metrics
Example high-fidelity network measures using ∆Q metricsMartin Geddes
 
Superfast or superfit? The case for UK broadband policy reform
Superfast or superfit? The case for UK broadband policy reformSuperfast or superfit? The case for UK broadband policy reform
Superfast or superfit? The case for UK broadband policy reformMartin Geddes
 
Broadband service quality - rationing or markets?
Broadband service quality - rationing or markets?Broadband service quality - rationing or markets?
Broadband service quality - rationing or markets?Martin Geddes
 
The End of Information Technology: Introducing Hypersense & Human Technology
The End of Information Technology: Introducing Hypersense & Human TechnologyThe End of Information Technology: Introducing Hypersense & Human Technology
The End of Information Technology: Introducing Hypersense & Human TechnologyMartin Geddes
 
Evaluating the internet end-user experience in the Russian Federation
Evaluating the internet end-user experience in the Russian FederationEvaluating the internet end-user experience in the Russian Federation
Evaluating the internet end-user experience in the Russian FederationMartin Geddes
 
Beasts to superheroes to gods
Beasts to superheroes to godsBeasts to superheroes to gods
Beasts to superheroes to godsMartin Geddes
 
Beyond 'neutrality' - how to reconnect regulation to reality?
Beyond 'neutrality' - how to reconnect regulation to reality?Beyond 'neutrality' - how to reconnect regulation to reality?
Beyond 'neutrality' - how to reconnect regulation to reality?Martin Geddes
 
The perception gap: the barrier to disruptive innovation in telecoms
The perception gap: the barrier to disruptive innovation in telecomsThe perception gap: the barrier to disruptive innovation in telecoms
The perception gap: the barrier to disruptive innovation in telecomsMartin Geddes
 
Lastingham - Parish mast report
Lastingham - Parish mast reportLastingham - Parish mast report
Lastingham - Parish mast reportMartin Geddes
 
The technology zeitgeist
The technology zeitgeistThe technology zeitgeist
The technology zeitgeistMartin Geddes
 
The business world in 2025
The business world in 2025The business world in 2025
The business world in 2025Martin Geddes
 
A Study of Traffic Management Detection Methods & Tools
A Study of Traffic Management Detection Methods & ToolsA Study of Traffic Management Detection Methods & Tools
A Study of Traffic Management Detection Methods & ToolsMartin Geddes
 
Hypertext to Hypervoice - The next stage in collaboration on the Web
Hypertext to Hypervoice - The next stage in collaboration on the WebHypertext to Hypervoice - The next stage in collaboration on the Web
Hypertext to Hypervoice - The next stage in collaboration on the WebMartin Geddes
 
Network cost & risk transformation
Network cost & risk transformationNetwork cost & risk transformation
Network cost & risk transformationMartin Geddes
 
How to get more out of the network?
How to get more out of the network?How to get more out of the network?
How to get more out of the network?Martin Geddes
 

More from Martin Geddes (18)

Martin Geddes Livestream - March 2018
Martin Geddes Livestream - March 2018Martin Geddes Livestream - March 2018
Martin Geddes Livestream - March 2018
 
Example high-fidelity network measures using ∆Q metrics
Example high-fidelity network measures using ∆Q metricsExample high-fidelity network measures using ∆Q metrics
Example high-fidelity network measures using ∆Q metrics
 
Superfast or superfit? The case for UK broadband policy reform
Superfast or superfit? The case for UK broadband policy reformSuperfast or superfit? The case for UK broadband policy reform
Superfast or superfit? The case for UK broadband policy reform
 
Broadband service quality - rationing or markets?
Broadband service quality - rationing or markets?Broadband service quality - rationing or markets?
Broadband service quality - rationing or markets?
 
The End of Information Technology: Introducing Hypersense & Human Technology
The End of Information Technology: Introducing Hypersense & Human TechnologyThe End of Information Technology: Introducing Hypersense & Human Technology
The End of Information Technology: Introducing Hypersense & Human Technology
 
The Guardian Avatar
The Guardian AvatarThe Guardian Avatar
The Guardian Avatar
 
Evaluating the internet end-user experience in the Russian Federation
Evaluating the internet end-user experience in the Russian FederationEvaluating the internet end-user experience in the Russian Federation
Evaluating the internet end-user experience in the Russian Federation
 
Beasts to superheroes to gods
Beasts to superheroes to godsBeasts to superheroes to gods
Beasts to superheroes to gods
 
Beyond 'neutrality' - how to reconnect regulation to reality?
Beyond 'neutrality' - how to reconnect regulation to reality?Beyond 'neutrality' - how to reconnect regulation to reality?
Beyond 'neutrality' - how to reconnect regulation to reality?
 
Superfit broadband
Superfit broadbandSuperfit broadband
Superfit broadband
 
The perception gap: the barrier to disruptive innovation in telecoms
The perception gap: the barrier to disruptive innovation in telecomsThe perception gap: the barrier to disruptive innovation in telecoms
The perception gap: the barrier to disruptive innovation in telecoms
 
Lastingham - Parish mast report
Lastingham - Parish mast reportLastingham - Parish mast report
Lastingham - Parish mast report
 
The technology zeitgeist
The technology zeitgeistThe technology zeitgeist
The technology zeitgeist
 
The business world in 2025
The business world in 2025The business world in 2025
The business world in 2025
 
A Study of Traffic Management Detection Methods & Tools
A Study of Traffic Management Detection Methods & ToolsA Study of Traffic Management Detection Methods & Tools
A Study of Traffic Management Detection Methods & Tools
 
Hypertext to Hypervoice - The next stage in collaboration on the Web
Hypertext to Hypervoice - The next stage in collaboration on the WebHypertext to Hypervoice - The next stage in collaboration on the Web
Hypertext to Hypervoice - The next stage in collaboration on the Web
 
Network cost & risk transformation
Network cost & risk transformationNetwork cost & risk transformation
Network cost & risk transformation
 
How to get more out of the network?
How to get more out of the network?How to get more out of the network?
How to get more out of the network?
 

Recently uploaded

Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 

Recently uploaded (20)

Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 

Advanced network performance measurement techniques

  • 1. Advanced network performance measurement techniques Dr Neil Davies Predictable Network Solutions Ltd Peter Thompson Predictable Network Solutions Ltd Martin Geddes Martin Geddes Consulting Ltd PREDICTABLE NETWORK SOLUTIONS © 2013 All Rights Reserved
  • 2. Dr Neil Davies Co-founder, Predictable Network Solutions Ltd Peter Thompson CTO, Predictable Network Solutions Ltd Martin Geddes Founder, Martin Geddes Consulting Ltd PREDICTABLE NETWORK SOLUTIONS
  • 3. The only ex ante network performance engineering company in the world. Consultancy on the future of telecoms and the Internet. PREDICTABLE NETWORK SOLUTIONS
  • 4. Context for this presentation We are all in the business of “information translocation” The timely movement of information from one computational process to another The value lies in delivering application outcomes That people will pay for You are reading this because you are interested in delivering successful outcomes And understanding the causes of failure, so they can be mitigated You may be working in a culture of deflecting the attribution of blame We’d like to help you turn away from the path to the Dark Side
  • 5. What affects the timeliness? • The timeliness of application outcomes is dependent on the end-to-end loss and delay characteristics of the translocation • We call this end-to-end property ∆Q – ∆Q applies in each direction – not just the round trip – These characteristics need to be suitably bounded • ∆Q depends on the offered load – “Bandwidth” is an aspect of the relationship between offered load and ∆Q This presentation is about measuring ∆Q – and the benefits that approach brings
  • 6. Good measurement is NOT about averages • The average number of legs of a Swedish person is 1.9 – Now find me one! • Measuring average throughput on a 1Gb link over 10 mins is like measuring the traffic on the M5 motorway over two years – No indicator of my likely travel experience • Need to know the instantaneous properties – The ∆Q the “next packet” is going to get • It is all about the probability distribution of quality attenuation – This is what determines timeliness of application outcomes
  • 7. One-point measures • This is the typical information captured by equipment today – Counters (e.g. packets passed, packet sizes, packets dropped) – Sampled over a period • Does not capture ∆Q – Not end-to-end • Multiple one-point measures don’t help • Creates an equipment-centric view – Focuses on the equipment, not the service to the customers – Leads to focus on capacity, and ignores schedulability
  • 8. Multipoint measures • Measure a value between different points – Not just counting things • Same “information translocation” at various points – Measuring the dynamics of the flow • Isolates issues, in both space and time – Excellent diagnostic power • Leads to a focus on schedulability and trading – Which in turn focuses on the outcomes for the customer
  • 9. Different measurement approaches Average Instantaneous Single Point Offered Load and Utilisation (mean values only) Limited predictive power Arrival Patterns Temporal predictive power, localised assurance (compliance with arrival pattern policy) Multiple Point Delay and Loss (mean and variance) Spatial predictive power Temporal and spatial predictive power Assurance of both arrival and service (demand and supply) – represents all that can be known about a system (by observation) PLUS PLUS
  • 10. Interpreting the two-point measure © Predictable Network Solutions 2013 Raw data: There’s no discernable structure here – not possible to work with data like this.
  • 11. Sort by packet size: a clear structure emerges
  • 12. Serialisation (or size-related) delay S Packets with bigger payloads experience more structural delay: it takes longer to turn the packet into a bitstream, and back again into a packet at the next network element . © Predictable Network Solutions 2013
  • 14. Example multi-point measure The bi-directional, end-to-end path of a small cell deployment over commodity infrastructure
  • 15. How to read the information • Different views tell different stories • We’ll see some of those stories in the following slides • The focus on V is because that is where the issues of schedulability manifest themselves
  • 16. Key to following charts Two point measures (by time) GSV view (by packet) V (by time) V (by packet size) V cumulative distribution function (main) V cumulative distribution function (tail)
  • 17. E to A direction (user experience)Return Transit (run dd0a2310-d235-495b-8d2f-a4dc 0 0.05 0.1 0.15 0.2 0 50 100 150 200 250 delay(s) run time (s) Observed Delay against Experiment Run Time E->A 0 0.05 0.1 0.15 0.2 0 delay(s) 0.02 0.04 0.06 0.08 0.1 0.12 0.14 delay(s) Observed Delay Variability (V) against Experiment Run Time E->A 0.02 0.04 0.06 0.08 0.1 0.12 0.14 delay(s) Note the delay spike during the test run @ approx 60 seconds in How can be begin to analyse this performance issue?
  • 18. E -> A (by packet) This ‘spike’ doesn’t appear to be related to a particular packet size (note ‘striations’ in the S value is an artefact of 3GPP scheduling)
  • 19. E -> A (Dynamic response) Removing G and S influences clearly highlights the magnitude of the contention issue
  • 20. Spatial Isolation Same magnitude issue between D to B But not between D and C
  • 21. Spatial Isolation (2) It is occurring between C and B NOTE: this is the effect that we are measuring – NOT the cause (which in this case was not the access network but elsewhere) Armed with this information, we can begin to analyse root causes (e.g. what is over-driving this link?)
  • 22. ∆Q for ADSL line © Predictable Network Solutions 2013 Compare and contrast: baseline data for an ADSL line
  • 23. ∆Q for Femto (over ADSL) © Predictable Network Solutions 2013 Now run a femtocell over that same line: much worse performance
  • 24. Summary • Multipoint distribution based measurement gives access to all the information available through observation – “observation” is key – independent of equipment – Captures the influence of technology etc • G,S & V gives you a way of extracting both temporal and spatial details • Becomes extremely powerful when combined with analysis – E.g. you have a model of what V should be, or what G and S should be given the network layout
  • 25. Upcoming workshops: Sustainable Public Service Networks London, 19th September 2013 Fundamentals of Network Performance London, 20th September 2013 www.sustainablebroadband.com PREDICTABLE NETWORK SOLUTIONS
  • 26. Neil Davies Neil.Davies@pnsol.com Peter Thompson Peter.Thompson@pnsol.com Martin Geddes mail@martingeddes.com PREDICTABLE NETWORK SOLUTIONS

Editor's Notes

  1. There is a branch of mathematics called Large Deviation Theory that does have something to say about the predictive power of averages. And what it says is not very comforting – in the sense what it means in terms as a predictor of underlying hazards and risks – i.e. it is pretty bad. Capturing distribution gives the ability to assure that arrival patterns are within specification (see QTA’s later)Multipoint measurement gives some level of spatial identification – but suffers from the same issues as A, in that it remains a bad predictor of the hazards and risks.This is the measurement nirvana – it turns out that multipoint instantaneous observation makes available all the information that is possible by observation. In a well designed system this, by the principle of observational bisimularity, is the ultimate evidence of correct operation – including its performance aspects.Although there are people who have prided themselves on capturing (average) data over smaller (and smaller) timescales – the real issue is the number of events that occur in those timeslots. This is where the M5 (major holiday highway in UK) analogy comes in – the number of possible “events” 10 minutes on a 1Gb Ethernet (i.e. packets) is broadly equivalent to the number of events (cars on a three lane highway) in two year. For “averaging” to make sense you would need to be generating them over 20ms to 250ms intervals – no one can afford that.
  2. Note that S is not a number, it is a function from packet size to delay. S is not necessarily a simple line, it may have a more complex structure depending on media quantisation (eg ATM cells, WiFi) and bearer allocation choices (eg 3GPP).