SlideShare a Scribd company logo
1 of 40
Energy-Efficient Parallel Storage Systems with Write-Buffer Disks XiaojunRuan and Xiao Qin Computer Science and Software Engineering Samuel Ginn College of Engineering Auburn University
My Research Group: 2011
Overview of the Project Energy Efficiency Security Solid State Drives Performance of  Secure Disk Systems [IEEE NAS09] Design, Model,  Simulate, And Evaluate  Disk Systems with  Buffer Disks [ACM SAC09][ICPP09] Enhancing Internal  Parallelism of SSDs [To Be Submitted11] Message Passing  Interface with  Enhanced Security [IPCCC 2010] Energy-Efficient Distributed Storage Systems [IPCCC10] Energy-Efficient  Dynamic Voltage  Scaling[ICCCN07]  Xiaojun Ruan 3 BUD
4 6/10/2011 Electricity Usage in Data Centers Annual Data Center Electricity Usage and Electricity Price increase Every year
The average power consumption of TOP10 supercomputing systems is 1.32 Mwatt. Dell’s Texas Data Center 5 6/10/2011 Energy Efficiency of Supercomputers
Electrical Cost of Data Centers ,[object Object]
Server and Data Centers Consume 110 Billion kWh per year
Assume average commercial end user is charged 9.46 kWh
Disk systems can account for 27% of the energy cost of data centers6/10/2011 6 Server and data centers may have an electrical cost of 10.4 billion dollars.
7 6/10/2011 Energy Consumption of Disks
Power States of Disks    Active State: high energy consumption Active Standby State transition penalty    Standby State: low energy consumption 8
A Hard Disk Drive A10000RPM Hard Drive may take 10.9 seconds to wake up! 9
Parallel Disks Performance Energy Efficiency
Challanges Performance Oriented: ,[object Object]
 Huge Electricity Bills Energy Efficiency Oriented: ,[object Object]
 Small Electricity Bills,[object Object]
Reduce Status Transitions as many as possible12
IBM Ultrastar 36Z15 6/10/2011 13
A Parallel Disk System with a Write Buffer Disk
The BUD Architecture Data Disks can serve requests without buffer disks when workload is high 15
Auburn University	 16 Sum of Requests in Buffer (SRB) ,[object Object]
SRB is set by administrators
Once SRB is satisfied, spin up the targeted data disk, dump all those data, then spin the disk down.,[object Object]
Example Buffer Disk Requests Queue 18
Auburn University  Xiaojun Ruan 19 From Design to Simulation
Simulation Environment 20
Auburn University	 21 Workloads
Impact of SRB—Low Workload, UltraStar 22
Auburn University	 Xiaojun Ruan 23 Non-Buffer Experiments
Auburn University	 24 BUD with IBM 40GNX TravalStar
Buffer Disk Number and Workload-- UltraStar 25
Auburn University	 26 Energy Consumption E = Active Energy Consumption + Standby Energy Consumption + Transition Penalty
Auburn University  Xiaojun Ruan 27 From  Simulation to  Real Implementation
An Energy-Efficient Cluster Storage System 28
Implementation (no buffer disks) 29
Implementation (with buffer-disks) 30
Experimental Design ,[object Object]
Data Disk 1: WesternDigital 400, 20GB
Data Disk 2: WesternDigital 400, 20GB
Disk Category I/O Node 2

More Related Content

What's hot

[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014
[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014
[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014
Christin Panjaitan
 
Energy Efficient Prefetching – from Models to Implementation
Energy Efficient Prefetching – from Models to ImplementationEnergy Efficient Prefetching – from Models to Implementation
Energy Efficient Prefetching – from Models to Implementation
Xiao Qin
 

What's hot (20)

1. OCP workshop
1. OCP workshop1. OCP workshop
1. OCP workshop
 
Green computing
Green computingGreen computing
Green computing
 
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Dynamic heterogeneity aware resource ...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Dynamic heterogeneity aware resource ...IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Dynamic heterogeneity aware resource ...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Dynamic heterogeneity aware resource ...
 
3 3 nick_diorio_sam_battery
3 3 nick_diorio_sam_battery3 3 nick_diorio_sam_battery
3 3 nick_diorio_sam_battery
 
04 final - hobbs lave wvm solar portfolios - pvpmc
04 final - hobbs lave wvm solar portfolios - pvpmc04 final - hobbs lave wvm solar portfolios - pvpmc
04 final - hobbs lave wvm solar portfolios - pvpmc
 
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEYDYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
 
[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014
[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014
[COMPUTER ARCHITECTURE] Final Presentation_Spring 2014
 
Katerine Dykes: 2013 Sandia National Laboratoies Wind Plant Reliability Workshop
Katerine Dykes: 2013 Sandia National Laboratoies Wind Plant Reliability WorkshopKaterine Dykes: 2013 Sandia National Laboratoies Wind Plant Reliability Workshop
Katerine Dykes: 2013 Sandia National Laboratoies Wind Plant Reliability Workshop
 
Robust workload and energy management for sustainable data centers
Robust workload and energy management for sustainable data centersRobust workload and energy management for sustainable data centers
Robust workload and energy management for sustainable data centers
 
10766012 ranalitics
10766012 ranalitics10766012 ranalitics
10766012 ranalitics
 
1 4 epri sandia cuiffi 050916 43
1 4 epri sandia cuiffi 050916 431 4 epri sandia cuiffi 050916 43
1 4 epri sandia cuiffi 050916 43
 
Energy Efficient Prefetching – from Models to Implementation
Energy Efficient Prefetching – from Models to ImplementationEnergy Efficient Prefetching – from Models to Implementation
Energy Efficient Prefetching – from Models to Implementation
 
Nuclear Engineering in Bangladesh
Nuclear Engineering in BangladeshNuclear Engineering in Bangladesh
Nuclear Engineering in Bangladesh
 
FORECASTING OF RENEWABLE ENERGY PRODUCTION BY USING GENETIC ALGORITHM (GA) FO...
FORECASTING OF RENEWABLE ENERGY PRODUCTION BY USING GENETIC ALGORITHM (GA) FO...FORECASTING OF RENEWABLE ENERGY PRODUCTION BY USING GENETIC ALGORITHM (GA) FO...
FORECASTING OF RENEWABLE ENERGY PRODUCTION BY USING GENETIC ALGORITHM (GA) FO...
 
Data Center Blueprints: Open Compute
Data Center Blueprints: Open ComputeData Center Blueprints: Open Compute
Data Center Blueprints: Open Compute
 
Applications of PARALLEL PROCESSING
Applications of PARALLEL PROCESSING Applications of PARALLEL PROCESSING
Applications of PARALLEL PROCESSING
 
3 4 thevenard-pai epri-sandia 2016-05 presentation
3 4 thevenard-pai epri-sandia 2016-05 presentation3 4 thevenard-pai epri-sandia 2016-05 presentation
3 4 thevenard-pai epri-sandia 2016-05 presentation
 
An accumulative computation framework on MapReduce ppl2013
An accumulative computation framework on MapReduce ppl2013An accumulative computation framework on MapReduce ppl2013
An accumulative computation framework on MapReduce ppl2013
 
Meteo I/O Introduction
Meteo I/O IntroductionMeteo I/O Introduction
Meteo I/O Introduction
 
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Optimal power allocation and load dis...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Optimal power allocation and load dis...IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Optimal power allocation and load dis...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Optimal power allocation and load dis...
 

Similar to BUDW: Energy-Efficient Parallel Storage Systems with Write-Buffer Disks

Interface for Performance Environment Autoconfiguration Framework
Interface for Performance Environment Autoconfiguration FrameworkInterface for Performance Environment Autoconfiguration Framework
Interface for Performance Environment Autoconfiguration Framework
Liang Men
 
MRI Energy-Efficient Cloud Computing
MRI Energy-Efficient Cloud ComputingMRI Energy-Efficient Cloud Computing
MRI Energy-Efficient Cloud Computing
Roger Rafanell Mas
 
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMSENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
ijdms
 

Similar to BUDW: Energy-Efficient Parallel Storage Systems with Write-Buffer Disks (20)

Reliability Analysis for an Energy-Aware RAID System
Reliability Analysis for an Energy-Aware RAID SystemReliability Analysis for an Energy-Aware RAID System
Reliability Analysis for an Energy-Aware RAID System
 
Performance and Energy evaluation
Performance and Energy evaluationPerformance and Energy evaluation
Performance and Energy evaluation
 
CNR @ VMUG.IT 20150304
CNR @ VMUG.IT 20150304CNR @ VMUG.IT 20150304
CNR @ VMUG.IT 20150304
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
AI Sustainability Mascots 23-f.pptx
AI Sustainability Mascots 23-f.pptxAI Sustainability Mascots 23-f.pptx
AI Sustainability Mascots 23-f.pptx
 
Introduction to Warehouse-Scale Computers
Introduction to Warehouse-Scale ComputersIntroduction to Warehouse-Scale Computers
Introduction to Warehouse-Scale Computers
 
Wp 75-comparing-ups-system-design-configurations
Wp 75-comparing-ups-system-design-configurationsWp 75-comparing-ups-system-design-configurations
Wp 75-comparing-ups-system-design-configurations
 
Interface for Performance Environment Autoconfiguration Framework
Interface for Performance Environment Autoconfiguration FrameworkInterface for Performance Environment Autoconfiguration Framework
Interface for Performance Environment Autoconfiguration Framework
 
MRI Energy-Efficient Cloud Computing
MRI Energy-Efficient Cloud ComputingMRI Energy-Efficient Cloud Computing
MRI Energy-Efficient Cloud Computing
 
CDP_2(1).pptx
CDP_2(1).pptxCDP_2(1).pptx
CDP_2(1).pptx
 
Hptf 2240 Final
Hptf 2240 FinalHptf 2240 Final
Hptf 2240 Final
 
Tutorial-on-DNN-09A-Co-design-Sparsity.pdf
Tutorial-on-DNN-09A-Co-design-Sparsity.pdfTutorial-on-DNN-09A-Co-design-Sparsity.pdf
Tutorial-on-DNN-09A-Co-design-Sparsity.pdf
 
Dark silicon and the end of multicore scaling
Dark silicon and the end of multicore scalingDark silicon and the end of multicore scaling
Dark silicon and the end of multicore scaling
 
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMSENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
 
AI-Sustainability.pptx
AI-Sustainability.pptxAI-Sustainability.pptx
AI-Sustainability.pptx
 
CENTRE FOR DATA CENTER WITH DIAGRAMS.ppt
CENTRE FOR DATA CENTER WITH DIAGRAMS.pptCENTRE FOR DATA CENTER WITH DIAGRAMS.ppt
CENTRE FOR DATA CENTER WITH DIAGRAMS.ppt
 
GMC: Greening MapReduce Clusters Considering both Computation Energy and Cool...
GMC: Greening MapReduce Clusters Considering both Computation Energy and Cool...GMC: Greening MapReduce Clusters Considering both Computation Energy and Cool...
GMC: Greening MapReduce Clusters Considering both Computation Energy and Cool...
 
Energy Efficient Data Center
Energy Efficient Data CenterEnergy Efficient Data Center
Energy Efficient Data Center
 
G-SLAM:OPTIMIZING ENERGY EFFIIENCY IN CLOUD
G-SLAM:OPTIMIZING ENERGY EFFIIENCY IN CLOUDG-SLAM:OPTIMIZING ENERGY EFFIIENCY IN CLOUD
G-SLAM:OPTIMIZING ENERGY EFFIIENCY IN CLOUD
 
HYPPO - NECSTTechTalk 23/04/2020
HYPPO - NECSTTechTalk 23/04/2020HYPPO - NECSTTechTalk 23/04/2020
HYPPO - NECSTTechTalk 23/04/2020
 

More from Xiao Qin

P#1 stream of praise
P#1 stream of praiseP#1 stream of praise
P#1 stream of praise
Xiao Qin
 

More from Xiao Qin (20)

How to apply for internship positions?
How to apply for internship positions?How to apply for internship positions?
How to apply for internship positions?
 
How to write research papers? Version 5.0
How to write research papers? Version 5.0How to write research papers? Version 5.0
How to write research papers? Version 5.0
 
Making a competitive nsf career proposal: Part 2 Worksheet
Making a competitive nsf career proposal: Part 2 WorksheetMaking a competitive nsf career proposal: Part 2 Worksheet
Making a competitive nsf career proposal: Part 2 Worksheet
 
Making a competitive nsf career proposal: Part 1 Tips
Making a competitive nsf career proposal: Part 1 TipsMaking a competitive nsf career proposal: Part 1 Tips
Making a competitive nsf career proposal: Part 1 Tips
 
Auburn csse faculty orientation
Auburn csse faculty orientationAuburn csse faculty orientation
Auburn csse faculty orientation
 
Auburn CSSE graduate student orientation
Auburn CSSE graduate student orientationAuburn CSSE graduate student orientation
Auburn CSSE graduate student orientation
 
CSSE Graduate Programs Committee: Progress Report
CSSE Graduate Programs Committee: Progress ReportCSSE Graduate Programs Committee: Progress Report
CSSE Graduate Programs Committee: Progress Report
 
Project 2 How to modify os161: A Manual
Project 2 How to modify os161: A ManualProject 2 How to modify os161: A Manual
Project 2 How to modify os161: A Manual
 
Project 2 how to modify OS/161
Project 2 how to modify OS/161Project 2 how to modify OS/161
Project 2 how to modify OS/161
 
Project 2 how to install and compile os161
Project 2 how to install and compile os161Project 2 how to install and compile os161
Project 2 how to install and compile os161
 
Project 2 - how to compile os161?
Project 2 - how to compile os161?Project 2 - how to compile os161?
Project 2 - how to compile os161?
 
Understanding what our customer wants-slideshare
Understanding what our customer wants-slideshareUnderstanding what our customer wants-slideshare
Understanding what our customer wants-slideshare
 
OS/161 Overview
OS/161 OverviewOS/161 Overview
OS/161 Overview
 
Surviving a group project
Surviving a group projectSurviving a group project
Surviving a group project
 
P#1 stream of praise
P#1 stream of praiseP#1 stream of praise
P#1 stream of praise
 
Data center specific thermal and energy saving techniques
Data center specific thermal and energy saving techniquesData center specific thermal and energy saving techniques
Data center specific thermal and energy saving techniques
 
How to do research?
How to do research?How to do research?
How to do research?
 
COMP2710 Software Construction: header files
COMP2710 Software Construction: header filesCOMP2710 Software Construction: header files
COMP2710 Software Construction: header files
 
COMP2710: Software Construction - Linked list exercises
COMP2710: Software Construction - Linked list exercisesCOMP2710: Software Construction - Linked list exercises
COMP2710: Software Construction - Linked list exercises
 
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
HDFS-HC2: Analysis of Data Placement Strategy based on Computing Power of Nod...
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 

BUDW: Energy-Efficient Parallel Storage Systems with Write-Buffer Disks

Editor's Notes

  1. Web Servers they account for 24% of the energy, 77% proxy server, 27% in data center
  2. , then spin the data disk on, otherwise we always keep data disks in standby mode.
  3. SRB is small, transfer data from buffer disk to data disk for too many times. Small SRB, more spin up and spin down times.
  4. Trend is similar, but ultrastar penalty is higher
  5. MAID:GreenFS:Benefits: low energy cost, Flaws: low capacity, low reliability