SlideShare a Scribd company logo
1 of 32
Download to read offline
Evaluation of
     Virtual
    Clusters
  Performance
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa

 Introduction

 Hypothesis

 Goals                  Evaluation of Virtual Clusters Performance on
 Methods
                              a Cloud Computing Infrastructure
 Results

 Conclusions

                                Nuno Cardoso, Tito Vieira and Jorge G. Barbosa

                                         Universidade do Porto, Faculdade de Engenharia


                                                         November 4, 2011

Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 1 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                             Outline
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito     1 Introduction
  Vieira and
   Jorge G.
   Barbosa
                   2 Hypothesis
 Introduction

 Hypothesis
                   3 Goals
 Goals

 Methods

 Results           4 Methods
 Conclusions

                   5 Results

                   6 Conclusions



Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 1 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                       User’s perspective
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa

                        • Increase of computing needs
 Introduction

 Hypothesis
                        • Lack of flexibility
 Goals
                            • SW requirements different from the available
 Methods
                            • Permissions to the available platforms are restricted
 Results
                            • Clusters exist for specific applications
 Conclusions




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 2 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                               Provider’s perspective
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.             • High energy cost
   Barbosa

 Introduction           • HW aging without proper use
 Hypothesis

 Goals
                        • SW is tightly coupled with HW leading to:
 Methods                    • Difficult and lengthy migrations
 Results
                            • Inflexibility
 Conclusions
                            • Difficult substitution of failing components

                        • Difficulty in meeting users’ requirements




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 3 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                      Hypothesis
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa

 Introduction

 Hypothesis         Cloud Computing enables a better usage of the available
 Goals              hardware without seriously compromising performance.
 Methods

 Results

 Conclusions




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 4 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                                 Goals
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa
                        • Explore the creation steps of an IaaS Cloud:
 Introduction               • In an academic context
 Hypothesis                 • Using both specialized and non-specialized hardware
 Goals                      • Using open source technologies
 Methods
                        • Evaluate the losses introduced by virtualization
 Results

 Conclusions
                        • Analyze the benefits of the Cloud paradigm




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 5 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                             Resources characterization (1)
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa
                       • More non-specialized HW
 Introduction            than specialized HW
 Hypothesis            • Specialized HW older than
 Goals                   non-specialized HW
 Methods
                               • Inferior performance
 Results                       • Higher energy
 Conclusions                      consumption                                Specialized: 256 Cores   Non-Specialized: 3328 Cores


                               • Closer to failure
                                                                               Figure: Computer resources




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 6 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                             Resources characterization (2)
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa

 Introduction
                       • High uptimes
 Hypothesis                • 70% > 40m
 Goals
                           • 42% > 1h30
 Methods               • Low loads
 Results
                       • Possibility of running jobs                               10 < t <= 40: 30%    40 < t <= 90: 28%
 Conclusions                                                                       90 < t <= 160: 23%   160 < t <= 250: 11%
                           during those periods                                    250 < t <= 360: 5%   360 < t <= 490: 3%




                                                                          Figure: Non-specialized HW
                                                                          uptimes




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 7 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                             Resources characterization (3)
   on a Cloud
   Computing
 Infrastructure
                       • Tier 1 nodes:
     Nuno
 Cardoso, Tito             • Hardware:
  Vieira and
   Jorge G.
                                      • 2x Intel Xeon X3440
   Barbosa                              (4 cores each)
                                      • 24GB RAM
 Introduction
                                      • GbE network
 Hypothesis
                               • Operating System:
 Goals
                                  Debian GNU/Linux 6
 Methods
                       • Tiers 2 and 3 nodes:
 Results
                           • Hardware:
 Conclusions
                                      • Intel Core 2 Quad
                                        Q9300 (4 cores)
                                      • 4GB RAM                                   Figure: Multi-tier setup
                                      • GbE network
                               • Operating System:
                                  Ubuntu FEUP

Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 8 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                  Technologies
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and                    Infrastructure                                          Benchmarks
   Jorge G.
   Barbosa             • Debian GNU/Linux 6                                   • Phoronix Test Suite 3.2
 Introduction
                       • OpenNebula 2.0.1                                     • HPCC 1.4.1
 Hypothesis

 Goals
                       • KVM 0.12.5                                           • OpenMPI 1.4.2
 Methods

 Results               • OpenVPN 2.1                                          • Condor 7.4.4
 Conclusions

                       • OpenSSH 5.5                                          • Riak 0.14.1

                                                                              • Cassandra 0.7.5




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 9 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud   November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                Benchmark Summary
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.                             Name                                   Scope
   Barbosa
                                     Deployment                            Infrastructure
 Introduction
                                       Phoronix                        CPU/RAM, Disk IO
 Hypothesis
                                        HPCC                       CPU/RAM, Network, HPC
 Goals

 Methods
                                        Condor                         Infrastructure, HTC
 Results
                                   Distributed DBs                  Infrastructure, Databases
 Conclusions
                                                   Table: Benchmark Summary




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 10 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                    Deployment
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
                                                                   Setup
   Jorge G.
   Barbosa           S1:                   1 node → 1 VM

 Introduction
                     S2, S4 and S6:            1 node at 1x, 2x and 4x capacity (8,16 and 32 VMs)

 Hypothesis          S3, S5 and S7:            2 nodes at 0.5x, 1x and 2x capacity (8,16 and 32 VMs)
 Goals
                                                                    VMs
 Methods

 Results
                         • 1 Virtual CPU
 Conclusions             • 1GB RAM
                         • 2GB Disk (image: 500MB)
                         • 4GB Swap




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 11 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                       Deployment
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
                              Results
  Vieira and
   Jorge G.
                       • 1 VM → ∼ 1.8 sec
   Barbosa
                               • Elastic capabilities
 Introduction                  • Enables duplication of
 Hypothesis                        VMs/Clusters
                                                                                         Request     Transfer    Boot
 Goals                 • Transfer bottleneck:                                             Avg          Avg       Avg
 Methods                                                                          S1       0.6         2.2       216.0
                           Distributed storage
                                                                                  S2       0.1         1.9       245.4
 Results                                                                          S3       0.1         1.3       228.5
                       • Processing power                                         S4       0.1         1.1       466.7
 Conclusions
                                                                                  S5       0.1         1.3       243.8
                           bottleneck:                                            S6       0.1         1.5       717.4
                           More physical resources                                S7       0.1         1.0       418.2

                                                                             Table: Benchmark results(sec)




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 12 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                Benchmark Summary
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.                             Name                                   Scope
   Barbosa
                                     Deployment                            Infrastructure
 Introduction
                                       Phoronix                        CPU/RAM, Disk IO
 Hypothesis

 Goals
                                        HPCC                       CPU/RAM, Network, HPC
 Methods
                                        Condor                         Infrastructure, HTC
 Results                           Distributed DBs                  Infrastructure, Databases
 Conclusions
                                                   Table: Benchmark Summary




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 13 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                    Phoronix Test Suite
   on a Cloud
   Computing
 Infrastructure                        Setup                                     Application                       Loss
                                                                                 Bullet Physics Engine 2.75      1.29%
     Nuno
 Cardoso, Tito         • Virtualized vs.                                         C-Ray 1.1                       0.67%
  Vieira and                                                                     FFmpeg 0.6.1                    5.39%
   Jorge G.              Non-Virtualized                                         FLAC Audio Encoding 1.2.1       1.43%
   Barbosa                                                                       GraphicsMagick 1.3.12           2.33%
                       • Two Categories:                                         John The Ripper 1.7.3.1         0.64%
                                                                                 LAME MP3 Encoding 3.98.2        4.46%
 Introduction                  • CPU intensive                                   OpenSSL 1.0.0a                  0.55%
                                                                                 Smallpt 1.0                     0.74%
 Hypothesis                    • IO intensive
 Goals
                                      Results                                       Table: CPU intensive
 Methods

 Results
                       • CPU virtualization → Low                                 Application                     Loss
                                                                                  Dbench 4.0 1                 -55.34%
 Conclusions               overhead       (avg: 1.71%)                            Flexible IO Tester 1.21       73.12%
                                                                                  PostMark 1.51               -363.33%
                       • IO virtualization → High                                 SQLite 3.7.3                  -5.37%
                                                                                  7-Zip Compression 9.13         6.68%
                           overhead       (avg w/o gains: 22.51%)                 GnuPG 1.4.10                   1.26%
                                                                                  Unpacking linux-2.6.32        35.53%
                       • Needing further analysis:                                x264 2010-11-22               10.95%
                                                                                  Compile linux-2.6.32           4.90%
                           Cache
                                                                                      Table: IO intensive

Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 14 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                Benchmark Summary
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.                             Name                                   Scope
   Barbosa
                                     Deployment                            Infrastructure
 Introduction
                                       Phoronix                        CPU/RAM, Disk IO
 Hypothesis

 Goals
                                        HPCC                       CPU/RAM, Network, HPC
 Methods
                                        Condor                         Infrastructure, HTC
 Results                           Distributed DBs                  Infrastructure, Databases
 Conclusions
                                                   Table: Benchmark Summary




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 15 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                  HPCC - Single Node
   on a Cloud
   Computing
 Infrastructure                        Setup                                                      HPL
                                                                                                     1

     Nuno                                                                                             0.8
 Cardoso, Tito         • 8 processes                                           PTRANS
                                                                                                      0.6
                                                                                                                   Latency


  Vieira and
                                                                                                      0.4
   Jorge G.
   Barbosa             • 1 Computer (8 cores)                                                         0.2
                                                                          Random
                                                                                                                        Bandwidth
                                                                          Access
 Introduction
                       • Several “PxQ” and “N”’s
 Hypothesis

 Goals
                       • Virt. vs. Non-virt.                                       FFTE                            DGEMM

 Methods

 Results
                                 Results                                                         STREAM
                                                                                                 VM         Host

 Conclusions
                        Spatial/Temporal Locality
                                                                                 Figure: Result comparison
                              High: Low losses
                                                                                                         Temporal
                                         (HPL: 2.2%)                                                  Low          High
                                                                                          Low    Random Access     FFT
                                                                            Spatial
                                                                                                   PTRANS         HPL
                               Low: High losses                                           High
                                                                                                   STREAM         DGEMM

                                         (RandomAccess: 35%)
                                                                                      Table: Data Locality

Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 16 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                           HPCC - Multiple Nodes
   on a Cloud
   Computing
 Infrastructure                        Setup                                                      HPL
                                                                                                     1

     Nuno                                                                                             0.8
 Cardoso, Tito         • 16 processes (2x8)                                    PTRANS
                                                                                                      0.6
                                                                                                                   Latency


  Vieira and
                                                                                                      0.4
   Jorge G.
   Barbosa             • 2 Computer (16 cores)                                                        0.2
                                                                          Random
                                                                                                                        Bandwidth
                                                                          Access
 Introduction
                       • Several “PxQ” and “N”’s
 Hypothesis

 Goals
                       • Virt. vs. Non-virt.                                       FFTE                            DGEMM

 Methods

 Results
                              Results                                                            STREAM
                                                                                                 VM         Host

 Conclusions
                      Huge impact on networking:
                                                                                 Figure: Result comparison
                         Latency: 563% increase
                                                                                                         Temporal
                                                                                                      Low          High
                     Bandwidth: 70% decrease                                Spatial
                                                                                          Low    Random Access     FFT
                                                                                          High     PTRANS         HPL
                                                                                                   STREAM         DGEMM


                                                                                      Table: Data Locality

Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 17 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                Benchmark Summary
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.                             Name                                   Scope
   Barbosa
                                     Deployment                            Infrastructure
 Introduction
                                       Phoronix                        CPU/RAM, Disk IO
 Hypothesis

 Goals
                                        HPCC                       CPU/RAM, Network, HPC
 Methods
                                        Condor                         Infrastructure, HTC
 Results                           Distributed DBs                  Infrastructure, Databases
 Conclusions
                                                   Table: Benchmark Summary




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 18 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                              Condor
   on a Cloud
   Computing
 Infrastructure                                Setup
     Nuno
 Cardoso, Tito         • S1: Baseline
  Vieira and
   Jorge G.                8 VMs → 4 (Tier 1) Computers
   Barbosa

 Introduction
                       • S2: Scalability/Resource
 Hypothesis                exploitation
 Goals                     8 + 15 VMs → 4 (Tier 1) + 15 (Tier 2) Computers

 Methods

 Results
                       • S3: Elasticity/Resource exploitation
 Conclusions               15 VMs → 15 (Tier 3, 10a.m. until 19p.m.) Computers

                                                                                          Figure: Multi-tier setup
                       • Job: Subdivided into 10 minute
                           chunks, Embarrassingly Parallel

                       • VMs: 4 CPUs, 3GB RAM


Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 19 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                              Condor
   on a Cloud
   Computing
 Infrastructure

     Nuno
                                                                 Results
 Cardoso, Tito
  Vieira and             • Execution times:
   Jorge G.
   Barbosa                   • 1 VM: 1 month (extrapolated)
                             • S1: 29 hours
 Introduction
                             • S2: 10 hours
 Hypothesis
                             • S3: 74 hours (extrapolated)
 Goals

 Methods                 • Nearly linear gain
 Results

 Conclusions             • Possibility of using HW in both dedicated (S1 and S2) and
                            non-dedicated (S3) fashions

                         • Enables using unexploited (Tiers 2 and 3) HW to perform
                            tasks with no extra expense


Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 20 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                Benchmark Summary
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.                             Name                                   Scope
   Barbosa
                                     Deployment                            Infrastructure
 Introduction
                                       Phoronix                        CPU/RAM, Disk IO
 Hypothesis

 Goals
                                        HPCC                       CPU/RAM, Network, HPC
 Methods
                                        Condor                         Infrastructure, HTC
 Results                           Distributed DBs                  Infrastructure, Databases
 Conclusions
                                                   Table: Benchmark Summary




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 21 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                               Distributed Databases
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
                                                                   Setup
  Vieira and
   Jorge G.              • Baseline
   Barbosa
                            6 nodes (2 CPUs, 4GB RAM), 1GB data per node
 Introduction

 Hypothesis
                         • S1: Elasticity
 Goals                      Start from baseline; add 1 node; measure latencies
 Methods

 Results
                         • S2: Scalability
 Conclusions                Start from baseline; scale up to 12 nodes while measuring latencies

                         • Databases:
                             • Riak
                             • Cassandra




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 22 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                               Distributed Databases
   on a Cloud
   Computing
 Infrastructure
                                      Results                              2000 ms


                                                                           1500 ms
     Nuno
 Cardoso, Tito
                       • IO was a bottleneck
                                                                           1000 ms
  Vieira and
   Jorge G.                                                                 500 ms
   Barbosa             • S1: The Cloud introduced
                                                                              0 ms
                           elasticity in the cluster




                                                                                     0m

                                                                                           5m

                                                                                                  10m

                                                                                                           15m

                                                                                                                 20m

                                                                                                                       25m

                                                                                                                             30m

                                                                                                                                   35m

                                                                                                                                          40m

                                                                                                                                                45m

                                                                                                                                                      50m

                                                                                                                                                            55m

                                                                                                                                                                  60m
 Introduction

 Hypothesis
                           with a transient (15 min)                                                       Cassandra               Riak



 Goals                     overhead
                                                                                                Figure: S1 Result
 Methods

 Results
                       • S2: The cluster scaled                            20 ms
                                                                           19 ms

 Conclusions               while maintaining latency                       18 ms
                                                                           17 ms
                           constant (4 ms variation)                       16 ms
                                                                           15 ms
                                                                           14 ms
                                                                           13 ms
                                                                                          6N            7N      8N       9N       10       11      12
                                                                                            ode           ode      ode      ode      Nod      Nod     Nod
                                                                                                s             s        s        s        es      es      es

                                                                                                           Cassandra                Riak




                                                                                                Figure: S2 Result
Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 23 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                     Conclusions
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito       Dynamic architecture enabled:
  Vieira and
   Jorge G.              •   Performance scaling
   Barbosa
                         •   Cluster duplication
 Introduction            •   Redundancy creation
 Hypothesis              •   Increase infrastructure’s capabilities by using non-specialized HW
 Goals
                     Performance losses
 Methods

 Results
                         • IO → Depends on cache’s efficiency, normally high (around 20%)
 Conclusions
                         • Networking → High (Latency: 563% increase, Bandwidth: 70% decrease)
                         • CPU → Depends on the data locality:
                                 • High → Low (≤ 5%)
                                 • Low → High (≤ 35%)




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 24 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                   Future Work
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa

 Introduction        Evaluate other setups
 Hypothesis              • Xen, VirtualBox, VMWare, etc.
 Goals                   • Different IO modules/configurations
 Methods                 • OpenStack, Nimbus, Eucalyptus, etc.
 Results

 Conclusions




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 25 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                                  Q&A
   on a Cloud
   Computing
 Infrastructure

     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa

 Introduction

 Hypothesis

 Goals

 Methods
                                                                       ?
 Results

 Conclusions




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 26 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                                                                              Backup
   on a Cloud
   Computing
 Infrastructure                 140 %
     Nuno                       100 %
 Cardoso, Tito
  Vieira and                      60 %
   Jorge G.
                       Gain

   Barbosa                        20 %

 Introduction                   −20 %
 Hypothesis                     −60 %
 Goals                         −100 %
 Methods                       −140 %
 Results                               1000        2000         4000        8000        16000       32000        46336
 Conclusions
                                                                    Problem Size
                                         VM (resources x 2)                           HOST (resources x 2)
                                         VM (resources x 4)                           HOST (resources x 4)


                              Figure: HPL performance gain by increasing processing power


Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 27 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                     Backup - HPL Benchmark Results
   on a Cloud
   Computing
 Infrastructure
                                                       (8 processes)
     Nuno                                                       Problem Size
 Cardoso, Tito                PxQ         2K         4K         8K     16K             32K         46K        Avg
  Vieira and
   Jorge G.
                              1x8         12.4       23.0       28.4   30.2            29.3        28.9       25.4
   Barbosa                    2x4         12.9       20.3       25.5   27.7            28.5        28.6       23.9
                              4x2         9.4        16.7       24.0   28.3            32.3        31.9       23.8
 Introduction                 8x1         11.0       12.2       20.5   30.3            36.7        38.2       24.8
 Hypothesis                   Avg         11.4       18.0       24.6   29.1            31.7        31.9       24.5
 Goals
                                                         Table: VM (GFlops)
 Methods

 Results                                                        Problem Size
                              PxQ         2K         4K         8K     16K             32K         46K        Avg
 Conclusions
                              1x8         13.3       23.9       30.3   33.1            33.1        33.3       27.9
                              2x4         9.9        20.5       28.3   32.2            32.7        33.0       26.1
                              4x2         9.1        17.4       26.2   32.4            35.7        35.3       26.0
                              8x1         8.2        8.6        16.8   27.8            36.5        38.8       22.8
                              Avg         10.2       17.6       25.4   31.4            34.5        35.1       25.7

                                                         Table: Host (GFlops)


Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 28 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                     Backup - HPL Benchmark Results
   on a Cloud
   Computing
 Infrastructure
                                                       (8 processes)
     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa
                                                                Problem      Size
 Introduction               PxQ          2K          4K          8K         16K         32K         46K         Avg
 Hypothesis                 1x8          7.0         3.9         6.3         8.8        11.7        13.2        9.0
                            2x4         -29.8        1.1         9.7        14.0        13.0        13.6        3.6
 Goals
                            4x2          -2.5        4.2         8.2        12.6         9.6         9.7        7.0
 Methods                    8x1         -33.9       -41.6       -22.0       -8.9        -0.6         1.6       -17.6
 Results                    Avg         -12.4        -2.4        3.0         7.2         8.2         9.2        2.2
 Conclusions
                                                   Table: Performance Loss(%)




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 29 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                     Backup - HPL Benchmark Results
   on a Cloud
   Computing
 Infrastructure
                                                      (16 processes)
                                                                Problem Size
     Nuno                     PxQ          2K        4K         8K     16K             32K        46K         Avg
 Cardoso, Tito
  Vieira and
                              1x16         1.6       3.0         6.1   12.7            25.3       34.0        13.8
   Jorge G.                    2x8         3.5       7.3        14.8   27.7            42.3       47.0        23.8
   Barbosa                     4x4         5.9       14.4       28.7   41.1            50.9       54.2        32.5
                               8x2         7.9       13.5       26.3   43.8            59.4       65.7        36.1
 Introduction
                              16x1         1.3       3.0         6.5   12.4            22.4       29.7        12.8
 Hypothesis                   Avg          4.0       8.3        16.5   27.6            40.0       46.1        23.8
 Goals
                                                    Table: VM Results(GFlops)
 Methods

 Results                                                        Problem Size
 Conclusions                  PxQ          2K        4K         8K     16K             32K        46K         Avg
                              1x16         3.4       6.8        14.7   28.0            43.2       50.3        24.4
                               2x8         5.8       13.7       26.9   44.0            55.6       58.6        34.1
                               4x4         5.2       15.6       35.2   51.4            61.2       63.5        38.7
                               8x2         7.6       11.0       24.3   44.8            63.0       69.8        36.7
                              16x1         3.1       6.5        11.4   21.8            37.4       46.9        21.2
                              Avg          5.0       10.7       22.5   38.0            52.0       57.8        31.0

                                                   Table: Host Results(GFlops)
Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 30 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
Evaluation of
     Virtual
    Clusters
  Performance
                                     Backup - HPL Benchmark Results
   on a Cloud
   Computing
 Infrastructure
                                                      (16 processes)
     Nuno
 Cardoso, Tito
  Vieira and
   Jorge G.
   Barbosa
                                                                 Problem Size
 Introduction
                             PxQ           2K         4K         8K     16K             32K         46K         Avg
                             1x16          54.1       56.3       58.2   54.5            41.4        32.2        49.5
 Hypothesis
                              2x8          39.4       46.5       44.9   36.9            23.9        19.6        35.2
 Goals                        4x4         -12.7       7.9        18.5   20.0            16.8        14.6        10.9
 Methods                      8x2          -4.3      -23.0       -8.1    2.2             5.6         5.9        -3.6
                             16x1          56.6       52.6       42.9   42.9            40.2        36.8        45.3
 Results
                             Avg           20.6       28.1       31.3   31.3            25.6        21.8        27.4
 Conclusions
                                                   Table: Performance Loss(%)




Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 31 / 26
                                           Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011

More Related Content

Similar to Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure

Summit 16: Cengn Experience in Opnfv Projects
Summit 16: Cengn Experience in Opnfv ProjectsSummit 16: Cengn Experience in Opnfv Projects
Summit 16: Cengn Experience in Opnfv ProjectsOPNFV
 
Automation Failover in Openstack
Automation Failover in OpenstackAutomation Failover in Openstack
Automation Failover in Openstackjannahyusoff1
 
BDSE 2015 Evaluation of Big Data Platforms with HiBench
BDSE 2015 Evaluation of Big Data Platforms with HiBenchBDSE 2015 Evaluation of Big Data Platforms with HiBench
BDSE 2015 Evaluation of Big Data Platforms with HiBencht_ivanov
 
Ceph on the Brain: Storage and Data-Movement Supporting the Human Brain Project
Ceph on the Brain: Storage and Data-Movement Supporting the Human Brain ProjectCeph on the Brain: Storage and Data-Movement Supporting the Human Brain Project
Ceph on the Brain: Storage and Data-Movement Supporting the Human Brain Projectinside-BigData.com
 
FIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future PerspectivesFIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future PerspectivesFIBRE Testbed
 
Big Data Benchmarking Tutorial
Big Data Benchmarking TutorialBig Data Benchmarking Tutorial
Big Data Benchmarking TutorialTilmann Rabl
 
MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...
MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...
MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...Stephen Aylward
 
Pc.&.network.technology june.2012
Pc.&.network.technology june.2012Pc.&.network.technology june.2012
Pc.&.network.technology june.2012NATHEEN
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.pptVipin Singhal
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.pptgeminass1
 
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio..."Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...Edge AI and Vision Alliance
 
Networking Challenges for the Next Decade
Networking Challenges for the Next DecadeNetworking Challenges for the Next Decade
Networking Challenges for the Next DecadeOpen Networking Summit
 

Similar to Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure (20)

Summit 16: Cengn Experience in Opnfv Projects
Summit 16: Cengn Experience in Opnfv ProjectsSummit 16: Cengn Experience in Opnfv Projects
Summit 16: Cengn Experience in Opnfv Projects
 
Automation chapt 3
Automation chapt 3Automation chapt 3
Automation chapt 3
 
Cloud Validation Suite Presentation for Webinar: Cloud and Earth Observation ...
Cloud Validation Suite Presentation for Webinar: Cloud and Earth Observation ...Cloud Validation Suite Presentation for Webinar: Cloud and Earth Observation ...
Cloud Validation Suite Presentation for Webinar: Cloud and Earth Observation ...
 
Automation Failover in Openstack
Automation Failover in OpenstackAutomation Failover in Openstack
Automation Failover in Openstack
 
BDSE 2015 Evaluation of Big Data Platforms with HiBench
BDSE 2015 Evaluation of Big Data Platforms with HiBenchBDSE 2015 Evaluation of Big Data Platforms with HiBench
BDSE 2015 Evaluation of Big Data Platforms with HiBench
 
01-06 OCRE Test Suite - Fernandes.pdf
01-06 OCRE Test Suite - Fernandes.pdf01-06 OCRE Test Suite - Fernandes.pdf
01-06 OCRE Test Suite - Fernandes.pdf
 
Deep Learning Initiative @ NECSTLab
Deep Learning Initiative @ NECSTLabDeep Learning Initiative @ NECSTLab
Deep Learning Initiative @ NECSTLab
 
Ceph on the Brain: Storage and Data-Movement Supporting the Human Brain Project
Ceph on the Brain: Storage and Data-Movement Supporting the Human Brain ProjectCeph on the Brain: Storage and Data-Movement Supporting the Human Brain Project
Ceph on the Brain: Storage and Data-Movement Supporting the Human Brain Project
 
OCRE webinar - April 14 - Cloud_Validation_Suite_Ignacio Peluaga Lozada.pdf
OCRE webinar - April 14 - Cloud_Validation_Suite_Ignacio Peluaga Lozada.pdfOCRE webinar - April 14 - Cloud_Validation_Suite_Ignacio Peluaga Lozada.pdf
OCRE webinar - April 14 - Cloud_Validation_Suite_Ignacio Peluaga Lozada.pdf
 
FIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future PerspectivesFIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future Perspectives
 
FIBRE testbed
FIBRE testbed FIBRE testbed
FIBRE testbed
 
Big Data Benchmarking Tutorial
Big Data Benchmarking TutorialBig Data Benchmarking Tutorial
Big Data Benchmarking Tutorial
 
MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...
MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...
MONAI: Medical imaging AI for data scientists and developers @ 3D Slicer Proj...
 
Pc.&.network.technology june.2012
Pc.&.network.technology june.2012Pc.&.network.technology june.2012
Pc.&.network.technology june.2012
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.ppt
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.ppt
 
CloudComputingJun28.ppt
CloudComputingJun28.pptCloudComputingJun28.ppt
CloudComputingJun28.ppt
 
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio..."Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
 
Cloud Testing Framework
Cloud Testing FrameworkCloud Testing Framework
Cloud Testing Framework
 
Networking Challenges for the Next Decade
Networking Challenges for the Next DecadeNetworking Challenges for the Next Decade
Networking Challenges for the Next Decade
 

More from EuroCloud

Cloudy Datacenter Survey
Cloudy Datacenter SurveyCloudy Datacenter Survey
Cloudy Datacenter SurveyEuroCloud
 
A Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban ScanningA Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban ScanningEuroCloud
 
Cities in the Cloud
Cities in the CloudCities in the Cloud
Cities in the CloudEuroCloud
 
Building an Outsourcing Ecosystem for Science
Building an Outsourcing Ecosystem for ScienceBuilding an Outsourcing Ecosystem for Science
Building an Outsourcing Ecosystem for ScienceEuroCloud
 
Self Optimizing transactional data grids for elastic cloud environments
Self Optimizing transactional data grids for elastic cloud environmentsSelf Optimizing transactional data grids for elastic cloud environments
Self Optimizing transactional data grids for elastic cloud environmentsEuroCloud
 
Cloudviews eurocloud rcosta
Cloudviews eurocloud rcostaCloudviews eurocloud rcosta
Cloudviews eurocloud rcostaEuroCloud
 
Cloud views2010 google docs privacy
Cloud views2010   google docs privacyCloud views2010   google docs privacy
Cloud views2010 google docs privacyEuroCloud
 
Cil 2010 cloud comp1.0
Cil 2010 cloud comp1.0Cil 2010 cloud comp1.0
Cil 2010 cloud comp1.0EuroCloud
 
CardMobili @ CloudViews2010
CardMobili @ CloudViews2010CardMobili @ CloudViews2010
CardMobili @ CloudViews2010EuroCloud
 
Hive solutions cloudviews 2010 presentation
Hive solutions cloudviews 2010 presentationHive solutions cloudviews 2010 presentation
Hive solutions cloudviews 2010 presentationEuroCloud
 
Closetask 10 mins en
Closetask 10 mins enClosetask 10 mins en
Closetask 10 mins enEuroCloud
 
Apresentacao produtiv cloud views
Apresentacao   produtiv cloud viewsApresentacao   produtiv cloud views
Apresentacao produtiv cloud viewsEuroCloud
 
Apresentação novastic mp
Apresentação novastic mpApresentação novastic mp
Apresentação novastic mpEuroCloud
 
Ap4 construction platform_presentation_cloud_views_2010
Ap4 construction platform_presentation_cloud_views_2010Ap4 construction platform_presentation_cloud_views_2010
Ap4 construction platform_presentation_cloud_views_2010EuroCloud
 
2010.05.21 invicta angels cloud views.callforbusiness
2010.05.21 invicta angels cloud views.callforbusiness2010.05.21 invicta angels cloud views.callforbusiness
2010.05.21 invicta angels cloud views.callforbusinessEuroCloud
 
Luis lima v3
Luis lima v3Luis lima v3
Luis lima v3EuroCloud
 
Fx apresentacao evento cloudview 2010
Fx apresentacao evento cloudview 2010Fx apresentacao evento cloudview 2010
Fx apresentacao evento cloudview 2010EuroCloud
 

More from EuroCloud (20)

Cloudy Datacenter Survey
Cloudy Datacenter SurveyCloudy Datacenter Survey
Cloudy Datacenter Survey
 
A Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban ScanningA Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban Scanning
 
Cities in the Cloud
Cities in the CloudCities in the Cloud
Cities in the Cloud
 
Building an Outsourcing Ecosystem for Science
Building an Outsourcing Ecosystem for ScienceBuilding an Outsourcing Ecosystem for Science
Building an Outsourcing Ecosystem for Science
 
Self Optimizing transactional data grids for elastic cloud environments
Self Optimizing transactional data grids for elastic cloud environmentsSelf Optimizing transactional data grids for elastic cloud environments
Self Optimizing transactional data grids for elastic cloud environments
 
Cloudviews eurocloud rcosta
Cloudviews eurocloud rcostaCloudviews eurocloud rcosta
Cloudviews eurocloud rcosta
 
Cloud views2010 google docs privacy
Cloud views2010   google docs privacyCloud views2010   google docs privacy
Cloud views2010 google docs privacy
 
Cil 2010 cloud comp1.0
Cil 2010 cloud comp1.0Cil 2010 cloud comp1.0
Cil 2010 cloud comp1.0
 
CardMobili @ CloudViews2010
CardMobili @ CloudViews2010CardMobili @ CloudViews2010
CardMobili @ CloudViews2010
 
Muchbeta
MuchbetaMuchbeta
Muchbeta
 
Hive solutions cloudviews 2010 presentation
Hive solutions cloudviews 2010 presentationHive solutions cloudviews 2010 presentation
Hive solutions cloudviews 2010 presentation
 
Closetask 10 mins en
Closetask 10 mins enClosetask 10 mins en
Closetask 10 mins en
 
Cardmobili
CardmobiliCardmobili
Cardmobili
 
Apresentacao produtiv cloud views
Apresentacao   produtiv cloud viewsApresentacao   produtiv cloud views
Apresentacao produtiv cloud views
 
Apresentação novastic mp
Apresentação novastic mpApresentação novastic mp
Apresentação novastic mp
 
Ap4 construction platform_presentation_cloud_views_2010
Ap4 construction platform_presentation_cloud_views_2010Ap4 construction platform_presentation_cloud_views_2010
Ap4 construction platform_presentation_cloud_views_2010
 
2010.05.21 invicta angels cloud views.callforbusiness
2010.05.21 invicta angels cloud views.callforbusiness2010.05.21 invicta angels cloud views.callforbusiness
2010.05.21 invicta angels cloud views.callforbusiness
 
Jorge gomes
Jorge gomesJorge gomes
Jorge gomes
 
Luis lima v3
Luis lima v3Luis lima v3
Luis lima v3
 
Fx apresentacao evento cloudview 2010
Fx apresentacao evento cloudview 2010Fx apresentacao evento cloudview 2010
Fx apresentacao evento cloudview 2010
 

Recently uploaded

IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 

Recently uploaded (20)

20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 

Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure

  • 1. Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Hypothesis Goals Evaluation of Virtual Clusters Performance on Methods a Cloud Computing Infrastructure Results Conclusions Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Universidade do Porto, Faculdade de Engenharia November 4, 2011 Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 1 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 2. Evaluation of Virtual Clusters Performance Outline on a Cloud Computing Infrastructure Nuno Cardoso, Tito 1 Introduction Vieira and Jorge G. Barbosa 2 Hypothesis Introduction Hypothesis 3 Goals Goals Methods Results 4 Methods Conclusions 5 Results 6 Conclusions Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 1 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 3. Evaluation of Virtual Clusters Performance User’s perspective on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa • Increase of computing needs Introduction Hypothesis • Lack of flexibility Goals • SW requirements different from the available Methods • Permissions to the available platforms are restricted Results • Clusters exist for specific applications Conclusions Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 2 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 4. Evaluation of Virtual Clusters Performance Provider’s perspective on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. • High energy cost Barbosa Introduction • HW aging without proper use Hypothesis Goals • SW is tightly coupled with HW leading to: Methods • Difficult and lengthy migrations Results • Inflexibility Conclusions • Difficult substitution of failing components • Difficulty in meeting users’ requirements Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 3 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 5. Evaluation of Virtual Clusters Performance Hypothesis on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Hypothesis Cloud Computing enables a better usage of the available Goals hardware without seriously compromising performance. Methods Results Conclusions Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 4 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 6. Evaluation of Virtual Clusters Performance Goals on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa • Explore the creation steps of an IaaS Cloud: Introduction • In an academic context Hypothesis • Using both specialized and non-specialized hardware Goals • Using open source technologies Methods • Evaluate the losses introduced by virtualization Results Conclusions • Analyze the benefits of the Cloud paradigm Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 5 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 7. Evaluation of Virtual Clusters Performance Resources characterization (1) on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa • More non-specialized HW Introduction than specialized HW Hypothesis • Specialized HW older than Goals non-specialized HW Methods • Inferior performance Results • Higher energy Conclusions consumption Specialized: 256 Cores Non-Specialized: 3328 Cores • Closer to failure Figure: Computer resources Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 6 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 8. Evaluation of Virtual Clusters Performance Resources characterization (2) on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction • High uptimes Hypothesis • 70% > 40m Goals • 42% > 1h30 Methods • Low loads Results • Possibility of running jobs 10 < t <= 40: 30% 40 < t <= 90: 28% Conclusions 90 < t <= 160: 23% 160 < t <= 250: 11% during those periods 250 < t <= 360: 5% 360 < t <= 490: 3% Figure: Non-specialized HW uptimes Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 7 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 9. Evaluation of Virtual Clusters Performance Resources characterization (3) on a Cloud Computing Infrastructure • Tier 1 nodes: Nuno Cardoso, Tito • Hardware: Vieira and Jorge G. • 2x Intel Xeon X3440 Barbosa (4 cores each) • 24GB RAM Introduction • GbE network Hypothesis • Operating System: Goals Debian GNU/Linux 6 Methods • Tiers 2 and 3 nodes: Results • Hardware: Conclusions • Intel Core 2 Quad Q9300 (4 cores) • 4GB RAM Figure: Multi-tier setup • GbE network • Operating System: Ubuntu FEUP Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 8 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 10. Evaluation of Virtual Clusters Performance Technologies on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Infrastructure Benchmarks Jorge G. Barbosa • Debian GNU/Linux 6 • Phoronix Test Suite 3.2 Introduction • OpenNebula 2.0.1 • HPCC 1.4.1 Hypothesis Goals • KVM 0.12.5 • OpenMPI 1.4.2 Methods Results • OpenVPN 2.1 • Condor 7.4.4 Conclusions • OpenSSH 5.5 • Riak 0.14.1 • Cassandra 0.7.5 Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 9 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 11. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis HPCC CPU/RAM, Network, HPC Goals Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark Summary Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 10 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 12. Evaluation of Virtual Clusters Performance Deployment on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Setup Jorge G. Barbosa S1: 1 node → 1 VM Introduction S2, S4 and S6: 1 node at 1x, 2x and 4x capacity (8,16 and 32 VMs) Hypothesis S3, S5 and S7: 2 nodes at 0.5x, 1x and 2x capacity (8,16 and 32 VMs) Goals VMs Methods Results • 1 Virtual CPU Conclusions • 1GB RAM • 2GB Disk (image: 500MB) • 4GB Swap Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 11 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 13. Evaluation of Virtual Clusters Performance Deployment on a Cloud Computing Infrastructure Nuno Cardoso, Tito Results Vieira and Jorge G. • 1 VM → ∼ 1.8 sec Barbosa • Elastic capabilities Introduction • Enables duplication of Hypothesis VMs/Clusters Request Transfer Boot Goals • Transfer bottleneck: Avg Avg Avg Methods S1 0.6 2.2 216.0 Distributed storage S2 0.1 1.9 245.4 Results S3 0.1 1.3 228.5 • Processing power S4 0.1 1.1 466.7 Conclusions S5 0.1 1.3 243.8 bottleneck: S6 0.1 1.5 717.4 More physical resources S7 0.1 1.0 418.2 Table: Benchmark results(sec) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 12 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 14. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark Summary Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 13 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 15. Evaluation of Virtual Clusters Performance Phoronix Test Suite on a Cloud Computing Infrastructure Setup Application Loss Bullet Physics Engine 2.75 1.29% Nuno Cardoso, Tito • Virtualized vs. C-Ray 1.1 0.67% Vieira and FFmpeg 0.6.1 5.39% Jorge G. Non-Virtualized FLAC Audio Encoding 1.2.1 1.43% Barbosa GraphicsMagick 1.3.12 2.33% • Two Categories: John The Ripper 1.7.3.1 0.64% LAME MP3 Encoding 3.98.2 4.46% Introduction • CPU intensive OpenSSL 1.0.0a 0.55% Smallpt 1.0 0.74% Hypothesis • IO intensive Goals Results Table: CPU intensive Methods Results • CPU virtualization → Low Application Loss Dbench 4.0 1 -55.34% Conclusions overhead (avg: 1.71%) Flexible IO Tester 1.21 73.12% PostMark 1.51 -363.33% • IO virtualization → High SQLite 3.7.3 -5.37% 7-Zip Compression 9.13 6.68% overhead (avg w/o gains: 22.51%) GnuPG 1.4.10 1.26% Unpacking linux-2.6.32 35.53% • Needing further analysis: x264 2010-11-22 10.95% Compile linux-2.6.32 4.90% Cache Table: IO intensive Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 14 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 16. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark Summary Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 15 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 17. Evaluation of Virtual Clusters Performance HPCC - Single Node on a Cloud Computing Infrastructure Setup HPL 1 Nuno 0.8 Cardoso, Tito • 8 processes PTRANS 0.6 Latency Vieira and 0.4 Jorge G. Barbosa • 1 Computer (8 cores) 0.2 Random Bandwidth Access Introduction • Several “PxQ” and “N”’s Hypothesis Goals • Virt. vs. Non-virt. FFTE DGEMM Methods Results Results STREAM VM Host Conclusions Spatial/Temporal Locality Figure: Result comparison High: Low losses Temporal (HPL: 2.2%) Low High Low Random Access FFT Spatial PTRANS HPL Low: High losses High STREAM DGEMM (RandomAccess: 35%) Table: Data Locality Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 16 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 18. Evaluation of Virtual Clusters Performance HPCC - Multiple Nodes on a Cloud Computing Infrastructure Setup HPL 1 Nuno 0.8 Cardoso, Tito • 16 processes (2x8) PTRANS 0.6 Latency Vieira and 0.4 Jorge G. Barbosa • 2 Computer (16 cores) 0.2 Random Bandwidth Access Introduction • Several “PxQ” and “N”’s Hypothesis Goals • Virt. vs. Non-virt. FFTE DGEMM Methods Results Results STREAM VM Host Conclusions Huge impact on networking: Figure: Result comparison Latency: 563% increase Temporal Low High Bandwidth: 70% decrease Spatial Low Random Access FFT High PTRANS HPL STREAM DGEMM Table: Data Locality Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 17 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 19. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark Summary Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 18 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 20. Evaluation of Virtual Clusters Performance Condor on a Cloud Computing Infrastructure Setup Nuno Cardoso, Tito • S1: Baseline Vieira and Jorge G. 8 VMs → 4 (Tier 1) Computers Barbosa Introduction • S2: Scalability/Resource Hypothesis exploitation Goals 8 + 15 VMs → 4 (Tier 1) + 15 (Tier 2) Computers Methods Results • S3: Elasticity/Resource exploitation Conclusions 15 VMs → 15 (Tier 3, 10a.m. until 19p.m.) Computers Figure: Multi-tier setup • Job: Subdivided into 10 minute chunks, Embarrassingly Parallel • VMs: 4 CPUs, 3GB RAM Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 19 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 21. Evaluation of Virtual Clusters Performance Condor on a Cloud Computing Infrastructure Nuno Results Cardoso, Tito Vieira and • Execution times: Jorge G. Barbosa • 1 VM: 1 month (extrapolated) • S1: 29 hours Introduction • S2: 10 hours Hypothesis • S3: 74 hours (extrapolated) Goals Methods • Nearly linear gain Results Conclusions • Possibility of using HW in both dedicated (S1 and S2) and non-dedicated (S3) fashions • Enables using unexploited (Tiers 2 and 3) HW to perform tasks with no extra expense Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 20 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 22. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark Summary Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 21 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 23. Evaluation of Virtual Clusters Performance Distributed Databases on a Cloud Computing Infrastructure Nuno Cardoso, Tito Setup Vieira and Jorge G. • Baseline Barbosa 6 nodes (2 CPUs, 4GB RAM), 1GB data per node Introduction Hypothesis • S1: Elasticity Goals Start from baseline; add 1 node; measure latencies Methods Results • S2: Scalability Conclusions Start from baseline; scale up to 12 nodes while measuring latencies • Databases: • Riak • Cassandra Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 22 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 24. Evaluation of Virtual Clusters Performance Distributed Databases on a Cloud Computing Infrastructure Results 2000 ms 1500 ms Nuno Cardoso, Tito • IO was a bottleneck 1000 ms Vieira and Jorge G. 500 ms Barbosa • S1: The Cloud introduced 0 ms elasticity in the cluster 0m 5m 10m 15m 20m 25m 30m 35m 40m 45m 50m 55m 60m Introduction Hypothesis with a transient (15 min) Cassandra Riak Goals overhead Figure: S1 Result Methods Results • S2: The cluster scaled 20 ms 19 ms Conclusions while maintaining latency 18 ms 17 ms constant (4 ms variation) 16 ms 15 ms 14 ms 13 ms 6N 7N 8N 9N 10 11 12 ode ode ode ode Nod Nod Nod s s s s es es es Cassandra Riak Figure: S2 Result Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 23 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 25. Evaluation of Virtual Clusters Performance Conclusions on a Cloud Computing Infrastructure Nuno Cardoso, Tito Dynamic architecture enabled: Vieira and Jorge G. • Performance scaling Barbosa • Cluster duplication Introduction • Redundancy creation Hypothesis • Increase infrastructure’s capabilities by using non-specialized HW Goals Performance losses Methods Results • IO → Depends on cache’s efficiency, normally high (around 20%) Conclusions • Networking → High (Latency: 563% increase, Bandwidth: 70% decrease) • CPU → Depends on the data locality: • High → Low (≤ 5%) • Low → High (≤ 35%) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 24 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 26. Evaluation of Virtual Clusters Performance Future Work on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Evaluate other setups Hypothesis • Xen, VirtualBox, VMWare, etc. Goals • Different IO modules/configurations Methods • OpenStack, Nimbus, Eucalyptus, etc. Results Conclusions Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 25 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 27. Evaluation of Virtual Clusters Performance Q&A on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Hypothesis Goals Methods ? Results Conclusions Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 26 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 28. Evaluation of Virtual Clusters Performance Backup on a Cloud Computing Infrastructure 140 % Nuno 100 % Cardoso, Tito Vieira and 60 % Jorge G. Gain Barbosa 20 % Introduction −20 % Hypothesis −60 % Goals −100 % Methods −140 % Results 1000 2000 4000 8000 16000 32000 46336 Conclusions Problem Size VM (resources x 2) HOST (resources x 2) VM (resources x 4) HOST (resources x 4) Figure: HPL performance gain by increasing processing power Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 27 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 29. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (8 processes) Nuno Problem Size Cardoso, Tito PxQ 2K 4K 8K 16K 32K 46K Avg Vieira and Jorge G. 1x8 12.4 23.0 28.4 30.2 29.3 28.9 25.4 Barbosa 2x4 12.9 20.3 25.5 27.7 28.5 28.6 23.9 4x2 9.4 16.7 24.0 28.3 32.3 31.9 23.8 Introduction 8x1 11.0 12.2 20.5 30.3 36.7 38.2 24.8 Hypothesis Avg 11.4 18.0 24.6 29.1 31.7 31.9 24.5 Goals Table: VM (GFlops) Methods Results Problem Size PxQ 2K 4K 8K 16K 32K 46K Avg Conclusions 1x8 13.3 23.9 30.3 33.1 33.1 33.3 27.9 2x4 9.9 20.5 28.3 32.2 32.7 33.0 26.1 4x2 9.1 17.4 26.2 32.4 35.7 35.3 26.0 8x1 8.2 8.6 16.8 27.8 36.5 38.8 22.8 Avg 10.2 17.6 25.4 31.4 34.5 35.1 25.7 Table: Host (GFlops) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 28 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 30. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (8 processes) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Problem Size Introduction PxQ 2K 4K 8K 16K 32K 46K Avg Hypothesis 1x8 7.0 3.9 6.3 8.8 11.7 13.2 9.0 2x4 -29.8 1.1 9.7 14.0 13.0 13.6 3.6 Goals 4x2 -2.5 4.2 8.2 12.6 9.6 9.7 7.0 Methods 8x1 -33.9 -41.6 -22.0 -8.9 -0.6 1.6 -17.6 Results Avg -12.4 -2.4 3.0 7.2 8.2 9.2 2.2 Conclusions Table: Performance Loss(%) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 29 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 31. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (16 processes) Problem Size Nuno PxQ 2K 4K 8K 16K 32K 46K Avg Cardoso, Tito Vieira and 1x16 1.6 3.0 6.1 12.7 25.3 34.0 13.8 Jorge G. 2x8 3.5 7.3 14.8 27.7 42.3 47.0 23.8 Barbosa 4x4 5.9 14.4 28.7 41.1 50.9 54.2 32.5 8x2 7.9 13.5 26.3 43.8 59.4 65.7 36.1 Introduction 16x1 1.3 3.0 6.5 12.4 22.4 29.7 12.8 Hypothesis Avg 4.0 8.3 16.5 27.6 40.0 46.1 23.8 Goals Table: VM Results(GFlops) Methods Results Problem Size Conclusions PxQ 2K 4K 8K 16K 32K 46K Avg 1x16 3.4 6.8 14.7 28.0 43.2 50.3 24.4 2x8 5.8 13.7 26.9 44.0 55.6 58.6 34.1 4x4 5.2 15.6 35.2 51.4 61.2 63.5 38.7 8x2 7.6 11.0 24.3 44.8 63.0 69.8 36.7 16x1 3.1 6.5 11.4 21.8 37.4 46.9 21.2 Avg 5.0 10.7 22.5 38.0 52.0 57.8 31.0 Table: Host Results(GFlops) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 30 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  • 32. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (16 processes) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Problem Size Introduction PxQ 2K 4K 8K 16K 32K 46K Avg 1x16 54.1 56.3 58.2 54.5 41.4 32.2 49.5 Hypothesis 2x8 39.4 46.5 44.9 36.9 23.9 19.6 35.2 Goals 4x4 -12.7 7.9 18.5 20.0 16.8 14.6 10.9 Methods 8x2 -4.3 -23.0 -8.1 2.2 5.6 5.9 -3.6 16x1 56.6 52.6 42.9 42.9 40.2 36.8 45.3 Results Avg 20.6 28.1 31.3 31.3 25.6 21.8 27.4 Conclusions Table: Performance Loss(%) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 31 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011