SlideShare a Scribd company logo
1 of 31
Download to read offline
MALAYSIAN PUBLIC SECTOR
  OPEN SOURCE SOFTWARE (OSS)
           PROGRAMME




  BENCHMARK/EVALUATION REPORT
on WEB SERVERS for BUDGET 2008 DAY




           AUGUST 2008
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day




                                             Copyright

                  The government of Malaysia retains the copyright of this document.
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


Table of Contents

1.0 EXECUTIVE SUMMARY.....................................................................................................1
2.0 INTRODUCTION..................................................................................................................1
   2.1 Background ......................................................................................................................1
   2.2 Purpose ............................................................................................................................2
   2.3 Scope .............................................................................................................................3
      2.3.1 Benchmarking activities ............................................................................................3
      2.3.2 Visitor access statistic ..............................................................................................3
      2.3.3 Personnel involved ...................................................................................................4
3.0 METHODOLOGY ................................................................................................................5
   3.1 Benchmarking methodology ............................................................................................5
   3.2 Visitor access recording and statistic generation ............................................................5
4.0 BENCHMARKING REPORT ...............................................................................................6
   4.1 Benchmarking Activities..................................................................................................6
      4.1.1 Experimental Setup ..................................................................................................6
      4.1.2 Test System Specification And Configuration ...........................................................7
      4.1.3 Commands Used ......................................................................................................7
   4.2 Result of Benchmarking Exercise ..................................................................................9
      4.2.1 Apache Web Server 2.2.3 .........................................................................................9
      4.2.2 Lighttpd Web Server 1.4.15-1 ................................................................................10
   4.3 Proposed Infrastructure Solution ...................................................................................11
5.0 BUDGET DAY SERVER OPERATION REPORT .............................................................13
   5.1 Server Preparation Activities .......................................................................................13
   5.2 Production Server Setup & Configuration ...................................................................13
      5.2.1 Sysctl.conf ..............................................................................................................13
      5.2.2 Synchronization scripts ..........................................................................................14
   5.3 Budget Day Operation Report .....................................................................................17
   5.4 Visitors Statistic For The Budget Day ..........................................................................17
      5.4.1 General statistic ......................................................................................................17
      5.4.2 Visitors per hour......................................................................................................18
      5.4.3 Visitors by countries (Top 20) .................................................................................19
      5.4.4 Visitors by operating system types..........................................................................20
      5.4.5 Visitors by browser types.........................................................................................20
6.0 BENEFITS OF OSCC'S PARTICIPATION ........................................................................21
7.0 CONCLUSION ..................................................................................................................22
8.0 APPENDICES ..................................................................................................................24
   8.1 Snapshot Treasury Portal during the Budget Day .........................................................24
   8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded ...........25
   8.3 Snapshot of Awstats reports...........................................................................................26
   8.4 Snapshot of appreciation letter from MOF.....................................................................27
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


1.0         EXECUTIVE SUMMARY

This document is designed to provide detailed report of all exercises done by OSCC during
their participation in preparing a dedicated web server for the Budget 2008 presentation day
conducted by the Ministry Of Finance (MOF). Due to a massive visitor access spike projected
during the budget day, OSCC team has been assigned to propose, set up and maintain a web
server infrastructure solution based on Open Source technology that is reliable to handle the
visitor surge, secure and cost saving. This solution is meant to replace the solution adopted
by MOF for the past years that are too expensive and complex. The solution provided by
OSCC has successfully performs reliably and                receives more than 130,000 page views
without any problem. The solution also saves MOF a huge amount of money as it eliminates
the need of expensive hardwares and it only uses a single unit of server equipped with free
Open Source softwares. All activities, findings and information will be presented in detail
within this report which will be used as source of reference for similar implementation in the
future.



2.0         INTRODUCTION

      2.1    Background

Over the years Ministry Of Finance's (MOF) website (http://www.treasury.gov.my) receives a
huge number of web accesses particularly during the national budget day presentation. These
spikes of requests were caused by a large number of visitors trying to get information
concerning the upcoming year's budget and also downloading the Malaysia Economic
Reports in digital format documents. Visitors also access the website to get information about
the live video broadcast of the presentation, and for this purpose the treasury website only
provide a web URL to a third party portal that handles the web broadcast. For the past years
OSCC had involved whether directly or indirectly in providing consultancy and human
expertise in preparing a suitable server solution for the budget presentation day. It was


                                                                                          Page 1
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


reported that in 2005, during the Malaysian Budget 2006 presentation day, such huge visitor
accesses had caused the web server to stall due to the excessive load congesting the server
resources. This event had caused denial of service state to the server thus causing failure of
web access requests to the visitors. To prevent the situation from happening again, for the
Malaysian Budget 2007 presentation day in 2006, drastic approaches have been taken. An
alternative server infrastructure consists of several unit of servers with load balancing
approach was implemented to substitute the actual web server only for the budget days
period. This solution was installed a few days prior to the budget date and being
decommissioned several days after once visitor access numbers back to normal day to day
routine. The solution had proven to be reliable as there are no denial of access reported but
for MOF's view, it was somewhat too expensive and too complicated and they are seeking for
a more practical and economical approach for the next national budget day. In August 2007,
OSCC once again been invited to provide consultancy and to facilitate the preparation
process for the Malaysian Budget 2008 presentation day. Both R&D and Technical Unit of
OSCC involved cooperatively to propose, design, install and operates a suitable server
solution for the budget day.


    2.2      Purpose


The purpose of this document is to:-

   1. Identify suitable web server infrastructure solution to be applied by Ministry Of Finance
       for the Budget 2008 presentation day

   2. To identify whether or not a server load balancing formation is needed to handle high
       web access request on the particular day

   3. To determine which type of web server package to be used

   4. To provide reports of operations initiated during the actual budget presentation day

   5. To present web access statistic captured for the whole budget day

   6. To table any related findings gathered during and after the operation day

                                                                                        Page 2
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


The testing is not in any way done to declare which web server application is better compared
to others, but merely to find which solution is the most suitable within the scope of our specific
requirement. Therefore, any results, findings and recommendation provided in this report
should not be considered as a generalized head to head comparison.



    2.3 Scope

     2.3.1 Benchmarking activities

Only two web servers software were selected to be the testing subjects which were        Apache
(http://www.apache.org) and Lighttpd (http://www.lighttpd.net). All testing activities were done
on machines with the same hardware specifications, identical operating systems and similar
configurations and performance tuning settings. All testing were done in a lab located in
OSCC. All network connections were Local Area Network in nature which means that
maximum network bandwidth should be approximately 100Mbps.

     2.3.2 Visitor access statistic

This report examines visitor activity log data for the website www.treasury.gov.my only for the
budget presentation day which is on the 7th September 2007. Only genuine human visitor will
be counted in the analysis and no visits or page hits by automated robots such as crawler,
bots and external data mining agents will be used within this report.

Due to the internet nature of 'the world without boundaries', visitor origins in the analysis will
be from all over the world which is not limited to specific geographical location. Data that will
be taken into consideration are hourly unique visitors and visitors which are divided by
countries. The analysis will also provide comparison between operating system types and
internet browser types to estimate the percentage in term of users who are using open source
technologies.




                                                                                           Page 3
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


     2.3.3 Personnel involved

Both RND and technical teams were involved directly with this project. There were also a
number of personnel from MOF participate in various                  activities throughout the server
benchmarking, server preparation and during operation day.

    OSCC personnel involved in the benchmarking activities:

       1. Haris (R&D Unit)

       2. Jamal (R&D Unit)

       3. Hisham (Technical Unit)

       4. Azizul (Technical Unit)

       5. Maisarah (R&D Unit)

       6. Indhran (R&D Unit)

OSCC personnel involved for the server preparation and operation day:

       1. Haris (R&D Unit)

       2. Jamal (R&D Unit)

       3. Hisham (Technical Unit)

       4. Azizul (Technical Unit)




                                                                                               Page 4
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day



3.0         METHODOLOGY

      3.1 Benchmarking methodology

The benchmarking activities were done using an open source web server stress test tool
called ApacheBench (AB). ApacheBench is a command line computer program for measuring
the performance of HTTP web servers, in particular the Apache HTTP Server. It was designed
to give an idea of the performance that a given Apache installation can provide. In particular, it
shows how many requests per second the server is capable of serving. A series of testing
were done on each test subject and the results were recorded. On each occasion, a number
of connections and quantity of concurrency were pre-determined. If the test finished
successfully, meaning all request been served effectively by the test subject without any failed
or denied request, the number of concurrency will be increased and another round of test will
be done. The procedures were repeated until the subject matters fail to serve. This would
mean that the limit of connection that the particular web server can handle has been found.
By using this method, a comparison can be made on which web server has the capability to
serve the highest number of connections and maintain availability through sudden spike of
visitor access.

      3.2 Visitor access recording and statistic generation

Throughout the operation process including the budget presentation day, no additional
monitoring tools were used on the web server rather than the conventional web server log
capability provided by both Apache and Lighttpd. This is to minimize resource usage of the
particular server to keep the free of unnecessary overhead. The web server logs are kept in
the access_log. Analyses were done to the log after the budget day to generate meaningful
statistic using an open source log analyzer tool called Awstat (http://awstats.sourceforge.net).
AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or
mail server statistics, graphically. This log analyzer works as a CGI or from command line and
shows you all possible information your log contains, in few graphical web pages. It uses a
partial information file to be able to process large log files, often and quickly. It can analyze

                                                                                           Page 5
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


log files from all major server tools like Apache log files (NCSA combined/XLF/ELF log format
or common/CLF log format), WebStar, IIS (W3C log format) and a lot of other web, proxy,
wap, streaming servers, mail servers and some ftp servers.


4.0         BENCHMARKING REPORT

      4.1 Benchmarking Activities

      4.1.1 Experimental Setup

A series of benchmarking activities were done using the Apache Bench tool. 2 servers with
identical hardware specification, Operating System and                configurations   were   installed
with Apache      and Lighttpd respectively.

Machine A :                                            Machine B :

IP address : 10.20.20.51                               IP address : 10.20.20.52

Apache 2.2.3                                           Lighttpd 1.4.15-1



Another machine was being set up as the testing terminal where the benchmarking and stress
test tool will be executed. This machine was equipped with the Apache Bench Tool.




                                                                                                Page 6
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


    4.1.2 Test System Specification And Configuration

All machines specification are identical. Using the same hardware model, operating system
and configurations.

Maker Model                                            HP DC770
Processor                                              Intel(R) Pentium(R) D CPU 3.20GHz
RAM                                                    512 MB
Hard Disk                                              40 GB
Operating System                                       Linux CentOS 5


     4.1.3 Commands Used

Command used to launch the benchmarking process

ab –n 10000 –c xxx http://ipaddress/

Where :-

–n is the number of connections to be generated during the test emulating the number of web
access estimated to be received by the server within a specific timeframe (approximately
below 20 seconds) during the budget day. The value 10000 was pre-determined by the
team as the appropriate number of estimated connection judging by the projected number of
web access for the upcoming budget day based on the past years pattern.

–c is the number of concurrent connection that will take place during the series of tests. This
is the most crucial element within the benchmarking activities, understanding that the aspect
of availability should be the highest priority in the choosing the most suitable solution. For
each round of testing, the number of concurrent connection will be increased until error
encountered which signals the actual limit where the web server capable of serving.

Example : ab –n 10000 –c 500 http://10.20.20.52/

*Testing the Machine B with 10000 number of connection with 500 number of concurrency.
During the test, system resource utilization was monitored and logged using vmstat

                                                                                           Page 7
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


command. This was to find any spike of resource usage or any occurrence of I/O bottleneck.
Several data that were closely monitored were:

            CPU Idle          To determine whether any excessive CPU usage
                              occurred during the stress test process. High CPU
                              Idle status means that             the system is healthy
            Free Memory       To determine whether any excessive RAM usage
                              occurred during the stress test process. High Free
                              Memory status means                    that the system is
                              healthy




                                                                                          Page 8
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


    4.2 Result of Benchmarking Exercise

    4.2.1 Apache Web Server 2.2.3

    Number of request (n) = 10,000




On each test round, Apache failed to surpass 400 concurrency connection level.




                                                                                 Page 9
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


    4.2.2 Lighttpd Web Server 1.4.15-1

    Number of request (n) = 10,000




                                                                            Page 10
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day




Based on the above results, it is clear that Lighttpd capable of handling larger number of
concurrent web requests compared to Apache when it comes to serving static web contents.
The above rounds of tests were repeated a few times but the outcome persists. In addition,
the team also tried a larger number of requests to the Lighttpd server which was supposedly
beyond the scope of testing by increasing the –n number and the –c number and lighttpd
proves to have the ability to withstand them.

    4.3 Proposed Infrastructure Solution

Based on the results of the testing, the team has decided to opt for Lighttpd as the web server
to use. We are confident that a single server with adequate hardware specification, equipped
with Lighttpd could withhold the high number of web access requests during the budget day
provided that the server only servers static contents without any server side scripting nor any
king of database connectivity involved. To make sure that the server uses resources efficiently
and to increase stability, several modifications and fine tuning configurations will be done to
the production server. These include CPU & RAM allocation and kernel optimization tuning.
Unneeded services were also turned off minimize resource overhead. All software installation,
modification and tuning processes will be done by OSCC with assistance of MOF personnel.

In addition, one unit of standby server will be also placed alongside the production server for


                                                                                        Page 11
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


contingency measure such as in the event of hardware failure to the primary server. The
standby server also has the same configuration and contents as the production server with
almost identical hardware specification. The team had also suggested the use of multiple
servers located in different data centers if in case large binary files such as 'self extracting
compilation of economic reports' were going to be served and made available to the public as
what have been done in the previous years. Those servers will act as the alternatives
download locations listed as download links within the download page in the main portal,
where visitors can choose from. This method will reduce the burdens of the primary portal.
Those server were also equipped with Lighttpd where minimal hardware specification as low
as a Personal Computer (PC) specification could be used.

Based on mutual agreement with MOF, three alternative download locations were identified.
Those three servers are:

   •   The standby server which are located in NetMyne Datacenter alongside primary server

   •   One unit of server located at Ministry of Finance

   •   One unit of server located at OSCC

A simple bash script was created to handle synchronization among servers to make sure that
all servers have the same up-to-date web contents. The scripts will be provided in the later
part of this document.

*** However during the budget day, none of the alternative download servers were utilized, as
there are no large binary files were served by MOF, and the main server showed no indication
of congestion and it's resource utilization were successfully kept at the very minimum.




                                                                                          Page 12
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day




Overview of the proposed server structure for Budget 2008 presentation day




                                                                             Page 13
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


5.0         BUDGET DAY SERVER OPERATION REPORT

      5.1 Server Preparation Activities

All servers has been freshly installed with Linux CentOS 5 one week before the actual event.
Several round of stress test were done on all machines to make sure they don't have any
problem particularly on the hardware aspect. An overnight stress test also have be done using
combination of AB stress tool and cron job to make sure that the servers are stable.

      5.2 Production Server Setup & Configuration

      5.2.1 Sysctl.conf

Exact file location: /etc/sysctl.conf

        #additional parameter to increase performance
          kernel.shmmax = 436883456
           kernel.shmall = 268435456
           kernel.sem = 500 51200 64 2048
           kernel.shmmni = 4096
           fs.file-max = 65536
           net.core.rmem_default = 262144
           net.core.wmem_default = 262144
           net.core.rmem_max = 262144
           net.core.wmem_max = 262144
           net.ipv4.ip_local_port_range = 1024 65000
           kernel.msgmni = 2048
           kernel.msgmax = 65536
           vm.page-cluster = 20
           net.ipv4.tcp_rmem = 4096 87380 16777216
           net.ipv4.tcp_wmem = 4096 87380 16777216
           net.ipv4.tcp_tw_reuse = 1



                                                                                       Page 14
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


      5.2.2 Synchronization scripts

The main script (called via command line at the primary server by the system administrator)

    Exact file location: /usr/local/bin/rsync-mof

       #!/bin/bash
       # mirror-script.sh
       # created by Jamal
       if [ $(whoami) = bajet08 ]; then
          echo -e "nnProcess started. Please wait..."
          /usr/local/bin/rsync-mdec2
          sleep 1
          /usr/local/bin/rsync-oscc
          sleep 1
          /usr/local/bin/rsync-treasury
          echo -e "Process finishednn"
       else
           echo -e "Denied: Only bajet08 user can run this scriptn"
       fi


The above script will launch three series of rsync instances.

   /usr/local/bin/rsync-mdec2

       #!/bin/sh
       # mirror-script.sh
       # created by Jamal
       DATE=`/bin/date +%y%m%d-%H%M%S`
       OUTFILE=/var/log/mirror/mdec2-$DATE.log
       date >> /var/log/mirror/mdec2-exec.log
       if [ -f "/home/bajet08/rsync-mof.pid" ]; then
          RUNPID=`cat /home/bajet08/rsync-mof.pid`
          if ps -p $RUNPID; then
             echo "Mirror is already running..."
             echo "Mirror is already running..." >> /var/log/mirror/mdec2-
       exec.log
             exit 1
          else
             echo "Mirror pid found but process dead, cleaning up"
       >> /var/log/mirror/mdec2-exec.log
          fi

                                                                                      Page 15
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


       else
          echo "No process Detected" >> /var/log/mirror/mdec2-exec.log
       fi
       echo $$ > /home/bajet08/rsync-mof.pid
       echo -n "MDEC2 Server Mirroring Started at "
       echo "Mirror Started " >> /var/log/mirror/mdec2-exec.log
       date
       #$rsync $mirror $local > $OUTFILE 2>&1
       /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no
       -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete 
          /var/www/html/ 202.75.59.26:/var/www/html > $OUTFILE 2>&1


   /usr/local/bin/rsync-oscc

       #!/bin/sh
       # mirror-script.sh
       # created by Jamal
       DATE=`/bin/date +%y%m%d-%H%M%S`
       OUTFILE=/var/log/mirror/oscc-$DATE.log
       date >> /var/log/mirror/oscc-exec.log
       if [ -f "/home/bajet08/rsync-mof.pid" ]; then
          RUNPID=`cat /home/bajet08/rsync-mof.pid`
          if ps -p $RUNPID; then
             echo "Mirror is already running..."
             echo "Mirror is already running..." >> /var/log/mirror/oscc-exec.log
             exit 1
          else
             echo "Mirror pid found but process dead, cleaning up"
       >> /var/log/mirror/oscc-exec.log
          fi
       else
          echo "No process Detected" >> /var/log/mirror/oscc-exec.log
       fi
       echo $$ > /home/bajet08/rsync-mof.pid
       echo -n "OSCC Server Mirroring Started at "
       echo "Mirror Started " >> /var/log/mirror/oscc-exec.log
       date
       /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no
       -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete 
          /var/www/html/ 210.187.27.213:/var/www/html > $OUTFILE 2>&1




                                                                                    Page 16
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


   /usr/local/bin/rsync-treasury



      #!/bin/sh
      # mirror-script.sh
      # created by Jamal
      DATE=`/bin/date +%y%m%d-%H%M%S`
      OUTFILE=/var/log/mirror/treasury-$DATE.log
      date >> /var/log/mirror/treasury-exec.log
      if [ -f "/home/bajet08/rsync-mof.pid" ]; then
         RUNPID=`cat /home/bajet08/rsync-mof.pid`
         if ps -p $RUNPID; then
            echo "Mirror is already running..."
            echo "Mirror is already running..." >> /var/log/mirror/treasury-
      exec.log
            exit 1
         else
            echo "Mirror pid found but process dead, cleaning up"
      >> /var/log/mirror/treasury-exec.log
         fi
      else
         echo "No process Detected" >> /var/log/mirror/treasury-exec.log
      fi
      echo $$ > /home/bajet08/rsync-mof.pid
      echo -n "Treasury Server Mirroring Started at "
      echo "Mirror Started " >> /var/log/mirror/treasury-exec.log
      date
      /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no
      -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete 
         /var/www/html/ 202.75.6.53:/var/www/html > $OUTFILE 2>&1




                                                                               Page 17
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


    5.3 Budget Day Operation Report

Several OSCC staffs have been located at all critical points where the servers reside. Each of
them will monitor the log files activity of each server for any kind of problem. Live report file
uploading processes were done by MOF's staff directly to the primary server and the
synchronization scripts will distribute and duplicate the changes to other backup servers.
There are no occurrence of error detected for the whole day and the backup servers were not
utilized at all as the primary server shows any symptom of resources drainage.

    5.4 Visitors Statistic For The Budget Day

Below is the visitor statistic collected during the Budget 2008 Presentation Day which was
held on 7th September 2007. All data were taken from web access log and was analyzed
using Awstats. Only the primary server was used during that day, therefore all statistics shown
here are purely from a single server.

    5.4.1 General statistic

     Date : 7th September 2007

Total number of unique visitors                        9, 874
Total number of visits                                 12, 796 (1.29 visits/visitor)
Total number of pages viewed                           130, 398 (10.19 Pages/Visit)
Total number of hits generated                         519, 184 (40.57 Hits/Visit)
Total bandwidth consumed                               4.58 GB (374.95 KB/Visit)




                                                                                         Page 18
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


     5.4.2 Visitors per hour


         Hours                       Pages                       Hits        Bandwidth
        00:00 am                      282                        1263        7,619,401
        01:00 am                      145                         601        4,713,187
        02:00 am                      114                         486        3,400,969
        03:00 am                       96                         377        2,695,992
        04:00 am                       56                         160         973,597
        05:00 am                       45                         144        1,096,283
        06:00 am                      110                         504        3,377,156
        07:00 am                      671                        3,800       18,702,079
       08:00 am                      1,979                      10,428       56,068,174
        09:00 am                     2,505                      11,851       70,603,683
        10:00 am                     2,739                      12,972       79,936,375
        11:00 am                     3,046                      14,192       79,977,401
       12:00 pm                      2,192                      10,347       59,969,313
        01:00 pm                     1,626                       7,457       44,138,365
       02:00 pm                      5,388                      23,544      142,280,704
        03:00 pm                    16,097                      76,505      393,637,888
        04:00 pm                    32,647                     150,655      580,046,848
        05:00 pm                    28,605                     104,234      1,040,812,032
        06:00 pm                    12,070                      33,375      835,983,360
       07:00 pm                      5,166                      16,029      343,683,072
        08:00 pm                     3,335                      11,222      264,849,408
        09:00 pm                     5,187                      12,175      405,623,808
        10:00 pm                     4,551                      10,335      380,430,336
        11:00 pm                 1,746                   6,529               92,384,038
       * The above data doesn't includes traffic generated by robots, worms,
         or replies with special HTTP status codes.




                                                                                        Page 19
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


     5.4.3 Visitors by countries (Top 20)


   No                  Country                    Pages                     Hits    Bandwidth
    1.     Malaysia                              119,908               485,441       4.29 MB
    2.     United States                           2,559                    7,589   59.42 MB
    3.     Singapore                               2,468                    6,838   61.50 MB
    4.     Japan                                   1,125                    3,672   20.01 MB
    5.     Australia                                715                     2,862   22.97 MB
    6.     India                                    551                     953     45.21 MB
    7.     Hong Kong                                541                     2,103   12.63 MB
    8.     European country                         439                     1,640   14.87 MB
    9.     Great Britain                            379                     1,422   17.34 MB
    10.    France                                   191                     755      3.86 MB
    11.    Indonesia                                179                     636      4.95 MB
    12.    China                                    161                     672      3.30 MB
    13.    Germany                                  154                     466      3.92 MB
    14.    South Korea                              134                     646      2.31 MB
    15.    Philippine                                74                     198      1.62 MB
    16.    Taiwan                                    67                     290      1.97 MB
    17.    New Zealand                               61                     278     1.24 MB
    18.    Qatar                                     48                     141      1.56 MB
    19.    Switzerland                               45                     224      1.22 MB
    20.    United Arab Emirates                      42                     177      0.53 MB




                                                                                          Page 20
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


     5.4.4 Visitors by operating system types


                     Operating Systems                           Hits       Percent
    1.     Windows                                             500,848      96.40%
    2.     Unknown                                              14,574      2.80%
    3.     Macintosh                                             1,829      0.30%
    4.     Linux                                                 1,559      0.30%
    5.     Symbian OS                                             332         0%
    6.     Sun Solaris                                            42          0%


     5.4.5 Visitors by browser types


                          Browsers                               Hits       Percent
    1.     MS Internet Explorer                                445,607      85.80%
    2.     Firefox                                              54,316      10.40%
    3.     NetAnts                                              10,638      2.00%
    4.     Mozilla                                               2,244      0.40%
    5.     Unknown                                               1,919      0.30%
    6.     Opera                                                 1,826      0.30%
    7.     Safari                                                1,764      0.30%
    8.     Netscape                                               570       0.10%
    9.     RssReader (RSS Reader)                                 82          0%
    10.    K-Meleon                                               37          0%
    11.    Others                                                 181         0%




                                                                                      Page 21
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


6.0         BENEFITS OF OSCC'S PARTICIPATION

      Benefits for OSCC

   1. OSCC gained significant visibility during Budget Day 2008 by having its logo
        embedded within the treasury.gov.my website from 2.00pm until 5.00pm. More than
        250,000 hits generated during that time-frame.

   2. Valuable knowledge based on research about comparison between 2 open-source web
        server (Apache/Lighttpd).

   3. Data will be used for OSCC OSS benchmarking reports as part of RND department
        deliverables

   4. Transfer of technology, exposure and knowledge sharing about Open Source
        technology to MOF.

   5. Providing solid proof about reliability, flexibility and future potential of open source
        products .

   6. Valuable lessons and experience for all OSCC Technical and RND department staffs .

   7. Helping MOF in substantially reducing the total cost for preparing budget day server
        compared to previous years.




                                                                                      Page 22
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


7.0         CONCLUSION

Overall, our recommended server infrastructure solution performs reliably in serving such high
number of web access for the www.treasury.gov.my portal during the budget 2008
presentation day. All requests were successfully served and the server did not encounter
any kind of problem such as network congestion or service interruption during the production
period. The resource utilization of the server also kept at very minimum with majority of the
system resources such as CPU and RAM were underutilized which means that the same
setup could theoretically handles even larger number of web access request in the future if
the same infrastructure solution and practices were to be reused.



Both MOF and OSCC have gained valuable experiences and knowledge throughout each of
the project phase especially during the benchmarking, installation and production phase.
Those knowledge and experience would be helpful in improving OSCC operation most
importantly in the technical aspects in the future. The benchmarking activities have provided
valuable knowledge especially in realizing the solidness of open source web server products
particularly for Lighttpd web application. Although the team did not took the results as
absolute declaration of which web server is the better compared to others as there a a lot of
external variables should be considered in making any justification, nevertheless it was a
good indicator of the wide variety of possibilities offered by the open source world where there
are so many alternatives to choose from in catering any specific needs.



Based on number of visitors divided by operating system types and internet browser types,
Microsoft has proven that they dominated the operating system and internet browser
application market especially for desktop workstation among the internet users particularly in
Malaysia. This information is crucial to the future strategic planning for OSCC as it could be
used as a guideline or reference in tabulating the trend of open source usage among the
Malaysian people. Only 0.30% of the total visitors were using Linux operating system while for


                                                                                        Page 23
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


Open Source internet browser, Firefox only manage to achieve slightly above 10%.



The number is tremendously small compared to the Microsoft and shows that user
acceptance toward open source technologies for desktop workstation and software
application is still arguable and majority of computer users are still prefer proprietary products.
This is also indicates that there are still a large room for OSCC to work on in the future.




                                                     Prepared by: Harifazillah Jamel, OSCC MAMPU

                                                                                           Page 24
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day


8.0 APPENDICES

    8.1 Snapshot Treasury Portal during the Budget Day




                                                                            Page 25
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day




    8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo
       embedded




                                                                            Page 26
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day




    8.3 Snapshot of Awstats reports




                                                                            Page 27
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day




    8.4 Snapshot of appreciation letter from MOF




                                                                            Page 28

More Related Content

Similar to Benchmarking On Web Server For Budget 2008 Day

Case Study 2_Motoring and Insurance
Case Study 2_Motoring and InsuranceCase Study 2_Motoring and Insurance
Case Study 2_Motoring and InsuranceMatt Campbell
 
Job aid for taxpayers how to use the e bir-forms package
Job aid for taxpayers   how to use the e bir-forms packageJob aid for taxpayers   how to use the e bir-forms package
Job aid for taxpayers how to use the e bir-forms packageraissarobles
 
Closing Report
Closing ReportClosing Report
Closing ReportAnuj Sodha
 
MECC Central roadshow
MECC Central roadshowMECC Central roadshow
MECC Central roadshowscottdavey
 
Microsoft Word - mcu-group-final-report_April2008_web_version_v2
Microsoft Word - mcu-group-final-report_April2008_web_version_v2Microsoft Word - mcu-group-final-report_April2008_web_version_v2
Microsoft Word - mcu-group-final-report_April2008_web_version_v2Videoguy
 
Lanny resume 190804
Lanny resume 190804Lanny resume 190804
Lanny resume 190804LannyIrwan
 
Final Year Project (ISP),Project Demo
Final Year Project (ISP),Project DemoFinal Year Project (ISP),Project Demo
Final Year Project (ISP),Project DemoAbdul Aslam
 
2012 Global Awards for Excellence in BPM and Workflow
2012 Global Awards for Excellence in BPM and Workflow2012 Global Awards for Excellence in BPM and Workflow
2012 Global Awards for Excellence in BPM and WorkflowFuture Strategies Inc.
 
618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatment
618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatment618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatment
618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatmentBrian Khoon
 
Ashutosh_Sharma_7 Yrs_Manual Testing
Ashutosh_Sharma_7 Yrs_Manual TestingAshutosh_Sharma_7 Yrs_Manual Testing
Ashutosh_Sharma_7 Yrs_Manual TestingAshutosh Sharma
 
How to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCI
How to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCIHow to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCI
How to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCISenturus
 
Improved Go to Market Time & Reduced Operational Cost
Improved Go to Market Time & Reduced Operational CostImproved Go to Market Time & Reduced Operational Cost
Improved Go to Market Time & Reduced Operational CostITC Infotech
 
Go beyond job scheduling
Go beyond job schedulingGo beyond job scheduling
Go beyond job schedulingDavid Resnic
 
Indian CST's GPMS Products Portfolio 2015
Indian CST's GPMS Products Portfolio 2015Indian CST's GPMS Products Portfolio 2015
Indian CST's GPMS Products Portfolio 2015Raja Seevan
 
NYC Dept. of Buildings Reorganization and Strategy
NYC Dept. of Buildings Reorganization and StrategyNYC Dept. of Buildings Reorganization and Strategy
NYC Dept. of Buildings Reorganization and StrategyREBNY
 
USAID KESIP II - Final Deliverable
USAID KESIP II - Final DeliverableUSAID KESIP II - Final Deliverable
USAID KESIP II - Final DeliverableErik Spurgin
 

Similar to Benchmarking On Web Server For Budget 2008 Day (20)

Case Study 2_Motoring and Insurance
Case Study 2_Motoring and InsuranceCase Study 2_Motoring and Insurance
Case Study 2_Motoring and Insurance
 
The BIR-forms package
The BIR-forms packageThe BIR-forms package
The BIR-forms package
 
Job aid for taxpayers how to use the e bir-forms package
Job aid for taxpayers   how to use the e bir-forms packageJob aid for taxpayers   how to use the e bir-forms package
Job aid for taxpayers how to use the e bir-forms package
 
Closing Report
Closing ReportClosing Report
Closing Report
 
MECC Central roadshow
MECC Central roadshowMECC Central roadshow
MECC Central roadshow
 
Microsoft Word - mcu-group-final-report_April2008_web_version_v2
Microsoft Word - mcu-group-final-report_April2008_web_version_v2Microsoft Word - mcu-group-final-report_April2008_web_version_v2
Microsoft Word - mcu-group-final-report_April2008_web_version_v2
 
Lanny resume 190804
Lanny resume 190804Lanny resume 190804
Lanny resume 190804
 
Final Year Project (ISP),Project Demo
Final Year Project (ISP),Project DemoFinal Year Project (ISP),Project Demo
Final Year Project (ISP),Project Demo
 
2012 Global Awards for Excellence in BPM and Workflow
2012 Global Awards for Excellence in BPM and Workflow2012 Global Awards for Excellence in BPM and Workflow
2012 Global Awards for Excellence in BPM and Workflow
 
618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatment
618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatment618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatment
618201483114 pmguide on-accounting-software-as-09032014-final-g5-treatment
 
Ashutosh_Sharma_7 Yrs_Manual Testing
Ashutosh_Sharma_7 Yrs_Manual TestingAshutosh_Sharma_7 Yrs_Manual Testing
Ashutosh_Sharma_7 Yrs_Manual Testing
 
PM
PMPM
PM
 
ITC_HLInfraPlan_v8
ITC_HLInfraPlan_v8ITC_HLInfraPlan_v8
ITC_HLInfraPlan_v8
 
How to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCI
How to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCIHow to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCI
How to Better Manage Cognos Upgrades: Leveraging the New Release of MotioCI
 
Improved Go to Market Time & Reduced Operational Cost
Improved Go to Market Time & Reduced Operational CostImproved Go to Market Time & Reduced Operational Cost
Improved Go to Market Time & Reduced Operational Cost
 
Automated budget management system
Automated budget management systemAutomated budget management system
Automated budget management system
 
Go beyond job scheduling
Go beyond job schedulingGo beyond job scheduling
Go beyond job scheduling
 
Indian CST's GPMS Products Portfolio 2015
Indian CST's GPMS Products Portfolio 2015Indian CST's GPMS Products Portfolio 2015
Indian CST's GPMS Products Portfolio 2015
 
NYC Dept. of Buildings Reorganization and Strategy
NYC Dept. of Buildings Reorganization and StrategyNYC Dept. of Buildings Reorganization and Strategy
NYC Dept. of Buildings Reorganization and Strategy
 
USAID KESIP II - Final Deliverable
USAID KESIP II - Final DeliverableUSAID KESIP II - Final Deliverable
USAID KESIP II - Final Deliverable
 

More from Linuxmalaysia Malaysia

Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...
Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...
Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...Linuxmalaysia Malaysia
 
Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...
Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...
Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...Linuxmalaysia Malaysia
 
Malaysia Open Source Conference MOSCMY 2013 Itinerary And Streams MOSC2013 a...
Malaysia Open Source Conference MOSCMY 2013  Itinerary And Streams MOSC2013 a...Malaysia Open Source Conference MOSCMY 2013  Itinerary And Streams MOSC2013 a...
Malaysia Open Source Conference MOSCMY 2013 Itinerary And Streams MOSC2013 a...Linuxmalaysia Malaysia
 
MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013
MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013
MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013Linuxmalaysia Malaysia
 
Brochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochure
Brochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochureBrochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochure
Brochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochureLinuxmalaysia Malaysia
 
Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)
Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)
Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)Linuxmalaysia Malaysia
 
FOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysia
FOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysiaFOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysia
FOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysiaLinuxmalaysia Malaysia
 
Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...
Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...
Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...Linuxmalaysia Malaysia
 
Sponsorship Prospectus Malaysia Open Source Conference 2012 (MOSC2012)
Sponsorship Prospectus Malaysia Open Source Conference 2012  (MOSC2012)Sponsorship Prospectus Malaysia Open Source Conference 2012  (MOSC2012)
Sponsorship Prospectus Malaysia Open Source Conference 2012 (MOSC2012)Linuxmalaysia Malaysia
 
OSS Community Forum Regarding Proposed BCPM2011 SWOT Slide
OSS Community Forum Regarding Proposed BCPM2011 SWOT SlideOSS Community Forum Regarding Proposed BCPM2011 SWOT Slide
OSS Community Forum Regarding Proposed BCPM2011 SWOT SlideLinuxmalaysia Malaysia
 
Introduction To ICT Security Audit OWASP Day Malaysia 2011
Introduction To ICT Security Audit OWASP Day Malaysia 2011Introduction To ICT Security Audit OWASP Day Malaysia 2011
Introduction To ICT Security Audit OWASP Day Malaysia 2011Linuxmalaysia Malaysia
 
Building Smart Phone Web Apps MOSC2010 Bikesh iTrain
Building Smart Phone Web Apps MOSC2010 Bikesh iTrainBuilding Smart Phone Web Apps MOSC2010 Bikesh iTrain
Building Smart Phone Web Apps MOSC2010 Bikesh iTrainLinuxmalaysia Malaysia
 
OSDC.my Master Plan For Malaysia Open Source Community
OSDC.my Master Plan For Malaysia Open Source CommunityOSDC.my Master Plan For Malaysia Open Source Community
OSDC.my Master Plan For Malaysia Open Source CommunityLinuxmalaysia Malaysia
 
33853955 bikesh-beginning-smart-phone-web-development
33853955 bikesh-beginning-smart-phone-web-development33853955 bikesh-beginning-smart-phone-web-development
33853955 bikesh-beginning-smart-phone-web-developmentLinuxmalaysia Malaysia
 
Open Source Tools for Creating Mashups with Government Datasets MOSC2010
Open Source Tools for Creating Mashups with Government Datasets MOSC2010Open Source Tools for Creating Mashups with Government Datasets MOSC2010
Open Source Tools for Creating Mashups with Government Datasets MOSC2010Linuxmalaysia Malaysia
 
DNS solution trumps cloud computing competition
DNS solution trumps cloud computing competitionDNS solution trumps cloud computing competition
DNS solution trumps cloud computing competitionLinuxmalaysia Malaysia
 
Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)
Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)
Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)Linuxmalaysia Malaysia
 

More from Linuxmalaysia Malaysia (20)

Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...
Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...
Big Data - Harisfazillah Jamel - Startup and Developer 4th Meetup 5th Novembe...
 
Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...
Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...
Call For Speakers Malaysia Open Source Conference 2014 (MOSCMY 2014 - MOSCMY2...
 
Malaysia Open Source Conference MOSCMY 2013 Itinerary And Streams MOSC2013 a...
Malaysia Open Source Conference MOSCMY 2013  Itinerary And Streams MOSC2013 a...Malaysia Open Source Conference MOSCMY 2013  Itinerary And Streams MOSC2013 a...
Malaysia Open Source Conference MOSCMY 2013 Itinerary And Streams MOSC2013 a...
 
MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013
MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013
MOSC2013 MOSCMY Brochure Malaysia Open Source Conference 2013
 
Brochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochure
Brochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochureBrochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochure
Brochure Malaysia Open Source Conference 2013 MOSCMY 2013 (MOSC2013) brochure
 
Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)
Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)
Hala Tuju Kemahiran Keselamatan Komputer Dan Internet (ICT)
 
FOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysia
FOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysiaFOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysia
FOSSDAY@IIUM 2012 Cloud Presentation By LinuxMalaysia
 
Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...
Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...
Questionnaire For Establishment Of Board of Computing Professionals Malaysia ...
 
Sponsorship Prospectus Malaysia Open Source Conference 2012 (MOSC2012)
Sponsorship Prospectus Malaysia Open Source Conference 2012  (MOSC2012)Sponsorship Prospectus Malaysia Open Source Conference 2012  (MOSC2012)
Sponsorship Prospectus Malaysia Open Source Conference 2012 (MOSC2012)
 
OSS Community Forum Regarding Proposed BCPM2011 SWOT Slide
OSS Community Forum Regarding Proposed BCPM2011 SWOT SlideOSS Community Forum Regarding Proposed BCPM2011 SWOT Slide
OSS Community Forum Regarding Proposed BCPM2011 SWOT Slide
 
Introduction To ICT Security Audit OWASP Day Malaysia 2011
Introduction To ICT Security Audit OWASP Day Malaysia 2011Introduction To ICT Security Audit OWASP Day Malaysia 2011
Introduction To ICT Security Audit OWASP Day Malaysia 2011
 
Building Smart Phone Web Apps MOSC2010 Bikesh iTrain
Building Smart Phone Web Apps MOSC2010 Bikesh iTrainBuilding Smart Phone Web Apps MOSC2010 Bikesh iTrain
Building Smart Phone Web Apps MOSC2010 Bikesh iTrain
 
OSDC.my Master Plan For Malaysia Open Source Community
OSDC.my Master Plan For Malaysia Open Source CommunityOSDC.my Master Plan For Malaysia Open Source Community
OSDC.my Master Plan For Malaysia Open Source Community
 
33853955 bikesh-beginning-smart-phone-web-development
33853955 bikesh-beginning-smart-phone-web-development33853955 bikesh-beginning-smart-phone-web-development
33853955 bikesh-beginning-smart-phone-web-development
 
Open Source Tools for Creating Mashups with Government Datasets MOSC2010
Open Source Tools for Creating Mashups with Government Datasets MOSC2010Open Source Tools for Creating Mashups with Government Datasets MOSC2010
Open Source Tools for Creating Mashups with Government Datasets MOSC2010
 
DNS solution trumps cloud computing competition
DNS solution trumps cloud computing competitionDNS solution trumps cloud computing competition
DNS solution trumps cloud computing competition
 
Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)
Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)
Brochure MSC Malaysia Open Source Conference 2010 (MSC MOSC2010)
 
Sesuaikan Masa Sempena 2010
Sesuaikan Masa Sempena 2010Sesuaikan Masa Sempena 2010
Sesuaikan Masa Sempena 2010
 
OSS Community In Malaysia 2009 List
OSS Community In Malaysia 2009 ListOSS Community In Malaysia 2009 List
OSS Community In Malaysia 2009 List
 
List Of OSS Communities Malaysia 2009
List Of OSS Communities Malaysia 2009List Of OSS Communities Malaysia 2009
List Of OSS Communities Malaysia 2009
 

Benchmarking On Web Server For Budget 2008 Day

  • 1. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE (OSS) PROGRAMME BENCHMARK/EVALUATION REPORT on WEB SERVERS for BUDGET 2008 DAY AUGUST 2008
  • 2. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day Copyright The government of Malaysia retains the copyright of this document.
  • 3. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day Table of Contents 1.0 EXECUTIVE SUMMARY.....................................................................................................1 2.0 INTRODUCTION..................................................................................................................1 2.1 Background ......................................................................................................................1 2.2 Purpose ............................................................................................................................2 2.3 Scope .............................................................................................................................3 2.3.1 Benchmarking activities ............................................................................................3 2.3.2 Visitor access statistic ..............................................................................................3 2.3.3 Personnel involved ...................................................................................................4 3.0 METHODOLOGY ................................................................................................................5 3.1 Benchmarking methodology ............................................................................................5 3.2 Visitor access recording and statistic generation ............................................................5 4.0 BENCHMARKING REPORT ...............................................................................................6 4.1 Benchmarking Activities..................................................................................................6 4.1.1 Experimental Setup ..................................................................................................6 4.1.2 Test System Specification And Configuration ...........................................................7 4.1.3 Commands Used ......................................................................................................7 4.2 Result of Benchmarking Exercise ..................................................................................9 4.2.1 Apache Web Server 2.2.3 .........................................................................................9 4.2.2 Lighttpd Web Server 1.4.15-1 ................................................................................10 4.3 Proposed Infrastructure Solution ...................................................................................11 5.0 BUDGET DAY SERVER OPERATION REPORT .............................................................13 5.1 Server Preparation Activities .......................................................................................13 5.2 Production Server Setup & Configuration ...................................................................13 5.2.1 Sysctl.conf ..............................................................................................................13 5.2.2 Synchronization scripts ..........................................................................................14 5.3 Budget Day Operation Report .....................................................................................17 5.4 Visitors Statistic For The Budget Day ..........................................................................17 5.4.1 General statistic ......................................................................................................17 5.4.2 Visitors per hour......................................................................................................18 5.4.3 Visitors by countries (Top 20) .................................................................................19 5.4.4 Visitors by operating system types..........................................................................20 5.4.5 Visitors by browser types.........................................................................................20 6.0 BENEFITS OF OSCC'S PARTICIPATION ........................................................................21 7.0 CONCLUSION ..................................................................................................................22 8.0 APPENDICES ..................................................................................................................24 8.1 Snapshot Treasury Portal during the Budget Day .........................................................24 8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded ...........25 8.3 Snapshot of Awstats reports...........................................................................................26 8.4 Snapshot of appreciation letter from MOF.....................................................................27
  • 4. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 1.0 EXECUTIVE SUMMARY This document is designed to provide detailed report of all exercises done by OSCC during their participation in preparing a dedicated web server for the Budget 2008 presentation day conducted by the Ministry Of Finance (MOF). Due to a massive visitor access spike projected during the budget day, OSCC team has been assigned to propose, set up and maintain a web server infrastructure solution based on Open Source technology that is reliable to handle the visitor surge, secure and cost saving. This solution is meant to replace the solution adopted by MOF for the past years that are too expensive and complex. The solution provided by OSCC has successfully performs reliably and receives more than 130,000 page views without any problem. The solution also saves MOF a huge amount of money as it eliminates the need of expensive hardwares and it only uses a single unit of server equipped with free Open Source softwares. All activities, findings and information will be presented in detail within this report which will be used as source of reference for similar implementation in the future. 2.0 INTRODUCTION 2.1 Background Over the years Ministry Of Finance's (MOF) website (http://www.treasury.gov.my) receives a huge number of web accesses particularly during the national budget day presentation. These spikes of requests were caused by a large number of visitors trying to get information concerning the upcoming year's budget and also downloading the Malaysia Economic Reports in digital format documents. Visitors also access the website to get information about the live video broadcast of the presentation, and for this purpose the treasury website only provide a web URL to a third party portal that handles the web broadcast. For the past years OSCC had involved whether directly or indirectly in providing consultancy and human expertise in preparing a suitable server solution for the budget presentation day. It was Page 1
  • 5. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day reported that in 2005, during the Malaysian Budget 2006 presentation day, such huge visitor accesses had caused the web server to stall due to the excessive load congesting the server resources. This event had caused denial of service state to the server thus causing failure of web access requests to the visitors. To prevent the situation from happening again, for the Malaysian Budget 2007 presentation day in 2006, drastic approaches have been taken. An alternative server infrastructure consists of several unit of servers with load balancing approach was implemented to substitute the actual web server only for the budget days period. This solution was installed a few days prior to the budget date and being decommissioned several days after once visitor access numbers back to normal day to day routine. The solution had proven to be reliable as there are no denial of access reported but for MOF's view, it was somewhat too expensive and too complicated and they are seeking for a more practical and economical approach for the next national budget day. In August 2007, OSCC once again been invited to provide consultancy and to facilitate the preparation process for the Malaysian Budget 2008 presentation day. Both R&D and Technical Unit of OSCC involved cooperatively to propose, design, install and operates a suitable server solution for the budget day. 2.2 Purpose The purpose of this document is to:- 1. Identify suitable web server infrastructure solution to be applied by Ministry Of Finance for the Budget 2008 presentation day 2. To identify whether or not a server load balancing formation is needed to handle high web access request on the particular day 3. To determine which type of web server package to be used 4. To provide reports of operations initiated during the actual budget presentation day 5. To present web access statistic captured for the whole budget day 6. To table any related findings gathered during and after the operation day Page 2
  • 6. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day The testing is not in any way done to declare which web server application is better compared to others, but merely to find which solution is the most suitable within the scope of our specific requirement. Therefore, any results, findings and recommendation provided in this report should not be considered as a generalized head to head comparison. 2.3 Scope 2.3.1 Benchmarking activities Only two web servers software were selected to be the testing subjects which were Apache (http://www.apache.org) and Lighttpd (http://www.lighttpd.net). All testing activities were done on machines with the same hardware specifications, identical operating systems and similar configurations and performance tuning settings. All testing were done in a lab located in OSCC. All network connections were Local Area Network in nature which means that maximum network bandwidth should be approximately 100Mbps. 2.3.2 Visitor access statistic This report examines visitor activity log data for the website www.treasury.gov.my only for the budget presentation day which is on the 7th September 2007. Only genuine human visitor will be counted in the analysis and no visits or page hits by automated robots such as crawler, bots and external data mining agents will be used within this report. Due to the internet nature of 'the world without boundaries', visitor origins in the analysis will be from all over the world which is not limited to specific geographical location. Data that will be taken into consideration are hourly unique visitors and visitors which are divided by countries. The analysis will also provide comparison between operating system types and internet browser types to estimate the percentage in term of users who are using open source technologies. Page 3
  • 7. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 2.3.3 Personnel involved Both RND and technical teams were involved directly with this project. There were also a number of personnel from MOF participate in various activities throughout the server benchmarking, server preparation and during operation day. OSCC personnel involved in the benchmarking activities: 1. Haris (R&D Unit) 2. Jamal (R&D Unit) 3. Hisham (Technical Unit) 4. Azizul (Technical Unit) 5. Maisarah (R&D Unit) 6. Indhran (R&D Unit) OSCC personnel involved for the server preparation and operation day: 1. Haris (R&D Unit) 2. Jamal (R&D Unit) 3. Hisham (Technical Unit) 4. Azizul (Technical Unit) Page 4
  • 8. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 3.0 METHODOLOGY 3.1 Benchmarking methodology The benchmarking activities were done using an open source web server stress test tool called ApacheBench (AB). ApacheBench is a command line computer program for measuring the performance of HTTP web servers, in particular the Apache HTTP Server. It was designed to give an idea of the performance that a given Apache installation can provide. In particular, it shows how many requests per second the server is capable of serving. A series of testing were done on each test subject and the results were recorded. On each occasion, a number of connections and quantity of concurrency were pre-determined. If the test finished successfully, meaning all request been served effectively by the test subject without any failed or denied request, the number of concurrency will be increased and another round of test will be done. The procedures were repeated until the subject matters fail to serve. This would mean that the limit of connection that the particular web server can handle has been found. By using this method, a comparison can be made on which web server has the capability to serve the highest number of connections and maintain availability through sudden spike of visitor access. 3.2 Visitor access recording and statistic generation Throughout the operation process including the budget presentation day, no additional monitoring tools were used on the web server rather than the conventional web server log capability provided by both Apache and Lighttpd. This is to minimize resource usage of the particular server to keep the free of unnecessary overhead. The web server logs are kept in the access_log. Analyses were done to the log after the budget day to generate meaningful statistic using an open source log analyzer tool called Awstat (http://awstats.sourceforge.net). AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or mail server statistics, graphically. This log analyzer works as a CGI or from command line and shows you all possible information your log contains, in few graphical web pages. It uses a partial information file to be able to process large log files, often and quickly. It can analyze Page 5
  • 9. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day log files from all major server tools like Apache log files (NCSA combined/XLF/ELF log format or common/CLF log format), WebStar, IIS (W3C log format) and a lot of other web, proxy, wap, streaming servers, mail servers and some ftp servers. 4.0 BENCHMARKING REPORT 4.1 Benchmarking Activities 4.1.1 Experimental Setup A series of benchmarking activities were done using the Apache Bench tool. 2 servers with identical hardware specification, Operating System and configurations were installed with Apache and Lighttpd respectively. Machine A : Machine B : IP address : 10.20.20.51 IP address : 10.20.20.52 Apache 2.2.3 Lighttpd 1.4.15-1 Another machine was being set up as the testing terminal where the benchmarking and stress test tool will be executed. This machine was equipped with the Apache Bench Tool. Page 6
  • 10. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 4.1.2 Test System Specification And Configuration All machines specification are identical. Using the same hardware model, operating system and configurations. Maker Model HP DC770 Processor Intel(R) Pentium(R) D CPU 3.20GHz RAM 512 MB Hard Disk 40 GB Operating System Linux CentOS 5 4.1.3 Commands Used Command used to launch the benchmarking process ab –n 10000 –c xxx http://ipaddress/ Where :- –n is the number of connections to be generated during the test emulating the number of web access estimated to be received by the server within a specific timeframe (approximately below 20 seconds) during the budget day. The value 10000 was pre-determined by the team as the appropriate number of estimated connection judging by the projected number of web access for the upcoming budget day based on the past years pattern. –c is the number of concurrent connection that will take place during the series of tests. This is the most crucial element within the benchmarking activities, understanding that the aspect of availability should be the highest priority in the choosing the most suitable solution. For each round of testing, the number of concurrent connection will be increased until error encountered which signals the actual limit where the web server capable of serving. Example : ab –n 10000 –c 500 http://10.20.20.52/ *Testing the Machine B with 10000 number of connection with 500 number of concurrency. During the test, system resource utilization was monitored and logged using vmstat Page 7
  • 11. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day command. This was to find any spike of resource usage or any occurrence of I/O bottleneck. Several data that were closely monitored were: CPU Idle To determine whether any excessive CPU usage occurred during the stress test process. High CPU Idle status means that the system is healthy Free Memory To determine whether any excessive RAM usage occurred during the stress test process. High Free Memory status means that the system is healthy Page 8
  • 12. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 4.2 Result of Benchmarking Exercise 4.2.1 Apache Web Server 2.2.3 Number of request (n) = 10,000 On each test round, Apache failed to surpass 400 concurrency connection level. Page 9
  • 13. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 4.2.2 Lighttpd Web Server 1.4.15-1 Number of request (n) = 10,000 Page 10
  • 14. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day Based on the above results, it is clear that Lighttpd capable of handling larger number of concurrent web requests compared to Apache when it comes to serving static web contents. The above rounds of tests were repeated a few times but the outcome persists. In addition, the team also tried a larger number of requests to the Lighttpd server which was supposedly beyond the scope of testing by increasing the –n number and the –c number and lighttpd proves to have the ability to withstand them. 4.3 Proposed Infrastructure Solution Based on the results of the testing, the team has decided to opt for Lighttpd as the web server to use. We are confident that a single server with adequate hardware specification, equipped with Lighttpd could withhold the high number of web access requests during the budget day provided that the server only servers static contents without any server side scripting nor any king of database connectivity involved. To make sure that the server uses resources efficiently and to increase stability, several modifications and fine tuning configurations will be done to the production server. These include CPU & RAM allocation and kernel optimization tuning. Unneeded services were also turned off minimize resource overhead. All software installation, modification and tuning processes will be done by OSCC with assistance of MOF personnel. In addition, one unit of standby server will be also placed alongside the production server for Page 11
  • 15. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day contingency measure such as in the event of hardware failure to the primary server. The standby server also has the same configuration and contents as the production server with almost identical hardware specification. The team had also suggested the use of multiple servers located in different data centers if in case large binary files such as 'self extracting compilation of economic reports' were going to be served and made available to the public as what have been done in the previous years. Those servers will act as the alternatives download locations listed as download links within the download page in the main portal, where visitors can choose from. This method will reduce the burdens of the primary portal. Those server were also equipped with Lighttpd where minimal hardware specification as low as a Personal Computer (PC) specification could be used. Based on mutual agreement with MOF, three alternative download locations were identified. Those three servers are: • The standby server which are located in NetMyne Datacenter alongside primary server • One unit of server located at Ministry of Finance • One unit of server located at OSCC A simple bash script was created to handle synchronization among servers to make sure that all servers have the same up-to-date web contents. The scripts will be provided in the later part of this document. *** However during the budget day, none of the alternative download servers were utilized, as there are no large binary files were served by MOF, and the main server showed no indication of congestion and it's resource utilization were successfully kept at the very minimum. Page 12
  • 16. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day Overview of the proposed server structure for Budget 2008 presentation day Page 13
  • 17. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 5.0 BUDGET DAY SERVER OPERATION REPORT 5.1 Server Preparation Activities All servers has been freshly installed with Linux CentOS 5 one week before the actual event. Several round of stress test were done on all machines to make sure they don't have any problem particularly on the hardware aspect. An overnight stress test also have be done using combination of AB stress tool and cron job to make sure that the servers are stable. 5.2 Production Server Setup & Configuration 5.2.1 Sysctl.conf Exact file location: /etc/sysctl.conf #additional parameter to increase performance kernel.shmmax = 436883456 kernel.shmall = 268435456 kernel.sem = 500 51200 64 2048 kernel.shmmni = 4096 fs.file-max = 65536 net.core.rmem_default = 262144 net.core.wmem_default = 262144 net.core.rmem_max = 262144 net.core.wmem_max = 262144 net.ipv4.ip_local_port_range = 1024 65000 kernel.msgmni = 2048 kernel.msgmax = 65536 vm.page-cluster = 20 net.ipv4.tcp_rmem = 4096 87380 16777216 net.ipv4.tcp_wmem = 4096 87380 16777216 net.ipv4.tcp_tw_reuse = 1 Page 14
  • 18. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 5.2.2 Synchronization scripts The main script (called via command line at the primary server by the system administrator) Exact file location: /usr/local/bin/rsync-mof #!/bin/bash # mirror-script.sh # created by Jamal if [ $(whoami) = bajet08 ]; then echo -e "nnProcess started. Please wait..." /usr/local/bin/rsync-mdec2 sleep 1 /usr/local/bin/rsync-oscc sleep 1 /usr/local/bin/rsync-treasury echo -e "Process finishednn" else echo -e "Denied: Only bajet08 user can run this scriptn" fi The above script will launch three series of rsync instances. /usr/local/bin/rsync-mdec2 #!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/mdec2-$DATE.log date >> /var/log/mirror/mdec2-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/mdec2- exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/mdec2-exec.log fi Page 15
  • 19. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day else echo "No process Detected" >> /var/log/mirror/mdec2-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "MDEC2 Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/mdec2-exec.log date #$rsync $mirror $local > $OUTFILE 2>&1 /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete /var/www/html/ 202.75.59.26:/var/www/html > $OUTFILE 2>&1 /usr/local/bin/rsync-oscc #!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/oscc-$DATE.log date >> /var/log/mirror/oscc-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/oscc-exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/oscc-exec.log fi else echo "No process Detected" >> /var/log/mirror/oscc-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "OSCC Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/oscc-exec.log date /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete /var/www/html/ 210.187.27.213:/var/www/html > $OUTFILE 2>&1 Page 16
  • 20. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day /usr/local/bin/rsync-treasury #!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/treasury-$DATE.log date >> /var/log/mirror/treasury-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/treasury- exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/treasury-exec.log fi else echo "No process Detected" >> /var/log/mirror/treasury-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "Treasury Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/treasury-exec.log date /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete /var/www/html/ 202.75.6.53:/var/www/html > $OUTFILE 2>&1 Page 17
  • 21. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 5.3 Budget Day Operation Report Several OSCC staffs have been located at all critical points where the servers reside. Each of them will monitor the log files activity of each server for any kind of problem. Live report file uploading processes were done by MOF's staff directly to the primary server and the synchronization scripts will distribute and duplicate the changes to other backup servers. There are no occurrence of error detected for the whole day and the backup servers were not utilized at all as the primary server shows any symptom of resources drainage. 5.4 Visitors Statistic For The Budget Day Below is the visitor statistic collected during the Budget 2008 Presentation Day which was held on 7th September 2007. All data were taken from web access log and was analyzed using Awstats. Only the primary server was used during that day, therefore all statistics shown here are purely from a single server. 5.4.1 General statistic Date : 7th September 2007 Total number of unique visitors 9, 874 Total number of visits 12, 796 (1.29 visits/visitor) Total number of pages viewed 130, 398 (10.19 Pages/Visit) Total number of hits generated 519, 184 (40.57 Hits/Visit) Total bandwidth consumed 4.58 GB (374.95 KB/Visit) Page 18
  • 22. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 5.4.2 Visitors per hour Hours Pages Hits Bandwidth 00:00 am 282 1263 7,619,401 01:00 am 145 601 4,713,187 02:00 am 114 486 3,400,969 03:00 am 96 377 2,695,992 04:00 am 56 160 973,597 05:00 am 45 144 1,096,283 06:00 am 110 504 3,377,156 07:00 am 671 3,800 18,702,079 08:00 am 1,979 10,428 56,068,174 09:00 am 2,505 11,851 70,603,683 10:00 am 2,739 12,972 79,936,375 11:00 am 3,046 14,192 79,977,401 12:00 pm 2,192 10,347 59,969,313 01:00 pm 1,626 7,457 44,138,365 02:00 pm 5,388 23,544 142,280,704 03:00 pm 16,097 76,505 393,637,888 04:00 pm 32,647 150,655 580,046,848 05:00 pm 28,605 104,234 1,040,812,032 06:00 pm 12,070 33,375 835,983,360 07:00 pm 5,166 16,029 343,683,072 08:00 pm 3,335 11,222 264,849,408 09:00 pm 5,187 12,175 405,623,808 10:00 pm 4,551 10,335 380,430,336 11:00 pm 1,746 6,529 92,384,038 * The above data doesn't includes traffic generated by robots, worms, or replies with special HTTP status codes. Page 19
  • 23. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 5.4.3 Visitors by countries (Top 20) No Country Pages Hits Bandwidth 1. Malaysia 119,908 485,441 4.29 MB 2. United States 2,559 7,589 59.42 MB 3. Singapore 2,468 6,838 61.50 MB 4. Japan 1,125 3,672 20.01 MB 5. Australia 715 2,862 22.97 MB 6. India 551 953 45.21 MB 7. Hong Kong 541 2,103 12.63 MB 8. European country 439 1,640 14.87 MB 9. Great Britain 379 1,422 17.34 MB 10. France 191 755 3.86 MB 11. Indonesia 179 636 4.95 MB 12. China 161 672 3.30 MB 13. Germany 154 466 3.92 MB 14. South Korea 134 646 2.31 MB 15. Philippine 74 198 1.62 MB 16. Taiwan 67 290 1.97 MB 17. New Zealand 61 278 1.24 MB 18. Qatar 48 141 1.56 MB 19. Switzerland 45 224 1.22 MB 20. United Arab Emirates 42 177 0.53 MB Page 20
  • 24. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 5.4.4 Visitors by operating system types Operating Systems Hits Percent 1. Windows 500,848 96.40% 2. Unknown 14,574 2.80% 3. Macintosh 1,829 0.30% 4. Linux 1,559 0.30% 5. Symbian OS 332 0% 6. Sun Solaris 42 0% 5.4.5 Visitors by browser types Browsers Hits Percent 1. MS Internet Explorer 445,607 85.80% 2. Firefox 54,316 10.40% 3. NetAnts 10,638 2.00% 4. Mozilla 2,244 0.40% 5. Unknown 1,919 0.30% 6. Opera 1,826 0.30% 7. Safari 1,764 0.30% 8. Netscape 570 0.10% 9. RssReader (RSS Reader) 82 0% 10. K-Meleon 37 0% 11. Others 181 0% Page 21
  • 25. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 6.0 BENEFITS OF OSCC'S PARTICIPATION Benefits for OSCC 1. OSCC gained significant visibility during Budget Day 2008 by having its logo embedded within the treasury.gov.my website from 2.00pm until 5.00pm. More than 250,000 hits generated during that time-frame. 2. Valuable knowledge based on research about comparison between 2 open-source web server (Apache/Lighttpd). 3. Data will be used for OSCC OSS benchmarking reports as part of RND department deliverables 4. Transfer of technology, exposure and knowledge sharing about Open Source technology to MOF. 5. Providing solid proof about reliability, flexibility and future potential of open source products . 6. Valuable lessons and experience for all OSCC Technical and RND department staffs . 7. Helping MOF in substantially reducing the total cost for preparing budget day server compared to previous years. Page 22
  • 26. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 7.0 CONCLUSION Overall, our recommended server infrastructure solution performs reliably in serving such high number of web access for the www.treasury.gov.my portal during the budget 2008 presentation day. All requests were successfully served and the server did not encounter any kind of problem such as network congestion or service interruption during the production period. The resource utilization of the server also kept at very minimum with majority of the system resources such as CPU and RAM were underutilized which means that the same setup could theoretically handles even larger number of web access request in the future if the same infrastructure solution and practices were to be reused. Both MOF and OSCC have gained valuable experiences and knowledge throughout each of the project phase especially during the benchmarking, installation and production phase. Those knowledge and experience would be helpful in improving OSCC operation most importantly in the technical aspects in the future. The benchmarking activities have provided valuable knowledge especially in realizing the solidness of open source web server products particularly for Lighttpd web application. Although the team did not took the results as absolute declaration of which web server is the better compared to others as there a a lot of external variables should be considered in making any justification, nevertheless it was a good indicator of the wide variety of possibilities offered by the open source world where there are so many alternatives to choose from in catering any specific needs. Based on number of visitors divided by operating system types and internet browser types, Microsoft has proven that they dominated the operating system and internet browser application market especially for desktop workstation among the internet users particularly in Malaysia. This information is crucial to the future strategic planning for OSCC as it could be used as a guideline or reference in tabulating the trend of open source usage among the Malaysian people. Only 0.30% of the total visitors were using Linux operating system while for Page 23
  • 27. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day Open Source internet browser, Firefox only manage to achieve slightly above 10%. The number is tremendously small compared to the Microsoft and shows that user acceptance toward open source technologies for desktop workstation and software application is still arguable and majority of computer users are still prefer proprietary products. This is also indicates that there are still a large room for OSCC to work on in the future. Prepared by: Harifazillah Jamel, OSCC MAMPU Page 24
  • 28. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 8.0 APPENDICES 8.1 Snapshot Treasury Portal during the Budget Day Page 25
  • 29. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded Page 26
  • 30. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 8.3 Snapshot of Awstats reports Page 27
  • 31. MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day 8.4 Snapshot of appreciation letter from MOF Page 28