SlideShare a Scribd company logo
1 of 17
Download to read offline
LVS Project: 14
              Years Development
              and Experience

                            Wensong Zhang
                    The 11th Northeast Asia OSS Promotion Forum
                                     2012.11.14




The 11th Northeast Asia
                                        Page 1
OSS Promotion Forum
About Me
        Wensong Zhang,
         Ph.D.
        Working at Alibaba,
         leading software
         infrastructure team
        LVS founder &
         developer
        Was the chief scientist
         and co-founder of
         TelTel, an associate
         professor at NUDT,
         the co-founder of
         ChinaCluster, and Red
         Hat Kernel Developer



The 11th Northeast Asia
                                   Page 2
OSS Promotion Forum
LVS Framework

     The Linux Virtual Server
     Project
      The   goal of the Linux Virtual Server
         project
            to provide a basic framework for building
             highly scalable and highly available
             network services using a large cluster of
             commodity servers.
      http://www.LinuxVirtualServer.org


The 11th Northeast Asia
                               Page 3
OSS Promotion Forum
LVS Framework

     Framework




The 11th Northeast Asia
                          Page 4
OSS Promotion Forum
LVS Framework

     IP Virtual Server
      Implemented   in the Linux kernel
      Three IP load balancing techniques
            Virtual Server via NAT
            Virtual Server via IP Tunneling
            Virtual Server via Direct Routing
      Ten          scheduling algorithms
          IPVS is an advanced Layer-4 switching
The 11th Northeast Asia
                                 Page 5
OSS Promotion Forum
Building Scalable Network Service using LVS

     General Architecture
                                       3   tiers
                                          Load balancer
                                          Server cluster
                                          Shared storage
                                        Clusters
                                          Web
                                          Cache
                                          Email, etc
The 11th Northeast Asia
                              Page 6
OSS Promotion Forum
Characteristics of LVS
     Characteristics
      LVS  extends Linux kernel to support
       three IP load balancing techniques
      Ten scheduling algorithms
      High scalability (up to 100 nodes)

      High availability

      Supporting most TCP and UDP
       services, no modifications to either
       clients or servers
The 11th Northeast Asia
                              Page 7
OSS Promotion Forum
Characteristics of LVS
     Compared to Other
     Commercial Products
      More  IP load balancing techniques
      Multiple scheduling algorithms

      State synchronization

      A robust and stable code base, a large
       user and developer base.
      Reliability proven in big real world
       applications
      Free to everyone
The 11th Northeast Asia
                              Page 8
OSS Promotion Forum
Comments from LVS Users
        “ We tried virtually all of the commercial load
         balancers, LVS beats them all for reliability, cost,
         manageability, you-name-it”
       Jerry Glomph Black, Director, Internet & Technical Operations, Real
        Networks, Seattle Washington, USA
         http://marc.theaimsgroup.com/?1=linux-virtual-server&m=95385809030794&w=2

        “I can say without a doubt that lvs toasts F5/BigIP
         solutions, at least in our real world
         implementations. I wouldn’t trade a good lvs box for
         a Cisco Local Director either”
         Drew Streib, Information Architect, VA Linux Systems, USA
         http://marc.theaimsgroup.com/?1=linux-virtual-server&m=95385694529750&w=2
The 11th Northeast Asia
                                               Page 9
OSS Promotion Forum
Some Sites using LVS
      QQ.com   has deployed thousands of LVS
       in the production
      Alibaba has used about 500 LVS systems
      Baidu.com has used about 500 too
      sourceforge.net & linux.com
      real.com
      IBM and EDS use LVS in their solutions
      One of largest PC manufacturers
      There is about tens of thousands of LVS
       deployment on this planet
The 11th Northeast Asia
                          Page 10
OSS Promotion Forum
LVS Development
        I got my first Linux CD at the end of 1995, mainly
         installed Linux for fun, later used Linux servers in
         some SI solutions.
        May 1998: the first version of LVS was released
         as a patch for Linux kernel 2.0, which only
         supports VS/NAT and Round-Robin scheduling,
         very simple!
        Later, added more scheduling algorithms, and
         included some bug fixes, and so on.
        Nov 1998: implemented the VS/IPTunneling load
         balancing.
        May 1999: implemented the VS/DirectRouting
         load balancing, then ported it to the Linux kernel
         2.2

The 11th Northeast Asia
OSS Promotion Forum
                                 Page 11
                                                 11
LVS Development (cont’d)
      More and more people joined the project.
      May 2000: ported to the Linux kernel 2.4
      Sep 2002: ported to the Linux kernel 2.5
      Oct 2003: included into the Linux kernel 2.5
       devel trunk, and into the Linux kernel 2.4
       stable branch too.
      Nov 2003: Linux kernel 2.4.23 includes LVS
      Dec 2003: Linux kernel 2.6.0 includes LVS
      Nov 2008: Google engineers helped to add
       IPv6 support
      Feb 2010: SCTP protocol support was added


The 11th Northeast Asia
OSS Promotion Forum
                            Page 12
                                          12
LVS Global Collaboration




        Source: WIRED Magazine, Vol. 6, 2004

The 11th Northeast Asia
OSS Promotion Forum
                                    Page 13
                                                13
Some Insights
        It’s better to do things well first, then reward
         follows.
        Open source is a good way to get more users,
         users will test and give feedbacks.
        Open source is also a good way to collect
         requirements.
        Through open source development, we can get
         help from a lot of developers and talents, we can
         improve our skills through collaboration.
         Software quality is improved as well.
        Open source can make our code to have much
         longer lifecycle.



The 11th Northeast Asia
OSS Promotion Forum
                                Page 14
                                               14
Some Insights (Cont’d)
      The   ways that users run our software
       usually beyond our imagination.
      Do not think that it’s too hard to do open
       source, just write software and open
       source it.
      It’s important to write documents for
       open source projects, especially the
       QuickStart.
      It’s also very important to give
       acknowledgements to every contribution,
       then community can grow.

The 11th Northeast Asia
OSS Promotion Forum
                          Page 15
                                       15
Collateral
      The          Linux Virtual Server Project




                          (http://www.LinuxVirtualServer.org)
      wensong@linux-vs.org
The 11th Northeast Asia
                                           Page 16
OSS Promotion Forum
Q & A


                          Thanks!




The 11th Northeast Asia
                             Page 17
OSS Promotion Forum

More Related Content

What's hot

wikimedia-architecture
wikimedia-architecturewikimedia-architecture
wikimedia-architecture
Kapil Mohan
 
TSM 6.4.1 intro
TSM 6.4.1 intro TSM 6.4.1 intro
TSM 6.4.1 intro
Solv AS
 
Solaris 10 virtualization presentation
Solaris 10 virtualization presentationSolaris 10 virtualization presentation
Solaris 10 virtualization presentation
xKinAnx
 
OSS Presentation by Bryan Badger
OSS Presentation by Bryan BadgerOSS Presentation by Bryan Badger
OSS Presentation by Bryan Badger
OpenStorageSummit
 
Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2
Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2
Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2
ldangelo0772
 
Abhishek Mallik Storage Administrator Lead
Abhishek Mallik Storage Administrator  LeadAbhishek Mallik Storage Administrator  Lead
Abhishek Mallik Storage Administrator Lead
Abhishek Mallik
 

What's hot (20)

Chapter 04: Storage virtualization basics
Chapter 04: Storage virtualization basicsChapter 04: Storage virtualization basics
Chapter 04: Storage virtualization basics
 
Gluster Webinar: Introduction to GlusterFS
Gluster Webinar: Introduction to GlusterFSGluster Webinar: Introduction to GlusterFS
Gluster Webinar: Introduction to GlusterFS
 
Introduzione alla nuova famiglia di NAS SnapServer
Introduzione alla nuova famiglia di NAS SnapServerIntroduzione alla nuova famiglia di NAS SnapServer
Introduzione alla nuova famiglia di NAS SnapServer
 
wikimedia-architecture
wikimedia-architecturewikimedia-architecture
wikimedia-architecture
 
Accelerating Data Management - Dave Fellinger - RDAP12
Accelerating Data Management - Dave Fellinger - RDAP12 Accelerating Data Management - Dave Fellinger - RDAP12
Accelerating Data Management - Dave Fellinger - RDAP12
 
TSM 6.4.1 intro
TSM 6.4.1 intro TSM 6.4.1 intro
TSM 6.4.1 intro
 
Learn OpenStack from trystack.cn ——Folsom in practice
Learn OpenStack from trystack.cn  ——Folsom in practiceLearn OpenStack from trystack.cn  ——Folsom in practice
Learn OpenStack from trystack.cn ——Folsom in practice
 
Solaris 10 virtualization presentation
Solaris 10 virtualization presentationSolaris 10 virtualization presentation
Solaris 10 virtualization presentation
 
Securing Your Endpoints Using Novell ZENworks Endpoint Security Management
Securing Your Endpoints Using Novell ZENworks Endpoint Security ManagementSecuring Your Endpoints Using Novell ZENworks Endpoint Security Management
Securing Your Endpoints Using Novell ZENworks Endpoint Security Management
 
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS StorageWebinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
 
OSS Presentation by Bryan Badger
OSS Presentation by Bryan BadgerOSS Presentation by Bryan Badger
OSS Presentation by Bryan Badger
 
Genomics Deployments - How to Get Right with Software Defined Storage
 Genomics Deployments -  How to Get Right with Software Defined Storage Genomics Deployments -  How to Get Right with Software Defined Storage
Genomics Deployments - How to Get Right with Software Defined Storage
 
ttec NAS powered by Open-E
ttec NAS powered by Open-Ettec NAS powered by Open-E
ttec NAS powered by Open-E
 
Finding Virtual Coins in the Couch
Finding Virtual Coins in the CouchFinding Virtual Coins in the Couch
Finding Virtual Coins in the Couch
 
Curriculum vitae
Curriculum vitaeCurriculum vitae
Curriculum vitae
 
Novell Filr
Novell FilrNovell Filr
Novell Filr
 
Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2
Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2
Cisco at v mworld 2015 vmworld - cisco mds and emc xtrem_io-v2
 
Subhas_Resume_
Subhas_Resume_Subhas_Resume_
Subhas_Resume_
 
Database performance in blade environments: Dell PowerEdge M1000e vs. Cisco U...
Database performance in blade environments: Dell PowerEdge M1000e vs. Cisco U...Database performance in blade environments: Dell PowerEdge M1000e vs. Cisco U...
Database performance in blade environments: Dell PowerEdge M1000e vs. Cisco U...
 
Abhishek Mallik Storage Administrator Lead
Abhishek Mallik Storage Administrator  LeadAbhishek Mallik Storage Administrator  Lead
Abhishek Mallik Storage Administrator Lead
 

Similar to LVS development and experience

Linux Operating System (Graduate Level CIS Term Paper)
Linux Operating System (Graduate Level CIS Term Paper)Linux Operating System (Graduate Level CIS Term Paper)
Linux Operating System (Graduate Level CIS Term Paper)
Carla Bennington
 
Linux @ IBM © 2003 IBM Corporation
Linux @ IBM © 2003 IBM Corporation Linux @ IBM © 2003 IBM Corporation
Linux @ IBM © 2003 IBM Corporation
webhostingguy
 
SuSE-Linux-Migration-Guide-IIS-to-Apache
SuSE-Linux-Migration-Guide-IIS-to-ApacheSuSE-Linux-Migration-Guide-IIS-to-Apache
SuSE-Linux-Migration-Guide-IIS-to-Apache
Kurt Brust
 
Scaleable Enterprise Computing Andre Hill
Scaleable Enterprise Computing Andre HillScaleable Enterprise Computing Andre Hill
Scaleable Enterprise Computing Andre Hill
webhostingguy
 

Similar to LVS development and experience (20)

Linux Operating System (Graduate Level CIS Term Paper)
Linux Operating System (Graduate Level CIS Term Paper)Linux Operating System (Graduate Level CIS Term Paper)
Linux Operating System (Graduate Level CIS Term Paper)
 
Linux @ IBM © 2003 IBM Corporation
Linux @ IBM © 2003 IBM Corporation Linux @ IBM © 2003 IBM Corporation
Linux @ IBM © 2003 IBM Corporation
 
Cloud Native Application @ VMUG.IT 20150529
Cloud Native Application @ VMUG.IT 20150529Cloud Native Application @ VMUG.IT 20150529
Cloud Native Application @ VMUG.IT 20150529
 
Building Linux IPv6 DNS Server (Complete Soft Copy)
Building Linux IPv6 DNS Server (Complete Soft Copy)Building Linux IPv6 DNS Server (Complete Soft Copy)
Building Linux IPv6 DNS Server (Complete Soft Copy)
 
(APP303) Lightning Fast Deploys with Docker Containers and AWS | AWS re:Inven...
(APP303) Lightning Fast Deploys with Docker Containers and AWS | AWS re:Inven...(APP303) Lightning Fast Deploys with Docker Containers and AWS | AWS re:Inven...
(APP303) Lightning Fast Deploys with Docker Containers and AWS | AWS re:Inven...
 
SuSE-Linux-Migration-Guide-IIS-to-Apache
SuSE-Linux-Migration-Guide-IIS-to-ApacheSuSE-Linux-Migration-Guide-IIS-to-Apache
SuSE-Linux-Migration-Guide-IIS-to-Apache
 
OFC 2014 Dinesh Dutt
OFC 2014 Dinesh DuttOFC 2014 Dinesh Dutt
OFC 2014 Dinesh Dutt
 
The Future of Web Application Architectures
The Future of Web Application ArchitecturesThe Future of Web Application Architectures
The Future of Web Application Architectures
 
linux introduction
linux introductionlinux introduction
linux introduction
 
Scaleable Enterprise Computing Andre Hill
Scaleable Enterprise Computing Andre HillScaleable Enterprise Computing Andre Hill
Scaleable Enterprise Computing Andre Hill
 
Cloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumarCloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumar
 
Cloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumarCloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumar
 
Cont0519
Cont0519Cont0519
Cont0519
 
Microservices: How loose is loosely coupled?
Microservices: How loose is loosely coupled?Microservices: How loose is loosely coupled?
Microservices: How loose is loosely coupled?
 
Linux VDI with OpenStack – How to Deliver Linux Virtual Desktops on Demand
Linux VDI with OpenStack – How to Deliver Linux Virtual Desktops on DemandLinux VDI with OpenStack – How to Deliver Linux Virtual Desktops on Demand
Linux VDI with OpenStack – How to Deliver Linux Virtual Desktops on Demand
 
Docker - A high level introduction to dockers and containers
Docker - A high level introduction to dockers and containersDocker - A high level introduction to dockers and containers
Docker - A high level introduction to dockers and containers
 
Choosing the Right Community Linux for Your Enterprise
Choosing the Right Community Linux for Your EnterpriseChoosing the Right Community Linux for Your Enterprise
Choosing the Right Community Linux for Your Enterprise
 
Download It
Download ItDownload It
Download It
 
Open Source in the Enterprise
Open Source in the EnterpriseOpen Source in the Enterprise
Open Source in the Enterprise
 
Executive Briefing: The Why, What, and Where of Containers
Executive Briefing: The Why, What, and Where of ContainersExecutive Briefing: The Why, What, and Where of Containers
Executive Briefing: The Why, What, and Where of Containers
 

More from Wensong Zhang

开源+自主开发 - 淘宝软件基础设施构建实践
开源+自主开发  - 淘宝软件基础设施构建实践开源+自主开发  - 淘宝软件基础设施构建实践
开源+自主开发 - 淘宝软件基础设施构建实践
Wensong Zhang
 
淘宝软件基础设施构建实践
淘宝软件基础设施构建实践淘宝软件基础设施构建实践
淘宝软件基础设施构建实践
Wensong Zhang
 

More from Wensong Zhang (9)

开源+自主开发 - 淘宝软件基础设施构建实践
开源+自主开发  - 淘宝软件基础设施构建实践开源+自主开发  - 淘宝软件基础设施构建实践
开源+自主开发 - 淘宝软件基础设施构建实践
 
Linux二十周年 -致辞
Linux二十周年 -致辞Linux二十周年 -致辞
Linux二十周年 -致辞
 
Taobao图片存储与cdn系统到服务
Taobao图片存储与cdn系统到服务Taobao图片存储与cdn系统到服务
Taobao图片存储与cdn系统到服务
 
低功耗服务器定制与绿色计算
低功耗服务器定制与绿色计算低功耗服务器定制与绿色计算
低功耗服务器定制与绿色计算
 
淘宝软件基础设施构建实践
淘宝软件基础设施构建实践淘宝软件基础设施构建实践
淘宝软件基础设施构建实践
 
使用LVS集群架设高可扩展的网络服务
使用LVS集群架设高可扩展的网络服务使用LVS集群架设高可扩展的网络服务
使用LVS集群架设高可扩展的网络服务
 
Taobao海量图片存储与cdn系统
Taobao海量图片存储与cdn系统Taobao海量图片存储与cdn系统
Taobao海量图片存储与cdn系统
 
Taobao海量图片存储与cdn系统 v2-系统架构师
Taobao海量图片存储与cdn系统 v2-系统架构师Taobao海量图片存储与cdn系统 v2-系统架构师
Taobao海量图片存储与cdn系统 v2-系统架构师
 
稳定、高效、低碳 -淘宝软件基础设施构建实践
稳定、高效、低碳  -淘宝软件基础设施构建实践稳定、高效、低碳  -淘宝软件基础设施构建实践
稳定、高效、低碳 -淘宝软件基础设施构建实践
 

LVS development and experience

  • 1. LVS Project: 14 Years Development and Experience Wensong Zhang The 11th Northeast Asia OSS Promotion Forum 2012.11.14 The 11th Northeast Asia Page 1 OSS Promotion Forum
  • 2. About Me  Wensong Zhang, Ph.D.  Working at Alibaba, leading software infrastructure team  LVS founder & developer  Was the chief scientist and co-founder of TelTel, an associate professor at NUDT, the co-founder of ChinaCluster, and Red Hat Kernel Developer The 11th Northeast Asia Page 2 OSS Promotion Forum
  • 3. LVS Framework The Linux Virtual Server Project  The goal of the Linux Virtual Server project  to provide a basic framework for building highly scalable and highly available network services using a large cluster of commodity servers.  http://www.LinuxVirtualServer.org The 11th Northeast Asia Page 3 OSS Promotion Forum
  • 4. LVS Framework Framework The 11th Northeast Asia Page 4 OSS Promotion Forum
  • 5. LVS Framework IP Virtual Server  Implemented in the Linux kernel  Three IP load balancing techniques  Virtual Server via NAT  Virtual Server via IP Tunneling  Virtual Server via Direct Routing  Ten scheduling algorithms IPVS is an advanced Layer-4 switching The 11th Northeast Asia Page 5 OSS Promotion Forum
  • 6. Building Scalable Network Service using LVS General Architecture 3 tiers  Load balancer  Server cluster  Shared storage  Clusters  Web  Cache  Email, etc The 11th Northeast Asia Page 6 OSS Promotion Forum
  • 7. Characteristics of LVS Characteristics  LVS extends Linux kernel to support three IP load balancing techniques  Ten scheduling algorithms  High scalability (up to 100 nodes)  High availability  Supporting most TCP and UDP services, no modifications to either clients or servers The 11th Northeast Asia Page 7 OSS Promotion Forum
  • 8. Characteristics of LVS Compared to Other Commercial Products  More IP load balancing techniques  Multiple scheduling algorithms  State synchronization  A robust and stable code base, a large user and developer base.  Reliability proven in big real world applications  Free to everyone The 11th Northeast Asia Page 8 OSS Promotion Forum
  • 9. Comments from LVS Users  “ We tried virtually all of the commercial load balancers, LVS beats them all for reliability, cost, manageability, you-name-it” Jerry Glomph Black, Director, Internet & Technical Operations, Real Networks, Seattle Washington, USA http://marc.theaimsgroup.com/?1=linux-virtual-server&m=95385809030794&w=2  “I can say without a doubt that lvs toasts F5/BigIP solutions, at least in our real world implementations. I wouldn’t trade a good lvs box for a Cisco Local Director either” Drew Streib, Information Architect, VA Linux Systems, USA http://marc.theaimsgroup.com/?1=linux-virtual-server&m=95385694529750&w=2 The 11th Northeast Asia Page 9 OSS Promotion Forum
  • 10. Some Sites using LVS  QQ.com has deployed thousands of LVS in the production  Alibaba has used about 500 LVS systems  Baidu.com has used about 500 too  sourceforge.net & linux.com  real.com  IBM and EDS use LVS in their solutions  One of largest PC manufacturers  There is about tens of thousands of LVS deployment on this planet The 11th Northeast Asia Page 10 OSS Promotion Forum
  • 11. LVS Development  I got my first Linux CD at the end of 1995, mainly installed Linux for fun, later used Linux servers in some SI solutions.  May 1998: the first version of LVS was released as a patch for Linux kernel 2.0, which only supports VS/NAT and Round-Robin scheduling, very simple!  Later, added more scheduling algorithms, and included some bug fixes, and so on.  Nov 1998: implemented the VS/IPTunneling load balancing.  May 1999: implemented the VS/DirectRouting load balancing, then ported it to the Linux kernel 2.2 The 11th Northeast Asia OSS Promotion Forum Page 11 11
  • 12. LVS Development (cont’d)  More and more people joined the project.  May 2000: ported to the Linux kernel 2.4  Sep 2002: ported to the Linux kernel 2.5  Oct 2003: included into the Linux kernel 2.5 devel trunk, and into the Linux kernel 2.4 stable branch too.  Nov 2003: Linux kernel 2.4.23 includes LVS  Dec 2003: Linux kernel 2.6.0 includes LVS  Nov 2008: Google engineers helped to add IPv6 support  Feb 2010: SCTP protocol support was added The 11th Northeast Asia OSS Promotion Forum Page 12 12
  • 13. LVS Global Collaboration  Source: WIRED Magazine, Vol. 6, 2004 The 11th Northeast Asia OSS Promotion Forum Page 13 13
  • 14. Some Insights  It’s better to do things well first, then reward follows.  Open source is a good way to get more users, users will test and give feedbacks.  Open source is also a good way to collect requirements.  Through open source development, we can get help from a lot of developers and talents, we can improve our skills through collaboration. Software quality is improved as well.  Open source can make our code to have much longer lifecycle. The 11th Northeast Asia OSS Promotion Forum Page 14 14
  • 15. Some Insights (Cont’d)  The ways that users run our software usually beyond our imagination.  Do not think that it’s too hard to do open source, just write software and open source it.  It’s important to write documents for open source projects, especially the QuickStart.  It’s also very important to give acknowledgements to every contribution, then community can grow. The 11th Northeast Asia OSS Promotion Forum Page 15 15
  • 16. Collateral  The Linux Virtual Server Project (http://www.LinuxVirtualServer.org)  wensong@linux-vs.org The 11th Northeast Asia Page 16 OSS Promotion Forum
  • 17. Q & A Thanks! The 11th Northeast Asia Page 17 OSS Promotion Forum