SlideShare a Scribd company logo
1 of 45
The MySQL Server
Ecosystem in 2016
Colin Charles, Team MariaDB, MariaDB Corporation
colin@mariadb.com / byte@bytebot.net
http://bytebot.net/blog/ | @bytebot on Twitter
SCALE14x, Pasadena, California, USA
22 January 2016
whoami
• Work on MariaDB at MariaDB Corporation
(SkySQL Ab)
• Merged with Monty Program Ab, makers of
MariaDB
• Formerly MySQL AB (exit: Sun Microsystems)
• Past lives include Fedora Project (FESCO),
OpenOffice.org
• MySQL Community Contributor of theYear Award
winner 2014
2
A Mature Ecosystem
• MySQL: 21 years old — May 1995
• Percona Server: 7 years old — November
2008
• MariaDB: 6 years old — February 2010
• Drizzle: 2008 - 2012 (R.I.P.)
• WebScaleSQL: March 2014
3
History
• 1979: UNIREG
• 1986: UNIREG on UNIX
• mSQL - freely available but not opensource
• 1995: MySQL 1.0 + MySQL AB founded
• 1996: 3.19
• 2000: GPL MySQL Server
4
History 2
• Shortly thereafter, the dual-license arrives —
libmysql is GPL and not LGPL like before
• May 2000: 3.23.15 - (statement based)
replication arrives
• 2001: 3.23 GA
• 2001: InnoDB storage engine (InnoBase Oy)
• 2001: first roundVC $$$, Mårten Mickos as
CEO
5
History 3
• 2002: MySQL sued Progress NuSphere
over the Gemini storage engine
• 2003: VC Series B
• March 2003: 4.0 GA + 4.1 & 5.0 as alpha
• 2003: SAP partnership (hello MaxDB)
• 2003:Acquires Alzato (NDBCLUSTER)
6
History 4
• October 2004: 4.1 GA (with NDBCLUSTER)
• 2005: 5.0 tree is the focus, but it has issues
• October 2005: Oracle acquires Innobase Oy
(“InnoDB Friday”)
• October 2005: 5.0 becomes GA*
• Late 2005: Maria project starts (make a
crash-safe+transactional MyISAM)
7
History 5
• February 2006:VC Series C
• 2006: Netfrastructure acquired (Falcon engine)
• Pluggable storage architecture - only database
that support(ed) it
• A “fork” of MySQL Cluster in 2006
• 2006: PBXT (log-based design + performance)
… 2011
8
What makes engines
different?
• Storage: how the data is
stored on disk
• Or in NDB (memory
+disk),
CassandraSE
(access a
Cassandra Cluster),
SphinxSE (access
the Sphinx daemon)
• Indexes: improves
search operations
• Memory usage:
improves data access
for speed
• Transactions: protects
the integrity of your data
(Atomic-Consistent-
Isolated-Durable -
ACID)
• Locking level: MyISAM
(table locks), InnoDB
(row locks), old BDB
(page locks)
• Data types: Data types
may be converted,
MEMORY doesn’t
support TEXT, etc.
• Caching: InnoDB
caches data & indexes,
MyISAM caches
indexes only (relying on
OS disk cache for data)
• Full-text search
capability: MyISAM has
this, InnoDB 5.6 got this
• GIS: MyISAM & Aria
work (R-tree indexes
exist), InnoDB 5.7 has
this too
• Backups
• Foreign Keys
History 6
• November 2007: MySQL 6.0 Alpha, 5.1 current tree
being worked on but not ready
• 2007: quiet period for IPO
• January 2008: Sun Microsystems acquires MySQL AB
for USD$1 BILLION
• June 2008: Drizzle — fork of MySQL 6.0 — modular,
fast, microkernel architecture, UTF8, etc.
• November 2008: 5.1 GA
History 7
• Late 2008: OurDelta binaries
• November 2008: Percona Server (patchset ~July)
• http://www.bytebot.net/blog/archives/2009/10/14/
flickrs-upgraded-shard
History 8
• February 2009: Monty leaves Sun
• March 2009: Final 6.0 Alpha (and shortly dead
thereafter)
• April 2009: Oracle acquires Sun Microsystems (January
2010 sale completes, after a long battle with the EU)
• shortly thereafter Monty Program Ab is where
MariaDB starts being worked on
• October 2009: MariaDB 5.1 Beta release
History 9
• February 2010: MariaDB 5.1 GA release
• November 2010: MariaDB 5.2 GA release
• December 2010: MySQL 5.5 GA
• April 2011: Percona Server 5.5 stable
• February 2012: MariaDB 5.3 GA (GIS, replication
improvements, optimiser)
History 10
• April 2012: MariaDB 5.5 GA
• November 2012: Announcement of MariaDB
Foundation
• February 2013: MySQL 5.6 GA
• April 2013: SkySQL Ab acquires Monty Program
Ab
• October 2013: Percona Server 5.6 GA
History 11
• March 2014: MariaDB 10 GA
• March 2014: WebScaleSQL — but there’s no
GA/shipping release
• October 2015: MariaDB 10.1 GA, MySQL 5.7 GA
Open source community
• MariaDB: takes external contributors/committers
• MySQL: 5.7 takes Generated Columns (virtual columns in
MariaDB 5.2) from Andrey Zhakov
• contributions welcome, commits not
• see: MySQL Community Contributor Award Program
• WebScaleSQL: Alibaba, Facebook, Google, LinkedIn, and
Twitter (w/ Percona + MariaDB also agreeing to work on it)
• Percona: bug reports welcome, commits not
Google Summer of Code
• 2013: 3 contributors (all shipping code, one
committer)
• 2014: 4 contributors (all shipping code, a
MariaDB Foundation member hired a new
developer)
• 2015: accepted with 8 contributors, finally 3
passed
Security
• Oracle: watch for CPUs, or just wait for the next release
• MariaDB: CVEs get fixed quickly when reported
• Percona: roughly follows Oracle, but also takes security
from MariaDB
• http://www.mysqlperformanceblog.com/2013/01/13/
cve-2012-4414-in-mysql-5-5-29-and-percona-
server-5-5-29/
• For one issue (sql/password.c & memcmp()), MariaDB
was first to be patched
Is MySQL dying?
• “The reports of my death have been greatly
exaggerated” — Mark Twain
• MySQL ecosystem development is at its most
vibrant now than it has ever been
• Oracle has been a great steward of pushing
MySQL development forward
Global Top 20 Sites
1. Google
2. Facebook
3. YouTube
4. Baidu
5. Yahoo!
6. Wikipedia
7. Amazon
8. Twitter
9. QQ
10.Taobao
11.Google.co.in
12.LinkedIn
13.live.com
14.Sina
15.Weibo
16.yahoo.co.jp
17.Tmall
18.google.co.jp
19.google.de
20.Ebay
MySQL adoption
• MySQL Server (5.5) still leads the way in Debian/
Ubuntu (the only one you can track via popcon)
• Followed by MariaDB Server and then Percona
Server
• Today you can also see stats on the Docker hub,
Juju Charms, etc.
OpenStack user survey
But what about the external
ecosystem?
• Yahoo! develops monitoring tools
• Yelp opensources replication monitoring
• Box has tools
• Dropbox starts playing around with Fabric
• Booking deploys MaxScale in production
• Pinterest offers up their tools
MySQL 5.7
• Multi-source
replication
• Dynamic
replication filters
• Lossless
semisync
• SHOW EXPLAIN
for connection_id
• GIS functionality
• Statement
timeouts
• Change master
without stopping
SQL thread
• Online GTID
implementation
• GTID no longer
requires log-
slave-updates to
be enabled
• Virtual columns
(generated
columns)
• Online buffer pool
resize
• Username size
increase
• LOCK/UNLOCK
accounts
• JSON
MariaDB 10.1
• START TRANSACTION
WITH CONSISTENT
SNAPSHOT
• Integrated Galera Cluster
• Table/tablespace encryption
• Optimistic parallel
replication
• Enhanced semi-sync
replication
• InnoDB defragmentation
• ANALYZE <statement>
• Threadpool
• cracklib_password_check
• SQL error logging plugin
• Extended REGEXP (PCRE)
• Roles
Percona Server 5.6
• variable: numa_interleave
• restrict # of binlog files -
max_binlog_files
• Lock-free SHOW SLAVE STATUS
NOLOCK
• Percona Toolkit UDFs
• Expanded fast index creation -
expand_fast_index_creation
• Utility user - system access to
admin tasks, limited access to
user schema
• Slow query log enhancements
• Log all client commands to
syslog (coming to 5.7)
• Improved Memory storage
engine
• Per-query variable statement
• PROXY protocol support
• Backup locks
• TokuBackup
WebScaleSQL
• Clients can specify millisecond read/write/
connect timeouts
• Super read-only to prevent writes by SUPER
users
• Prefix index query optimisation
• Idle system flush rate
• Production-ready builds from PSCE
Facebook
• Dynamic columns + indexes? DocStore
• RocksDB, including myrocks_hotbackup
• Asynchronous mysql client support
• max_running_queries / max_waiting_queries
• Relay log writes don’t block SHOW SLAVE
STATUS
Twitter
• Last updated mid-June 2015 :(
• They made Apache Cotton for Mesos/MySQL
AliSQL
• Further optimised threadpool
• For Single’s Day, they have a “hot SKU” fix for inventory
deductions of a single SKU
• SQL firewall
• Temporary table space limitations
• Log SHUTDOWN information
• Persistent InnoDB AUTO_INCREMENT (MDEV-6076)
• Column level compression
What about the !server
external ecosystem?
• Percona Toolkit
• Percona Xtrabackup
• MariaDB MaxScale
• mydumper
• MHA
• Tungsten Replicator
• vitess
• ScaleDB & ScaleBase
• Tumblr JetPants
• MySQL Utilities
• MySQL Router
• MySQL Fabric
• PRM (w/Pacemaker)
• SeveralNines ClusterControl
• MMM
• ShardQuery + FlexViews
• MySQL Sandbox
• Numerous GUI tools: MySQL
Workbench, phpMyAdmin, SQLYog,
etc
(GNU/Linux) Distributions
• Most are defaulted to MariaDB Server 10 (some like
RHEL 7 are still on MariaDB Server 5.5)
• so when you ask for mysql, you effectively get
MariaDB Server (beware!)
• Debian is hotly contesting if it should drop MySQL or
not (see: Elasticsearch)
• however, today, Debian & Ubuntu ship MySQL as
default, MariaDB Server and Percona Server as
choices
Where are they now?
• Drizzle - single company opensource project
(Rackspace). Most went on to work at OpenStack
• PBXT - PrimeBase focuses on TeamDrive, out of the
engine business
• InfoBright
• Calpont InfiniDB - to MariaDB Corporation & Oracle
• Tokutek TokuDB - Percona acquires in April 2015
Future?
• MySQL 5.8 is being planned already. Look out for the
interesting work behind Cluster & group replication
• Percona Server aims to never become a fork — work
closely with Oracle. Look forward to 5.7
• MariaDB 10.2 will become more of a fork with various
features like window functions, CTEs, 5.7 compatibility,
etc.
• WebScaleSQL will skip MySQL 5.7; backports to
current tree + look at 5.8
Cloud MySQL
• Amazon Web Services Relational
Database Service (RDS): MySQL,
MariaDB,Aurora
• Rackspace Cloud Databases: MySQL,
MariaDB Server, Percona Server
• Google Cloud SQL: MySQL
• Aliyun: MySQL (+TokuDB)
• Jelastic - PaaS offering MySQL,
MariaDB
• ClearDB - MySQL on Heroku,Azure
• Joyent - Image offers Percona
MySQL and a Percona SmartMachine
• Google Compute Engine offers
Percona XtraDB Cluster as a “click-
to-deploy” app
• comes with Galera 3, Percona
Toolkit, XtraBackup as well
• Pivotal CloudFoundry - “MySQL”
PaaS which is MariaDB Galera
Cluster 10
• Red Hat OpenShift - MySQL 5.1/5.5,
MariaDB 5.5
• MariaDB Enterprise Cluster and
MaxScale on Microsoft Azure
Discussions
• http://planet.mysql.com/
• https://lists.launchpad.net/maria-developers/
• https://lists.launchpad.net/maria-discuss/
• https://groups.google.com/forum/#!forum/percona-discussion
• https://groups.google.com/forum/#!forum/maxscale
• https://groups.google.com/forum/#!forum/codership-team
• https://lists.mysql.com/internals (kinda dead :( )
Bugs
• http://bugs.mysql.com/
• https://bugs.launchpad.net/percona-server
• https://mariadb.atlassian.net/secure/
Dashboard.jspa
• Phabricator https://reviews.facebook.net/
Conferences/Events w/
dedicated MySQL track
• SCALE, Los Angeles, CA
• FOSDEM, Brussels, Belgium
• Percona Live Data Performance, Santa Clara, CA
• Percona Live Europe, Amsterdam, Netherlands
• Oracle OpenWorld, San Francisco, CA
• Various db.tech showcases in Japan
• DataOps LATAM, Buenos Aires, Argentina
What should you use?
• Think about the innovation today
• Think about the features you need today (with
tolerance for the roadmap & what comes
tomorrow)
• Beware vendor lock-in
• Ensure you are well supported
Resources
Resources II
A word from your sponsors
• MariaDB Corporation sponsored my T&E to come to this
conference
• They have a booth so you can check them out at #511 &
win a BB-8™ by Sphero
• Remember you can buy a MariaDB Enterprise
subscription to help you with your cloud deployments,
MariaDB Server usage, etc.
• Services include: 24x7 support, consulting, training,
remote DBA services, non-recurring engineering and more
for all variants of MySQL
Thank you!
Colin Charles
colin@mariadb.com / byte@bytebot.net
http://bytebot.net/blog | @bytebot on twitter
slides: slideshare.net/bytebot

More Related Content

What's hot

MariaDB 10 and what's new with the project
MariaDB 10 and what's new with the projectMariaDB 10 and what's new with the project
MariaDB 10 and what's new with the project
Colin Charles
 

What's hot (20)

Securing your MySQL / MariaDB Server data
Securing your MySQL / MariaDB Server dataSecuring your MySQL / MariaDB Server data
Securing your MySQL / MariaDB Server data
 
My first moments with MongoDB
My first moments with MongoDBMy first moments with MongoDB
My first moments with MongoDB
 
Best practices for MySQL/MariaDB Server/Percona Server High Availability
Best practices for MySQL/MariaDB Server/Percona Server High AvailabilityBest practices for MySQL/MariaDB Server/Percona Server High Availability
Best practices for MySQL/MariaDB Server/Percona Server High Availability
 
Lessons from database failures
Lessons from database failures Lessons from database failures
Lessons from database failures
 
Lessons from database failures
Lessons from database failuresLessons from database failures
Lessons from database failures
 
The Complete MariaDB Server tutorial
The Complete MariaDB Server tutorialThe Complete MariaDB Server tutorial
The Complete MariaDB Server tutorial
 
Databases in the hosted cloud
Databases in the hosted cloudDatabases in the hosted cloud
Databases in the hosted cloud
 
MySQL features missing in MariaDB Server
MySQL features missing in MariaDB ServerMySQL features missing in MariaDB Server
MySQL features missing in MariaDB Server
 
MariaDB Server Compatibility with MySQL
MariaDB Server Compatibility with MySQLMariaDB Server Compatibility with MySQL
MariaDB Server Compatibility with MySQL
 
Differences between MariaDB 10.3 & MySQL 8.0
Differences between MariaDB 10.3 & MySQL 8.0Differences between MariaDB 10.3 & MySQL 8.0
Differences between MariaDB 10.3 & MySQL 8.0
 
The Proxy Wars - MySQL Router, ProxySQL, MariaDB MaxScale
The Proxy Wars - MySQL Router, ProxySQL, MariaDB MaxScaleThe Proxy Wars - MySQL Router, ProxySQL, MariaDB MaxScale
The Proxy Wars - MySQL Router, ProxySQL, MariaDB MaxScale
 
MariaDB 10: The Complete Tutorial
MariaDB 10: The Complete TutorialMariaDB 10: The Complete Tutorial
MariaDB 10: The Complete Tutorial
 
MariaDB 10 Tutorial - 13.11.11 - Percona Live London
MariaDB 10 Tutorial - 13.11.11 - Percona Live LondonMariaDB 10 Tutorial - 13.11.11 - Percona Live London
MariaDB 10 Tutorial - 13.11.11 - Percona Live London
 
Better encryption & security with MariaDB 10.1 & MySQL 5.7
Better encryption & security with MariaDB 10.1 & MySQL 5.7Better encryption & security with MariaDB 10.1 & MySQL 5.7
Better encryption & security with MariaDB 10.1 & MySQL 5.7
 
MariaDB 10 and what's new with the project
MariaDB 10 and what's new with the projectMariaDB 10 and what's new with the project
MariaDB 10 and what's new with the project
 
Best practices for MySQL High Availability Tutorial
Best practices for MySQL High Availability TutorialBest practices for MySQL High Availability Tutorial
Best practices for MySQL High Availability Tutorial
 
Why MariaDB?
Why MariaDB?Why MariaDB?
Why MariaDB?
 
A beginners guide to MariaDB
A beginners guide to MariaDBA beginners guide to MariaDB
A beginners guide to MariaDB
 
MariaDB 10: A MySQL Replacement - HKOSC
MariaDB 10: A MySQL Replacement - HKOSC MariaDB 10: A MySQL Replacement - HKOSC
MariaDB 10: A MySQL Replacement - HKOSC
 
The MySQL ecosystem - understanding it, not running away from it!
The MySQL ecosystem - understanding it, not running away from it! The MySQL ecosystem - understanding it, not running away from it!
The MySQL ecosystem - understanding it, not running away from it!
 

Similar to The MySQL Server ecosystem in 2016

Similar to The MySQL Server ecosystem in 2016 (20)

The MySQL Server ecosystem in 2016
The MySQL Server ecosystem in 2016The MySQL Server ecosystem in 2016
The MySQL Server ecosystem in 2016
 
The MySQL Server Ecosystem in 2016
The MySQL Server Ecosystem in 2016The MySQL Server Ecosystem in 2016
The MySQL Server Ecosystem in 2016
 
Maria db 10 and the mariadb foundation(colin)
Maria db 10 and the mariadb foundation(colin)Maria db 10 and the mariadb foundation(colin)
Maria db 10 and the mariadb foundation(colin)
 
MySQL Ecosystem in 2023 - FOSSASIA'23 - Alkin.pptx.pdf
MySQL Ecosystem in 2023 - FOSSASIA'23 - Alkin.pptx.pdfMySQL Ecosystem in 2023 - FOSSASIA'23 - Alkin.pptx.pdf
MySQL Ecosystem in 2023 - FOSSASIA'23 - Alkin.pptx.pdf
 
OSDC 2017 | Lessons from database failures by Colin Charles
OSDC 2017 | Lessons from database failures by Colin CharlesOSDC 2017 | Lessons from database failures by Colin Charles
OSDC 2017 | Lessons from database failures by Colin Charles
 
OSDC 2018 | Scaling & High Availability MySQL learnings from the past decade+...
OSDC 2018 | Scaling & High Availability MySQL learnings from the past decade+...OSDC 2018 | Scaling & High Availability MySQL learnings from the past decade+...
OSDC 2018 | Scaling & High Availability MySQL learnings from the past decade+...
 
MariaDB: in-depth (hands on training in Seoul)
MariaDB: in-depth (hands on training in Seoul)MariaDB: in-depth (hands on training in Seoul)
MariaDB: in-depth (hands on training in Seoul)
 
The Complete MariaDB Server Tutorial - Percona Live 2015
The Complete MariaDB Server Tutorial - Percona Live 2015The Complete MariaDB Server Tutorial - Percona Live 2015
The Complete MariaDB Server Tutorial - Percona Live 2015
 
MariaDB 初学者指南
MariaDB 初学者指南MariaDB 初学者指南
MariaDB 初学者指南
 
MySQL in the Cloud
MySQL in the CloudMySQL in the Cloud
MySQL in the Cloud
 
Mariadb10 和新项目中有什么
Mariadb10 和新项目中有什么Mariadb10 和新项目中有什么
Mariadb10 和新项目中有什么
 
Databases in the hosted cloud
Databases in the hosted cloud Databases in the hosted cloud
Databases in the hosted cloud
 
MySQL in the Hosted Cloud
MySQL in the Hosted CloudMySQL in the Hosted Cloud
MySQL in the Hosted Cloud
 
MySQL Ecosystem in 2020
MySQL Ecosystem in 2020MySQL Ecosystem in 2020
MySQL Ecosystem in 2020
 
The Evolution of Open Source Databases
The Evolution of Open Source DatabasesThe Evolution of Open Source Databases
The Evolution of Open Source Databases
 
Databases in the Hosted Cloud
Databases in the Hosted CloudDatabases in the Hosted Cloud
Databases in the Hosted Cloud
 
Mysql ecosystem in 2018
Mysql ecosystem in 2018Mysql ecosystem in 2018
Mysql ecosystem in 2018
 
MySQL Options in OpenStack
MySQL Options in OpenStackMySQL Options in OpenStack
MySQL Options in OpenStack
 
OpenStack Days East -- MySQL Options in OpenStack
OpenStack Days East -- MySQL Options in OpenStackOpenStack Days East -- MySQL Options in OpenStack
OpenStack Days East -- MySQL Options in OpenStack
 
Forking Successfully - or is a branch better?
Forking Successfully - or is a branch better?Forking Successfully - or is a branch better?
Forking Successfully - or is a branch better?
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

The MySQL Server ecosystem in 2016

  • 1. The MySQL Server Ecosystem in 2016 Colin Charles, Team MariaDB, MariaDB Corporation colin@mariadb.com / byte@bytebot.net http://bytebot.net/blog/ | @bytebot on Twitter SCALE14x, Pasadena, California, USA 22 January 2016
  • 2. whoami • Work on MariaDB at MariaDB Corporation (SkySQL Ab) • Merged with Monty Program Ab, makers of MariaDB • Formerly MySQL AB (exit: Sun Microsystems) • Past lives include Fedora Project (FESCO), OpenOffice.org • MySQL Community Contributor of theYear Award winner 2014 2
  • 3. A Mature Ecosystem • MySQL: 21 years old — May 1995 • Percona Server: 7 years old — November 2008 • MariaDB: 6 years old — February 2010 • Drizzle: 2008 - 2012 (R.I.P.) • WebScaleSQL: March 2014 3
  • 4. History • 1979: UNIREG • 1986: UNIREG on UNIX • mSQL - freely available but not opensource • 1995: MySQL 1.0 + MySQL AB founded • 1996: 3.19 • 2000: GPL MySQL Server 4
  • 5. History 2 • Shortly thereafter, the dual-license arrives — libmysql is GPL and not LGPL like before • May 2000: 3.23.15 - (statement based) replication arrives • 2001: 3.23 GA • 2001: InnoDB storage engine (InnoBase Oy) • 2001: first roundVC $$$, Mårten Mickos as CEO 5
  • 6. History 3 • 2002: MySQL sued Progress NuSphere over the Gemini storage engine • 2003: VC Series B • March 2003: 4.0 GA + 4.1 & 5.0 as alpha • 2003: SAP partnership (hello MaxDB) • 2003:Acquires Alzato (NDBCLUSTER) 6
  • 7. History 4 • October 2004: 4.1 GA (with NDBCLUSTER) • 2005: 5.0 tree is the focus, but it has issues • October 2005: Oracle acquires Innobase Oy (“InnoDB Friday”) • October 2005: 5.0 becomes GA* • Late 2005: Maria project starts (make a crash-safe+transactional MyISAM) 7
  • 8. History 5 • February 2006:VC Series C • 2006: Netfrastructure acquired (Falcon engine) • Pluggable storage architecture - only database that support(ed) it • A “fork” of MySQL Cluster in 2006 • 2006: PBXT (log-based design + performance) … 2011 8
  • 9. What makes engines different? • Storage: how the data is stored on disk • Or in NDB (memory +disk), CassandraSE (access a Cassandra Cluster), SphinxSE (access the Sphinx daemon) • Indexes: improves search operations • Memory usage: improves data access for speed • Transactions: protects the integrity of your data (Atomic-Consistent- Isolated-Durable - ACID) • Locking level: MyISAM (table locks), InnoDB (row locks), old BDB (page locks) • Data types: Data types may be converted, MEMORY doesn’t support TEXT, etc. • Caching: InnoDB caches data & indexes, MyISAM caches indexes only (relying on OS disk cache for data) • Full-text search capability: MyISAM has this, InnoDB 5.6 got this • GIS: MyISAM & Aria work (R-tree indexes exist), InnoDB 5.7 has this too • Backups • Foreign Keys
  • 10. History 6 • November 2007: MySQL 6.0 Alpha, 5.1 current tree being worked on but not ready • 2007: quiet period for IPO • January 2008: Sun Microsystems acquires MySQL AB for USD$1 BILLION • June 2008: Drizzle — fork of MySQL 6.0 — modular, fast, microkernel architecture, UTF8, etc. • November 2008: 5.1 GA
  • 11. History 7 • Late 2008: OurDelta binaries • November 2008: Percona Server (patchset ~July) • http://www.bytebot.net/blog/archives/2009/10/14/ flickrs-upgraded-shard
  • 12. History 8 • February 2009: Monty leaves Sun • March 2009: Final 6.0 Alpha (and shortly dead thereafter) • April 2009: Oracle acquires Sun Microsystems (January 2010 sale completes, after a long battle with the EU) • shortly thereafter Monty Program Ab is where MariaDB starts being worked on • October 2009: MariaDB 5.1 Beta release
  • 13. History 9 • February 2010: MariaDB 5.1 GA release • November 2010: MariaDB 5.2 GA release • December 2010: MySQL 5.5 GA • April 2011: Percona Server 5.5 stable • February 2012: MariaDB 5.3 GA (GIS, replication improvements, optimiser)
  • 14. History 10 • April 2012: MariaDB 5.5 GA • November 2012: Announcement of MariaDB Foundation • February 2013: MySQL 5.6 GA • April 2013: SkySQL Ab acquires Monty Program Ab • October 2013: Percona Server 5.6 GA
  • 15. History 11 • March 2014: MariaDB 10 GA • March 2014: WebScaleSQL — but there’s no GA/shipping release • October 2015: MariaDB 10.1 GA, MySQL 5.7 GA
  • 16.
  • 17. Open source community • MariaDB: takes external contributors/committers • MySQL: 5.7 takes Generated Columns (virtual columns in MariaDB 5.2) from Andrey Zhakov • contributions welcome, commits not • see: MySQL Community Contributor Award Program • WebScaleSQL: Alibaba, Facebook, Google, LinkedIn, and Twitter (w/ Percona + MariaDB also agreeing to work on it) • Percona: bug reports welcome, commits not
  • 18. Google Summer of Code • 2013: 3 contributors (all shipping code, one committer) • 2014: 4 contributors (all shipping code, a MariaDB Foundation member hired a new developer) • 2015: accepted with 8 contributors, finally 3 passed
  • 19. Security • Oracle: watch for CPUs, or just wait for the next release • MariaDB: CVEs get fixed quickly when reported • Percona: roughly follows Oracle, but also takes security from MariaDB • http://www.mysqlperformanceblog.com/2013/01/13/ cve-2012-4414-in-mysql-5-5-29-and-percona- server-5-5-29/ • For one issue (sql/password.c & memcmp()), MariaDB was first to be patched
  • 20. Is MySQL dying? • “The reports of my death have been greatly exaggerated” — Mark Twain • MySQL ecosystem development is at its most vibrant now than it has ever been • Oracle has been a great steward of pushing MySQL development forward
  • 21. Global Top 20 Sites 1. Google 2. Facebook 3. YouTube 4. Baidu 5. Yahoo! 6. Wikipedia 7. Amazon 8. Twitter 9. QQ 10.Taobao 11.Google.co.in 12.LinkedIn 13.live.com 14.Sina 15.Weibo 16.yahoo.co.jp 17.Tmall 18.google.co.jp 19.google.de 20.Ebay
  • 22. MySQL adoption • MySQL Server (5.5) still leads the way in Debian/ Ubuntu (the only one you can track via popcon) • Followed by MariaDB Server and then Percona Server • Today you can also see stats on the Docker hub, Juju Charms, etc.
  • 24. But what about the external ecosystem? • Yahoo! develops monitoring tools • Yelp opensources replication monitoring • Box has tools • Dropbox starts playing around with Fabric • Booking deploys MaxScale in production • Pinterest offers up their tools
  • 25. MySQL 5.7 • Multi-source replication • Dynamic replication filters • Lossless semisync • SHOW EXPLAIN for connection_id • GIS functionality • Statement timeouts • Change master without stopping SQL thread • Online GTID implementation • GTID no longer requires log- slave-updates to be enabled • Virtual columns (generated columns) • Online buffer pool resize • Username size increase • LOCK/UNLOCK accounts • JSON
  • 26. MariaDB 10.1 • START TRANSACTION WITH CONSISTENT SNAPSHOT • Integrated Galera Cluster • Table/tablespace encryption • Optimistic parallel replication • Enhanced semi-sync replication • InnoDB defragmentation • ANALYZE <statement> • Threadpool • cracklib_password_check • SQL error logging plugin • Extended REGEXP (PCRE) • Roles
  • 27. Percona Server 5.6 • variable: numa_interleave • restrict # of binlog files - max_binlog_files • Lock-free SHOW SLAVE STATUS NOLOCK • Percona Toolkit UDFs • Expanded fast index creation - expand_fast_index_creation • Utility user - system access to admin tasks, limited access to user schema • Slow query log enhancements • Log all client commands to syslog (coming to 5.7) • Improved Memory storage engine • Per-query variable statement • PROXY protocol support • Backup locks • TokuBackup
  • 28. WebScaleSQL • Clients can specify millisecond read/write/ connect timeouts • Super read-only to prevent writes by SUPER users • Prefix index query optimisation • Idle system flush rate • Production-ready builds from PSCE
  • 29. Facebook • Dynamic columns + indexes? DocStore • RocksDB, including myrocks_hotbackup • Asynchronous mysql client support • max_running_queries / max_waiting_queries • Relay log writes don’t block SHOW SLAVE STATUS
  • 30. Twitter • Last updated mid-June 2015 :( • They made Apache Cotton for Mesos/MySQL
  • 31. AliSQL • Further optimised threadpool • For Single’s Day, they have a “hot SKU” fix for inventory deductions of a single SKU • SQL firewall • Temporary table space limitations • Log SHUTDOWN information • Persistent InnoDB AUTO_INCREMENT (MDEV-6076) • Column level compression
  • 32. What about the !server external ecosystem? • Percona Toolkit • Percona Xtrabackup • MariaDB MaxScale • mydumper • MHA • Tungsten Replicator • vitess • ScaleDB & ScaleBase • Tumblr JetPants • MySQL Utilities • MySQL Router • MySQL Fabric • PRM (w/Pacemaker) • SeveralNines ClusterControl • MMM • ShardQuery + FlexViews • MySQL Sandbox • Numerous GUI tools: MySQL Workbench, phpMyAdmin, SQLYog, etc
  • 33. (GNU/Linux) Distributions • Most are defaulted to MariaDB Server 10 (some like RHEL 7 are still on MariaDB Server 5.5) • so when you ask for mysql, you effectively get MariaDB Server (beware!) • Debian is hotly contesting if it should drop MySQL or not (see: Elasticsearch) • however, today, Debian & Ubuntu ship MySQL as default, MariaDB Server and Percona Server as choices
  • 34. Where are they now? • Drizzle - single company opensource project (Rackspace). Most went on to work at OpenStack • PBXT - PrimeBase focuses on TeamDrive, out of the engine business • InfoBright • Calpont InfiniDB - to MariaDB Corporation & Oracle • Tokutek TokuDB - Percona acquires in April 2015
  • 35. Future? • MySQL 5.8 is being planned already. Look out for the interesting work behind Cluster & group replication • Percona Server aims to never become a fork — work closely with Oracle. Look forward to 5.7 • MariaDB 10.2 will become more of a fork with various features like window functions, CTEs, 5.7 compatibility, etc. • WebScaleSQL will skip MySQL 5.7; backports to current tree + look at 5.8
  • 36. Cloud MySQL • Amazon Web Services Relational Database Service (RDS): MySQL, MariaDB,Aurora • Rackspace Cloud Databases: MySQL, MariaDB Server, Percona Server • Google Cloud SQL: MySQL • Aliyun: MySQL (+TokuDB) • Jelastic - PaaS offering MySQL, MariaDB • ClearDB - MySQL on Heroku,Azure • Joyent - Image offers Percona MySQL and a Percona SmartMachine • Google Compute Engine offers Percona XtraDB Cluster as a “click- to-deploy” app • comes with Galera 3, Percona Toolkit, XtraBackup as well • Pivotal CloudFoundry - “MySQL” PaaS which is MariaDB Galera Cluster 10 • Red Hat OpenShift - MySQL 5.1/5.5, MariaDB 5.5 • MariaDB Enterprise Cluster and MaxScale on Microsoft Azure
  • 37. Discussions • http://planet.mysql.com/ • https://lists.launchpad.net/maria-developers/ • https://lists.launchpad.net/maria-discuss/ • https://groups.google.com/forum/#!forum/percona-discussion • https://groups.google.com/forum/#!forum/maxscale • https://groups.google.com/forum/#!forum/codership-team • https://lists.mysql.com/internals (kinda dead :( )
  • 38. Bugs • http://bugs.mysql.com/ • https://bugs.launchpad.net/percona-server • https://mariadb.atlassian.net/secure/ Dashboard.jspa • Phabricator https://reviews.facebook.net/
  • 39. Conferences/Events w/ dedicated MySQL track • SCALE, Los Angeles, CA • FOSDEM, Brussels, Belgium • Percona Live Data Performance, Santa Clara, CA • Percona Live Europe, Amsterdam, Netherlands • Oracle OpenWorld, San Francisco, CA • Various db.tech showcases in Japan • DataOps LATAM, Buenos Aires, Argentina
  • 40. What should you use? • Think about the innovation today • Think about the features you need today (with tolerance for the roadmap & what comes tomorrow) • Beware vendor lock-in • Ensure you are well supported
  • 41.
  • 44. A word from your sponsors • MariaDB Corporation sponsored my T&E to come to this conference • They have a booth so you can check them out at #511 & win a BB-8™ by Sphero • Remember you can buy a MariaDB Enterprise subscription to help you with your cloud deployments, MariaDB Server usage, etc. • Services include: 24x7 support, consulting, training, remote DBA services, non-recurring engineering and more for all variants of MySQL
  • 45. Thank you! Colin Charles colin@mariadb.com / byte@bytebot.net http://bytebot.net/blog | @bytebot on twitter slides: slideshare.net/bytebot