Exploring the Fundamentals of YugabyteDB - Mydbops MyWebinar Edition 25 Join us for an enlightening journey into the world of YugabyteDB, a distributed SQL database revolutionizing data management. In this webinar presentation, we delve into the challenges faced by traditional databases, explore the architecture and unique features of YugabyteDB, and showcase its seamless scalability and fault tolerance. Watch the full recording: https://youtu.be/QtvK-apLBwQ Visit Mydbops Blogs: https://www.mydbops.com/blog/

1. YugabyteDB Fundamentals
Aakash M
Database Reliabiltiy Engineer - II
Mydbops

2. Database Reliabiltiy Engineer
Interested in MySQL and PostgreSQL
Certified Professional
Tech Speaker/Blogger
Aakash M
About Me

3. Services on top open source databases
•
Founded in 2016
•
90 Member team
•
Assisted over 500+ Customers
•
AWS Partner, ISO and a PCI Certified Organisation
•
About Mydbops

4. Database
Consulting
Services
Managed
Database
Services
Focuses on Top Opensource database MySQL,MariaDB, MongoDB and
PostgreSQL both ON Premises and Cloud
Mydbops Services

5. Agenda
Problems with Traditional Databases
•
Challenges with NoSQL and NewSQL database
•
Distributed SQL
•
YugabyteDB Architecture
•
Demo
•

6. Traditional Database Problems

7. Types of Traditional Databases
Traditional Databases
Traditional SQL Traditional NoSQL NewSQL

8. Traditional SQL
By Definition, they are relational
•
Examples: Oracle, MySQL, PostgreSQL
•
Strong Consistency and ACID Guarantees
•

9. Traditional SQL
Scales Vertically
•
Serves Writes from only one server
•
Manual Sharding
•

10. Traditional NoSQL
Developed as an alternative to SQL databases
•
Examples: MongoDB, Cassandra
•
Good Horizontal Scalability
•

11. Traditional NoSQL
No ACID Guarantee
•
Lack of multi-key access patterns
•
AP side of CAP Theorem
•

12. NewSQL
First Flavor - Vitess, Citus
•
Automatic Sharding Layer
•
Second Flavor - NuoDB, VoltDB
•

13. NewSQL
Geographic Data Distribution
•

14. What is Distributed SQL

15. Distributed SQL
Single Logical Database - Cluster of Servers
•
SQL API
•
Automatic Distributed Data Storage
•
Distributed Query Execution
•
Consistent Replication and ACID Compliance
•

16. Distributed SQL vs SQL
Characteristics SQL NoSQL Distributed SQL
Language SQL Custom SQL and CQL
Schema Relational Mulitmodel Multimodel
Scalability Vertical Horizontal Horizontal
Consistency Strong Eventual Strong
Availability Low High High

17. Distributed SQL
Distributed Databases - Scale Out
•
Serve writes on any nodes
•
Tolerate failure to any nodes in the cluster
•

18. Yugabytedb

19. What is YugabyteDB
YugabyteDB is a high-performance distributed SQL
database for powering
global, internet-scale applications. Built using a unique
combination of
document store, per-shard distributed consensus
replication and multi-shard ACID transactions
(inspired by Google Spanner)

20. CAP Theorem and Split Brain
Consistency (C): Every read receives the most recent write or an error. All nodes in the
system see the same data at the same time.
Availability (A): Every request receives a response, without guarantee that it contains the
most recent write.
Partition tolerance (P): The system continues to operate despite network partitions
(communication failures) that prevent some nodes from communicating with others.

21. CAP Theorem and Split Brain
Consistent and Partition Tolerant(CP) Database
•
Architecture is same as google spanner
•

22. CAP Theorem and Split Brain
Split Brain - Data and Availability inconsistency
•
Elects a new leader based on majority
•
Single leader exists throughout the entire system
•

23. Consensus Algorithm
RAFT Consensus Algorithm
•
Equivalent to Paxos in fault tolerance and performance
•
Used to achieve consensus among leader and followers in tablet peer group and Master
servers
•

24. Key Components
Nodes - Servers/VMs
•
Group of nodes - Cluster/Universe
•
Primary Cluster and Read Replica Cluster
•
3+ nodes forms a cluster (Replication Factor)
•
Synchronous replication with in a primary cluster
•
Asynchronous Replication from primary to read replicas.
•

25. YugabyteDB Architecture

26. Architecture
Source: https://github.com/yugabyte/yugabyte-db

27. Architecture - YQL Layer
YQL Layer
•
Application interacts directly with this layer
•
Supports two types of distributed SQL API
•
YSQL
•
YCQL
•

28. Architecture - YB-TServer Service
Responsible for the input-output(I/O) for the application
•
Data for a table is split(Shared) into tablets
•
Each tablet will have copy of 1 or more
•

29. Architecture - YB-TServer Service

30. Architecture - YB-Master Service
Keeps the system metadata and records
•
Tables and location of their tablets
•
Responsible for coordinating background operations
•

31. Architecture - YB-Master Service

32. Core Functions

33. Universe Creation
First start YB-Masters
•
Sufficient number of YB-Masters
•
Each start with own UUID and perform an election
•
One of the masters establishes as a leader
•

34. Universe Creation

35. Universe Creation

36. Universe Creation

37. Table Creation
Validation
Acknowledgement
Validation
Replication
Execution
Acknowledgement

38. Table Creation

39. Table Creation

40. Table Creation

41. Write IO Path
User Write Request interact with the YQL query layer
•
This user request is translated into an internal key by the query layer
•
Each key owns by different tablets.
•
YQL query layer make the call to YB master to determine the location of tablet
•
At last, YQL layer then issues the write to the appropriate YB-T server hosting the tablet
leader
•

42. Write IO Path

43. Read IO Path
User Read Request interact with the YQL query layer
•
This user request is translated into an internal key by the query layer
•
YQL query layer make the call to YB master to determine the location of tablet and the
YB-Tserver hosting it
•
At last, YQL layer then issues the read to the appropriate YB-T server hosting the tablet
leader
•

44. Read IO Path

45. High Availability

46. YB-T Server Failure
YQL Layer Failure
•
Tablet Peer Follower Failure
•
Tablet Peer Leader Failure
•

47. YB-Master Failure
Not in the critical path of I/O operations
•

48. Default Ports
API/Server Port
YSQL 5433
YCQL 9042
YB-Master 7100
YB-T Server 9100
YB-Master Admin UI 7000
YB-T Server Admin UI 9000

49. Demo

50. Reach Us : Info@mydbops.com
Thank You