TiDB in a Nutshell - Open-Source Distributed SQL Database Immerse yourself in the world of TiDB Architecture with our captivating presentation. Dive deep into the intricacies of TiDB, the distributed SQL database that has redefined data management. Join us as we unravel the architectural brilliance behind TiDB, exploring its key components, data flow, and design principles. Uncover the secrets to exceptional performance, elastic scalability, and rock-solid data consistency. Prepare to be enlightened by the groundbreaking TiDB Architecture that is revolutionizing the industry. Watch the full webinar here https://youtu.be/aMSUtQVdFks for webinar recording Mydbops Blogs: https://www.mydbops.com/blog/

1. TiDB Architecture In Nutshell
May 27th, 2023
Mydbops Webinar - 22
Kabilesh PR
Co-Founder, Mydbops

2. Interested in Open Source technologies
MySQL / TiDB Certified Professional
Tech Speaker/Blogger
AWS certified Database speciality
AWS community builder / SME
Co-Founder, Mydbops IT Solutions
Kabilesh PR
About Me

3. Mydbops Services
Consulting
Services
Managed
Services
Focuses on MySQL, MongoDB, PostgreSQL
Targeted
Engagement
24 x 7
DBA Team

4. Agenda
What is TiDB ?
Architecture
Production Readiness
Sharding

5. What is TiDB ?
• An Open Source distributed SQL database by PingCAP
• Scalability in both ways horizontally and vertically
• Supports both Transactional and Analytical workload in realtime
• Compatible with MySQL protocol
• Highly available and Fault Tolerance

6. MySQL scalability - Bottlenecks
Monolithic - Single node Limitation
Horizontal scaling - Sharding

7. Architecture
TiDB cluster - SQL layer
Tikv - Storage layer
TiFlash - Analytical columnar storage
Placement Driver(PD) - Metadata & TSO

8. Architecture

9. TiDB - SQL Interface
• Stateless
• Handles Client connections & authentication
• Parsing & compiling
• Coverting relational to KV pair (Tikv)
• Executing SQL
• Online DDL execution
• Garbage collections
• Cache table

10. TiKV - Transactional Storage
• Stateful
• Persistent storage with RocksDB
• Distributed storage & transaction support
• Strong Consistency
• MVCC support
• Inbuilt HA
• Co-Processor (PP)

11. TiKV - Regions and Raft
• Region - Represents a range of key-value data
• 96 Mb in size
• A region is replicated to multiple nodes forming Raft group
• Regions are automatically balanced across TiKV nodes
• Each region has a leader and followers
• Leader handles RW ops
• Followers replicate , server read & can be promoted as leader via election
• PD Maintains the region info,scheduling,balacing

12. Services (LB)
Stateful Sets
Operator Maturity
TiKV - Regions and Raft

13. Placement Driver - PD
• Metadata management - Global view
• Data placement and load balancing
• TransactionID allocation
• Global Timestamp (TSO)
• Scheduling by collecting cluster info
• PD consists of 3 node at-least

14. TiFlash - Analytical Store
Columnar storage
Replicated Async from Tikv
Intelligent engine selection
Optimised for aggregation, join & table scans
MPP (Multiple Parallel Processing)

15. Architecture

16. Sharding
Supports on the fly sharing & distribution
Relational to Key-value transformation
Distributed based on Global key
Global_key = Primary_key + Table_id(generated)
For Non-int primary key row_id is generated

17. Sharding - Relational to KV

18. Sharding - Global-key

19. Sharding - Region split & distribution

20. Production Readiness
Definitely YES !! its ready to be deployed
Know the current limitation of Tidb
Test your usecase

21. Reach Us : Info@mydbops.com
Thank You
Image Courtesy : PingCAP