SlideShare a Scribd company logo
1 of 8
Main Memory Database Systems
       prabakaran.t@lakshyasolutions.com
      Architect and Founder – CSQL MMDB




              http://www.csqldb.com
DBMS Types

DRDB
       Disk Based Database Management System
       Stores data in disk
       Buffer frequently accessed data to memory

MMDB
       Main Memory Database Management System
       Complete data is stored in memory
       No buffer manager required




                       http://www.csqldb.com
DRDB VS MMDB

Fully cached DRDB != MMDB

      Data structures are designed for disk based access
      rather than main memory data access

      Access mechanisms (Hash, Tree, etc) are optimized
      for disk access rather than main memory

      DRDB involves lot of data copies

      DRDB provides client/server connections whereas
      MMDB provides embedded mode




                       http://www.csqldb.com
DBMS Products

Disk Based Database Management System
       Oracle
       DB2
       MySQL
       Postgres

Main Memory Database Management System
       CSQL
       Timesten




                      http://www.csqldb.com
MMDB is better than DRDB

Hardware trend:
     CPU speed, memory & Disk capacity grows 80%/yr
   ●


     Memory performance grows 10%/yr
   ●


     Disk speed remains same
   ●


     Price of memory continues to drop
   ●




•Access time for main memory is orders of magnitude less than
that of disk. (100ns VS 10 ms)
•Application queries require random access most of the time(point
lookups)
•Data resides permanently on main memory. No disk I/Os
•No buffer manager overhead
•Data Structures and algorithms are designed for memory access
rather than disk access


                        http://www.csqldb.com
CSQL MMDB

Performance: Developed from scratch keeping one thing in
mind- performance.

Direct access to data: uses shared memory architecture

User Level Mutexes: Hand written using atomic instructions

Custom Allocators : Fixed and Variable Size Allocators

Embedded Architecture: No network overhead, no data copies

Tightly coupled: code segments which are performance critical
are tightly coupled to avoid data copies



                        http://www.csqldb.com
CSQL Features

•Fully ACID Transactions
•Highly concurrent
•Fault Tolerant
•Multi user – Authentication
•Multi granular locking – Database, Table, Row
•Hash Index, Tree Index
•Aggregates and Inner Join
•Client / Server and Embedded mode
•JDBC 3.0 and ODBC 3.0 compliant




                 CSQL is 30 times faster than DRDB
          Visit http://www.csqldb.com for benchmark results


                           http://www.csqldb.com
Thank You
www.csqldb.com




   http://www.csqldb.com

More Related Content

More from Prabakaran Thirumalai

More from Prabakaran Thirumalai (6)

Madras government medical college NEET Cut off
Madras government medical college NEET Cut offMadras government medical college NEET Cut off
Madras government medical college NEET Cut off
 
Procrastination quotes
Procrastination quotesProcrastination quotes
Procrastination quotes
 
Procrastination
ProcrastinationProcrastination
Procrastination
 
Csql Replicator
Csql ReplicatorCsql Replicator
Csql Replicator
 
Csql Cache
Csql CacheCsql Cache
Csql Cache
 
Student projects with open source CSQL
Student projects with open source CSQLStudent projects with open source CSQL
Student projects with open source CSQL
 

Recently uploaded

Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 

Recently uploaded (20)

Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 

Main Memory Database

  • 1. Main Memory Database Systems prabakaran.t@lakshyasolutions.com Architect and Founder – CSQL MMDB http://www.csqldb.com
  • 2. DBMS Types DRDB Disk Based Database Management System Stores data in disk Buffer frequently accessed data to memory MMDB Main Memory Database Management System Complete data is stored in memory No buffer manager required http://www.csqldb.com
  • 3. DRDB VS MMDB Fully cached DRDB != MMDB Data structures are designed for disk based access rather than main memory data access Access mechanisms (Hash, Tree, etc) are optimized for disk access rather than main memory DRDB involves lot of data copies DRDB provides client/server connections whereas MMDB provides embedded mode http://www.csqldb.com
  • 4. DBMS Products Disk Based Database Management System Oracle DB2 MySQL Postgres Main Memory Database Management System CSQL Timesten http://www.csqldb.com
  • 5. MMDB is better than DRDB Hardware trend: CPU speed, memory & Disk capacity grows 80%/yr ● Memory performance grows 10%/yr ● Disk speed remains same ● Price of memory continues to drop ● •Access time for main memory is orders of magnitude less than that of disk. (100ns VS 10 ms) •Application queries require random access most of the time(point lookups) •Data resides permanently on main memory. No disk I/Os •No buffer manager overhead •Data Structures and algorithms are designed for memory access rather than disk access http://www.csqldb.com
  • 6. CSQL MMDB Performance: Developed from scratch keeping one thing in mind- performance. Direct access to data: uses shared memory architecture User Level Mutexes: Hand written using atomic instructions Custom Allocators : Fixed and Variable Size Allocators Embedded Architecture: No network overhead, no data copies Tightly coupled: code segments which are performance critical are tightly coupled to avoid data copies http://www.csqldb.com
  • 7. CSQL Features •Fully ACID Transactions •Highly concurrent •Fault Tolerant •Multi user – Authentication •Multi granular locking – Database, Table, Row •Hash Index, Tree Index •Aggregates and Inner Join •Client / Server and Embedded mode •JDBC 3.0 and ODBC 3.0 compliant CSQL is 30 times faster than DRDB Visit http://www.csqldb.com for benchmark results http://www.csqldb.com
  • 8. Thank You www.csqldb.com http://www.csqldb.com

Editor's Notes

  1. <number>