In this presentation, we will provide an introduction to Apache Ignite™ (incubating), which is an open source, distributed framework for a unified In-Memory Data Fabric. Apache Ignite™ (incubating) provides a high-performance, distributed in-memory data management software layer that has been designed to operate between both new and existing data sources and applications, boosting application performance and scale by orders of magnitude.
We will start with a summary of the technical drivers and market forces, and will cover popular and emerging use cases for in-memory computing, from financial industry trading platforms to mobile payment processing, online advertising, online/mobile gaming back-ends and more. We will then present some foundational concepts and terminology, and discuss the architecture, capabilities and benefits of the Apache Ignite In-Memory Data Fabric in quite some detail.
Bio:-
Nikita Ivanov is founder and CTO of GridGain Systems, the leading Java in-memory data fabric starting every 10 seconds around the world today. Nikita has over 20 years of experience in software application development, building HPC and middleware platforms, contributing to the efforts of other startups and notable companies including Adaptec, Visa and BEA Systems.
Software and Systems Engineering Standards: Verification and Validation of Sy...
Introduction to Apache Ignite (TM) (incubating) by Nikita Ivanov of GridGain
1. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
DMITRIY
SETRAKYAN
Founder,
PMC
Apache
Ignite(TM)
-‐
In-‐Memory
Data
Fabric
Ul<mate
Speed
and
Scale
for
Transac<ons
and
Analy<cs
hDp://www.ignite.incubator.apache.org
#apacheignite
2. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
Agenda
• About
In-‐Memory
Compu<ng
• Apache
Ignite(tm)
In-‐Memory
Data
Fabric
• Advanced
Clustering
• Data
Grid
• Compute
Grid
• Service
Grid
• Streaming
&
CEP
• Plug-‐n-‐Play
Hadoop
Accelerator
• Q
&
A
3. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
Apache
Ignite(TM)
In-‐Memory
Data
Fabric:
Strategic
Approach
to
IMC
• SupportsApplicationsof
varioustypesand
languages
• Open Source – Apache 2.0
• Simple Java APIs
• 1 JAR Dependency
• High Performance & Scale
• Automatic Fault Tolerance
• Management/Monitoring
• Runs on Commodity Hardware
• Supports existing &
new data sources
• No need to rip & replace
4. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
In-‐Memory
Data
Fabric:
More
Than
Data
Grid
5. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
• Ease
of
GeSng
Started
– Automa<c
Discovery
• Any
Environment
– Public
Cloud
(AWS,
OpenStack)
– Private
Cloud
– Hybrid
Cloud
– Local
Laptop
• Zero-‐Deployment
– Auto-‐Deploy
Code
• Full
Cluster
Management
• Pluggable
Design
In-‐Memory
Data
Fabric:
Clustering
6. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
In-‐Memory
Data
Fabric:
Clustering
7. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
• Distributed
In-‐Memory
Key-‐Value
Store
• Replicated
and
Par<<oned
data
• TBs
of
data,
of
any
type
• Redundant
Backups
• Distributed
ACID
Transac<ons
• SQL
queries
and
JDBC
driver
• Data
Structures
(Queue,
AtomicLong,
etc.)
• Colloca<on
of
Compute
and
Data
In-‐Memory
Data
Fabric:
Data
Grid
8. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
• Unlimited
Ver<cal
Scale
• Avoid
Java
Garbage
Collec<on
Pauses
• Small
On-‐Heap
Footprint
• Large
Off-‐Heap
Footprint
• Off-‐Heap
Indexes
• Full
RAM
U<liza<on
• Simple
Configura<on
In-‐Memory
Data
Fabric:
Off-‐Heap
Memory
9. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
• Direct
API
for
MapReduce
• Zero
Deployment
• Cron-‐like
Task
Scheduling
• State
Checkpoints
• Load
Balancing
• Automa<c
Failover
• Full
Cluster
Management
• Pluggable
SPI
Design
In-‐Memory
Data
Fabric:
Compute
Grid
10. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
• Distribute
Any
Data
Structure
– Available
Anywhere
on
the
Grid
– Access
Anywhere
via
Proxies
• Controlled
Deployment
– Support
for
Cluster
Singleton
– Support
for
Node
Singleton
– Support
for
Custom
Topology
– Load
Balanced
• Guaranteed
Availability
– Auto
Redeployment
in
Case
of
Failures
In-‐Memory
Data
Fabric:
Service
Grid
11. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
• Streaming
Data
Never
Ends
• Branching
Pipelines
• Pluggable
Rou<ng
• Sliding
Windows
• CEP/Con<nuous
Query
• SQL
Query
• Real
Time
Analysis
In-‐Memory
Data
Fabric:
Streaming
and
CEP
12. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
• Plug
and
Play
installa<on
• 10x
to
100x
Accelera<on
• In-‐Memory
Na<ve
MapReduce
• In-‐Process
Data
Coloca<on
• GGFS
In-‐Memory
File
System
• Pure
In-‐Memory
• Read-‐Through
from
HDFS
• Write-‐Through
to
HDFS
• Sync
and
Async
Persistence
In-‐Memory
Data
Fabric:
Hadoop
Accelerator
13. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
In-‐Memory
Data
Fabric:
Accelerated
MapReduce
• In-‐Memory
Na<ve
Performance
• Zero
Code
Change
• Use
exis<ng
MR
code
• Use
exis<ng
Hive
queries
• No
Name
Node
• No
Network
Noise
• In-‐Process
Data
Coloca<on
• Eager
Push
Scheduling
14. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
Visor:
Monitoring
&
Mgmt
for
DevOps
✴ GridGain
Enterprise
Edi-on
15. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
Enterprise
&
Open
Source
Comparison
Chart
GridGain
Enterprise
SubscripNons
include
the
following
during
the
term
of
the
subscripNon:
> Right
to
use
GridGain
Enterprise
Edi<on
> Bug
fixes,
patches,
updates
and
upgrades
> 9x5
or
24x7
Support
> Ability
to
procure
Training
and
Consul<ng
Services
from
GridGain
> Confidence
and
protec<on,
not
provided
under
Open
Source
licensing,
that
only
a
commercial
vendor
can
provide,
such
as
indemnifica<on
Features Open Source
Enterprise
Edition
In-Memory Data Grid ✓ ✓
In-Memory Compute Grid ✓ ✓
Real-Time Streaming & CEP ✓ ✓
Hadoop Acceleration ✓ ✓
Management & Monitoring GUI ✓
Portable Objects ✓
.Net and C++ APIs ✓
Enterprise-grade Security ✓
Network Segmentation Protection ✓
Local Restartable Store ✓
Rolling Production Updates ✓
Datacenter Replication ✓
9x5 and 24x7 Support ✓
Long Term Support & Patches ✓
16. Apache®,
Apache
Ignite,
Ignite®,
and
the
Apache
Ignite
logo
are
either
registered
trademarks
or
trademarks
of
the
Apache
So8ware
Founda<on
ANY
QUESTIONS?
www.gridgain.com
@gridgain
#gridgain
Thank
you
for
joining
us.
Follow
the
conversa<on.