Virdatint’s unique comprehensive Distributed Data Virtualization, Integration, Analytics and Security platform, bridges the gap between customer-facing operational systems and MDM, CRM, BPM, BI and analytics in near real-time, to grow revenue and decrease costs. Because it leverages existing architectures and systems, leaves data in-place, and offers a unique approach to indexing, link mapping and analysis, implementation is rapid and the resulting operational costs are low.
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Virdatint Distributed Data Virtualization Basics_2.6
1. Virtual distributed data virtualization, integration, analytics and security platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 1
Distributed Data Virtualization Platform (DDVP)
Basics and Options
September 2015
(Best viewed in slideshow mode)
2. Virtual distributed data virtualization, integration, analytics and security platform
“It’s all about the data”
and
“Data has a life!”
“
and
Virdatint takes a highly data-driven approach:
Revision 2.6 Copyright 2015 Virdatint, Inc. 2
Virtual data virtualization
Virtual data federation
Virtual data integration
3. Virtual distributed data virtualization, integration, analytics and security platform
What is Virdatint, Inc.?
• Recently formed 100% owned subsidiary of WhamTech, Inc., which has been
around for over 15 years
−Privately held and US-based
−Unique technologies
• Virtual data integration and analytics platform for enterprise and any other data,
Big Data, cybersecurity, data security and MDM
• WhamTech past DoD and intel work for large government system integrators,
e.g., BAH, Boeing, Lockheed Martin and Northrop Grumman
• WhamTech past commercial work for EMC and others
• Virdatint recent and current work for CSC and others, with a focus on healthcare
and financial services
Revision 2.6 Copyright 2015 Virdatint, Inc. 3
4. Virtual distributed data virtualization, integration, analytics and security platform
Virdatint takes a highly data-driven approach
Discovery
Source – almost any
Profiling
Classification/categorization
Quality and standardization
Indexing and query processing
Virtualization
Federation
Link mapping/Link Indexes™
Event processing
Event correlation
Security
Master data management
Integration
Interoperability
BI and analytics
Link analytics
Standard drivers and SQL
Revision 2.6 Copyright 2015 Virdatint, Inc. 4
Key Differentiators
Real-time to batch and automated (as much as possible) virtual data:
5. Virtual distributed data virtualization, integration, analytics and security platform
Virdatint key differentiators expanded (1 of 2)
1. Data remains in sources – not copied or moved
2. Any data source – mainframes, legacy, databases, office documents, Web,
social media, streaming, Hadoop, structured, unstructured, semi-structured, etc.
3. Automation as much as possible – detect new devices, and discover data
sources and data, e.g., for IoT and networks
4. Data quality addressed before any data access – cleansed, transformed and
standardized indexes, and results
5. Own indexes, indexed views and query processing, as part of adapters to
multiple data sources – parallel distributed processing – linearly scalable –
maintained in real-time using changed data capture, incrementally and batch
6. Event processing (partner with Oracle®)
Revision 2.6 Copyright 2015 Virdatint, Inc. 5
6. Virtual distributed data virtualization, integration, analytics and security platform
Virdatint key differentiators expanded (2 of 2)
7. Link mapping finds relationships between entities within and across data
sources and captures them in Link Indexes™ using (i) exact, (ii) fuzzy and (iii)
composite weighted probability matches
8. Link Indexes used to (i) locate and read entities for master data, (ii) execute
degrees of separation queries, (iii) accelerate joins, (iv) represent
ontological/semantic models and (v) perform link analytics
9. Seamless combination of master data with operational, other enterprise and
external data systems, and of use by any application
10.Link analytics for single customer/patient views, network visualization, fraud
detection, de-bottlenecking, social media analysis, etc.
11.Highly interactive browser-based query, results and link visualization tool
12.New support for active CRM, BPM, individual analytics and machine learning
Revision 2.6 Copyright 2015 Virdatint, Inc. 6
7. Virtual distributed data virtualization, integration, analytics and security platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 7
Created
Stored
Copied
Quality/improved
Stored
Copied
Quality/improvedStored
Copied
Quality/improved
Stored
Indexed
Related
Reported
Analyzed
Acted on
Operational
Data Store (ODS)
Data
Warehouse (ETL and DW)
Data Mart
(DM)/
Analytics
Database/
Link
Analysis-
Graph
Database
Log/Transaction
System
Indexed
Indexed
Discarded/retained
Conventional data life-cycle
Data copied multiple times
8. Virtual distributed data virtualization, integration, analytics and security platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 8
Created
Stored
Quality/improved
Stored
Quality/improvedStored
Quality/improved
Stored
Indexed
Related
Reported
Analyzed
Acted on
Big Data
Lake/Reservoir
(similar to ODS)
Big Data Refinery
(similar to ETL)
Analytics
Database/
Link
Analysis-
Graph
Database
Log/Transaction
System
Indexed
Indexed
Discarded/retained
Big Data life-cycle (similar to a conventional data life-cycle)
Copied
Copied
Copied
Data copied multiple times
9. Virtual distributed data virtualization, integration, analytics and security platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 9
Created
Stored
Copied
Quality/improved
Stored
Copied
Quality/improvedStored
Copied
Quality/improved
Stored
Indexed
Related
Reported
Analyzed
Acted on
Indexed
Indexed
Discarded/retained
Created
Stored
Reported
Analyzed
Acted on
Discarded/retained
Quality/improved
Indexed
Related
Virdatint Distributed
Data Virtualization
Platform
Discarded/retained
Virdatint eliminates most conventional data life-cycle stages
Capabilities at the DDVP
support applications
10. Virtual distributed data virtualization, integration, analytics and security platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 10
Device/host
discovery
Data source
discovery
Data quality/
transformation
Query processing
Reported
Analyzed
Acted on
Discarded/retained
Virdatint DDVP data processes
Data discovery
and profiling
Data and
link indexing
Results retrieval
(Results data quality/
transformation)
Note: Data not copied or moved
- only results retrieved
11. Virtual distributed data virtualization, integration, analytics and security platform
Solutions to seven challenging problems in one platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 11
Virtual Interactive
Link Analysis
and Visualization
Virtual
BI/
Analytics
Distributed Data Virtualization (and Federation, Integration and
Interoperability) Platform
Virtual
MDM
Virtual
Cybersecurity
Virtual
Data
Security
Virtual
Event
Processing
Applications
Basic
Product
Optional
Modules
Click on and off the darker blue graphics to view descriptions or click elsewhere to advance presentation
Automated device, data source
and data discovery, profiling,
quality, mapping, indexing,
virtualization, federation,
integration and interoperability
as basis for capability support
modules and applications
Track significant changes
occurring in data
Seamlessly combine with
operational/transactional data
and maintain in near real-time
Defend and protect data of value
(i) as it is created, (ii) at rest in
the source, (iii) in transit, (iv) at
the recipient and (v) after no
longer needed
Virtual and materialized real-time
updateable hierarchical indexed
views, text analytics including
entity extraction, and locally
executed algorithms
Indexed federated log and other
data source access, including
automated anomaly detection
and automated event correlation
Link analysis/graph database for
almost any type of analytics,
including virtual MDM (master
patient index), cybersecurity and
data security
12. Virtual distributed data virtualization, integration, analytics and security platform
Solutions to seven challenging problems in one platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 12
Virtual Interactive
Link Analysis
and Visualization
Virtual
BI/
Analytics
Distributed Data Virtualization (and Federation, Integration and
Interoperability) Platform
Virtual
MDM
Virtual
Cybersecurity
Virtual
Data
Security
Virtual
Event
Processing
Applications
Basic
Product
Optional
Modules
13. Virtual distributed data virtualization, integration, analytics and security platform
Seven solutions to challenging problems in one platform
1. DISTRIBUTED DATA VIRTUALIZATION PLATFORM (DDVP) for automated device, data source and
data discovery, profiling, quality, mapping, indexing, virtualization, federation, integration and
interoperability as basis for capability support modules and applications
2. EXTEND DDVP WITH EVENT PROCESSING to keep track of significant changes occurring in data
3. EXTEND DDVP WITH DISTRIBUTED (preferably HYBRID) MDM to seamlessly combine with
operational/transactional data and maintain in near real-time
4. EXTEND DDVP WITH IMPROVED CYBERSECURITY through indexed federated log and other data
source access, including automated anomaly detection and automated event correlation
5. EXTEND DDVP WITH VIRTUAL DATA SECURITY LAYER to defend and protect data of value (i) as it is
created, (ii) at rest in the source, (iii) in transit, (iv) at the recipient and (v) after no longer needed
6. EXTEND DDVP WITH BI/ANALYTICS oriented virtual and materialized real-time updateable hierarchical
indexed views, text analytics including entity extraction, and locally executed algorithms
7. EXTEND DDVP WITH LINK ANALYSIS (and OEM LINK VISUALIZATION) for link analysis/graph
database for almost any type of analytics, including virtual MDM (master patient index), cybersecurity and
data security
Revision 2.6 Copyright 2015 Virdatint, Inc. 13
14. Virtual distributed data virtualization, integration, analytics and security platform
Platform is decentralized/distributed and indefinitely scalable
Revision 2.6 Copyright 2015 Virdatint, Inc. 14
Applications
Data Source
Data stays in sources
- no copying or moving
Data SourceData Source
15. Virtual distributed data virtualization, integration, analytics and security platform
How do EIQ Adapters work?
Revision 2.6 Copyright 2015 Virdatint, Inc. 15
EIQ
Server
(sub-
Middleware)
Data
Source
Application(s)
Data Read,
Transform/
clean-up
(and Index)
Index schema
and names same
as data source
Twelve ways
to build and
maintain indexes
Result-set pointers
to data in source
Results provided
in almost any format
Applications / middleware
connect with standard drivers or
Web Services and SQL***
EIQ
Adapter*
w/SDM**
Multiple other data sources
EIQ
Indexes
User-level
access
…
…
Middleware
*EIQ SuperAdapter and EIQ TurboAdapter
**Standard Data Model – future application-to-
SDM query translation
***Future OQL, SPARQL and NoSQL options
Data Discovery
and raw index-
based
Data Profiling
Develop
and test
Data Transforms
using profiles
Queries resolved
in the EIQ Adapter
and EIQ Indexes
Raw results data
transformed/cleaned-up
from source
Network
Asset
and Device
Discovery
Metadata
Discovery
and Semantic
Mapping
Data
Source
Discovery
Distributed Network Asset,
Data Source and
Metadata Repository, incl.
Data Governance
EIQ
Federation
Server
(sub-
middleware)
w/SDM
EIQ
Federation
Server
Indexes do not store
data – only queryable
representations
…
…
…
16. Virtual distributed data virtualization, integration, analytics and security platform
Example multiple data source configuration
Revision 2.6 Copyright 2015 Virdatint, Inc. 16
FIREWALL
FIREWALL
EIQ Federation
Server
EIQ Federation
Server
Social
Media
Feed
Indexes
EIQ
SuperAdapter
EIQ Conventional
Adapter
3rd Party
AdapterSalesforce
Hadoop Indexes
EIQ
SuperAdapter
Mainframe Indexes
EIQ
SuperAdapter
ERP
System
EIQ Federation
Server Application(s)
WhamTech
JDBC Driver
TCP / IP
RDBMS Indexes
EIQ
SuperAdapter
17. Virtual distributed data virtualization, integration, analytics and security platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 17
Location agnostic
18. Virtual distributed data virtualization, integration, analytics and security platform
Revision 2.6 Copyright 2015 Virdatint, Inc. 18
Configuration agnostic
19. Virtual distributed data virtualization, integration, analytics and security platform
The End
Revision 2.6 Copyright 2015 Virdatint, Inc. 19