As business intelligence (BI) teams face increasing pressure to perform faster, organizations are quickly adopting agile development methodologies to try and keep up. Join us to learn how virtual, integrated views of data make agile BI development easier.
Successful BI teams must be able to implement projects fast and respond quickly to changing business requirements. Agile development can help your business respond to these needs, but as the methodologies are updated, you also have to update the tools and techniques for implementing BI.
Red Hat® JBoss® Data Virtualization is perfectly suited for agile BI teams.
Join our webinar to learn how JBoss Data Virtualization:
-Provides logical access to physical source data with virtual, integrated views.
-Reduces development delays.
-Offers flexibility across multiple project teams.
Webinar Recording-
http://www.redhat.com/about/events-webinars/webinars/2013-08-29-business-intel-using-data-virt
Delivering agile business intelligence using data virtualization
1. Data Virtualization and Business Intelligence | Roadmap Information Subject to Change1
Data Virtualization and Business
Intelligence
August 29, 2013
Syed Rasheed
Senior Solutions Marketing Manager
Kenneth W. Peeples, C|HFI, Security+
JBoss Technology Evangelist
2. 2 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Agenda
Syed Rasheed
• Business Intelligence Trends and Challenges
• Data Virtualization Overview
• How Data Virtualization enables Agile BI
Kenneth Peeples
• Data Virtualization Product Architecture
• Demonstration
Both
• Summary
• Q&A
3. Data Virtualization and Business Intelligence | Roadmap Information Subject to Change3
Part I – DV and BI
4. 4 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Top 5 Factors driving the need for Agile Business
Intelligence*
1. Constantly changing business needs (65%)
2. IT’s inability to satisfy new requests in a timely manner
(57%)
3. The need to be a more analytics-driven organization
(54%)
4. Slow and untimely access to information (47%)
5. Business user dissatisfaction with IT-delivered BI
capabilities (34%) Business need arise IT Respond
Agility Gap
* Self-Service Business Intelligence: TWDI Report and Survey of over 625 business and IT professionals
5. 5 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Data Access and Provisioning at the core of
Business Intelligence Challenges
Data lives in Silos
With disparate access methods
With disparate storage characteristics
With disparate taxonomy
Common techniques to integrate data are complex,
costly and time consuming
Hand coded integration
Replication
ETL
EAI
6. 6 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
What is Data Virtualization?
• Data Virtualization makes data
that is spread across various
disparate sources; available to
applications as if it is coming
from a single dedicated source.
Data Source
Applications
Data Virtualization
7. 7 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
How does JBoss Data Virtualization
Works?
JBoss
Data Grid
Connect
Compose
Consume
SAP Salesforce.comOracle DWHive
Excel,
CSV filesSQL Server
Unified
Customer
View
Unified
Product View
Unified
Supplier View
JBoss
DataVirtualization
BI Analytics & Dashboards Mobile SOA Applications
Unified Virtual Database / Common Data Model
Mainframe
ESB, ETL
Native Data Connectivity
Standard based Data Provisioning
JDBC, ODBC, SOAP, REST, XML, JMS, POJO, Hibernate
DataConsumersDataSources
8. 8 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Supported Data Sources
Enterprise RDBMS:
Oracle
IBM DB2
Microsoft SQL Server
Sybase ASE
MySQL
PostgreSQL
Ingres
Enterprise EDW:
Teradata
Netezza
Greenplum
Specialty Data Sources:
S-RAMP/ModeShape Repository
Mondrian
MetaMatrix
LDAP
Enterprise & Cloud Applications:
Salesforce.com
SAP
Big Data:
Apache Hive
NoSQL:
JBoss Data Grid (Infinispan)
MongoDB
Technology Connectors:
Flat Files, XML Files, XML over
HTTP
SOAP Web Services
REST Web Services
OData Services
Office Productivity:
Microsoft Excel
Microsoft Access
Google Spreadsheets
9. 9 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
TOP 10 WAYS
DATA VIRTUALIZATION ENABLE
AGILE BUSINESS INTELLIGENCE
DEVELOPMENT
10. 10 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#1 Data Flattening- Simplified Tables
11. 11 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#2 Tools Agnostic Common Data Model
Reusable, Common, Semantic Data Model
Jaspersoft Cognos
Business
Object
MicrosoftData Consumers
Data Sources
JBoss Data Virtualization
Virtual DB
12. 12 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#3 Centralized Data Transformation
Report 1 Report 2 Report 3 Report 4Data Consumers
Data Sources
JBoss Data Virtualization
Format consistency
123456789
0
123-456-
7890
(123)-456-
7890
123/456/78
90
123,456,78
90
[123]-456-
7890
13. 13 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#4 Ubiquitous Data Consumption
BI App 1 BI App 2 BI App 3 BI App 4Data Consumers
Data Sources
JBoss Data Virtualization
Standard based
Provisioning
JDBC, ODBC, SOAP, REST, XML, JMS, POJO, Hibernate
14. 14 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#5 Optimized Data Access
Federating relational query engine.
Rule and cost based optimizer, advanced query planner
Multi-level caching
Pushdown Queries
15. 15 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#6 Centralize Data Integration
BI App 1 BI App 2 BI App 3 BI App 4Data Consumers
Data Sources
JBoss Data Virtualization
Virtual
Customer
Master
Virtual
Master
Data
Virtual
Product
Master
16. 16 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#7 Centralized Business KPIs & Metrics
Calculations
BI App 1 BI App 2 BI App 3 BI App 4Data Consumers
Data Sources
JBoss Data Virtualization Net Profit
Operating
Margin
Net Sales
17. 17 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#8 No Data Latency
select e.title, e.lastname from Employees as e JOIN Departments as d ON e.dept_id =
d.dept_id where year(e.birthday) >= 1970 and d.dept_name = 'Engineering'
Data Source(s)
Virtual Table
18. 18 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#9 Minimization Need for Data Replication and
Duplication
Define
Data
Structure
Define
ETL Logic
Prepare
HW
Server
Install and
Configure
RDBMS
Create
Database
Physical
DB
Design
and
Tuning
Load
Tables
and Setup
Batch
Updates
Require
DBA,
Developer
to
maintain
and
manage
Design
Data
Structure
Define
Mappings
Define
Virtual
Tables
Enable
Caching
(if need)
Activities required to setup a physical vs. virtual data mart
VS.
19. 19 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
#10 Only Open Source Data Virtualization
Solution
Community driven innovation
Cost Effective Subscription Model
Best Enterprise Support
Comprehensive Middleware Platform
20. 20 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Big Data Integration
Hadoop
JBoss Data Virtualization
JBoss Data Grid
BI Analytics
(historical, operational, predictive)
Capture, Process and Integrate Data Volume, Velocity, Variety
SOA Composite Applications
JBoss Messaging &
Event Processing
Structured Data
Streaming
Data
Semi-
Structured Data
Red Hat Enterprise Linux
Red Hat Storage
Capture&ProcessIntegrate&Analyze
21. 21 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
22. 22 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
23. 23 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Part 2 – Data Virtualization
Demonstration
24. 24 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
●JBoss Data Virtualization is a
data federation and
virtualization engine (the Teiid
Server) that allows you to query
multiple data sources
(RDBMSs, web services, files,
applications, etc) as though
they were a single unified
source.
●It builds on the JBoss EAP and
SOA Platforms and includes
model-driven development tools
and rich management
capabilities along with a robust
runtime
●The Teiid Server Runtime
executes as an additional
service/capability within the
JBoss container.
JBoss Data Virtualization Components
EDS v5
25. 25 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
JBoss Data Virtualization
•Turn the data you have into the information
you want.
•Standards-based read/write access to
heterogeneous data stores in real time.
•Speeds application development by simplifying
access to distributed data.
•Transforms data structure and semantics
through data virtualization.
•Consolidates data into a “single view” without
the need for more data.
•Centralized access control, auditing through
robust security infrastructure.
•Creates services that provision data to
business process in your SOA.
•Enterprise-proven – flexible, scalable, high-
performance.
JBoss Data Virtualization
Data Service Data ServiceData Service
SQL
Web
Services
26. 26 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
What does Data Virtualization/Teiid do?
Data Virtualization, with a focus on optimized real-time access.
Like a database, but the planner and optimizer are geared to data integration.
• Query decomposition/push-down
• XA Transactions for writes
Convenient relational abstraction with lots of other features
• XML Document Models
• SQL Views, Procedure language, XQuery integration
• Available as a JDBC driver, includes optional ODBC driver
• Built-in integration with RDBMSs, XML sources, LDAP, Salesforce, Services
etc.
Tight integration with Teiid Designer
27. 27 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
What does Teiid Designer do?
Creates source models
• By importing metadata
• By manually defining metadata
Creates view models
Creates Virtual Databases (VDB)
Uses Teiid (integrated with the Designer) to allow
querying models prior to deployment
28. 28 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
29. 29 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Three Topics that will be covered in the demo
• Decouple Data access logic from BI applications and Data Flattening
• BI tool agnostic, reusable, business friendly semantic data model(s)
• Improve security and compliance with centralized KPIs and metrics
calculations
30. 30 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Prerequisites
Maven 3.0.3 or higher
JDK 1.7
JBoss Developer Studio 7
EAP 6.1
Teiid and Teiid Designer
Source to be posted
https://github.com/kpeeples/dv-and-bi.git
Article from Webinar
www.ossmentor.com - Teiid (Data Virtualization) and Business
Intelligence
31. 31 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Steps to create the example project
Scope: Walk through the Teiid Designer to create the virtual
databases and deploy them to JBoss
Section 1 – Setup
http://www.jboss.org/products
http://download.jboss.org/jbosstools/updates/integration/kepler/in
tegration-stack/aggregate/4.1.2/
http://www.jboss.org/teiid
http://www.jboss.org/teiiddesigner
Section 2 – Teiid Designer
Section 3 – Web Console
Section 4 – Teiid Dashboard
32. 32 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Part 3 - Closing
33. 33 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Data Virtualization Benefits
• Empower your organization with instant access to the
right data, at the right time, for the right people.
• Respond faster to change with flexible information
infrastructure.
• Save co$t of unnecessary data replication and
duplication.
• Complements existing integration technologies and
approaches (SOA, ETL, EAI)
• Derive value from ALL new and old data sources – Big
Data, Cloud Data, SaaS etc.
34. 34 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change
Call to Action
Evaluate JBoss Data Virtualization for your BI project
Download the software from Jboss.org
Get Started Quick download the demo
Red Hat JBoss Middleware
Deliver More, On Time, On Budget
35. Data Virtualization and Business Intelligence | Roadmap Information Subject to Change35
Questions?