Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Business Intelligence solutions using Excel 2013 and Power BI
1. Enabling Self Service
Business Intelligence
using Excel
CIAPR – Ponce
February 8, 2014
Alan Koo
Senior Consultant | Nagnoi, Inc.
www.alankoo.com | @alan_koo
2. Who am I?
•
•
•
•
•
•
•
•
•
•
Senior Consultant at Nagnoi, Inc.
14+ years in SQL Server
9+ years in BI & OLAP
Member of the Microsoft BI Advisors internal group
Microsoft MVP (5th year)
MCT Regional Lead – Puerto Rico
MCT since 2004 for Business Intelligence / SQL Server / .NET
Co-Founder of Puerto Rico PASS
PASS Regional Mentor - LATAM
Blogger: www.alankoo.com
Alan Koo | www.alankoo.com
3. Agenda
Intro
Modern Self Service BI tools
Excel and Power BI
Discover and combine data
Visualize
Model & analyze
What is Next?
Alan Koo | www.alankoo.com
5. Enormous amounts of data
online behavior of Facebook users
tissue samples of cancer patients
purchasing habits of grocery shoppers
crime statistics of cities
“internet of things”
24/7 outpatient monitor
real-time telemetry devices
Big Data
http://www.nytimes.com/2013/04/14/education/edlife/universities-offer-courses-in-a-hot-new-field-data-science.html?_r=1&
90%
Of data in the world,
has been created in
the last 2 years
Alan Koo | www.alankoo.com
6. The sexiest job in the 21st century
Data Science
http://www.nytimes.com/2013/04/14/education/edlife/universities-offer-courses-in-a-hot-new-field-data-science.html?_r=1&
http://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century/
Alan Koo | www.alankoo.com
7. Data Scientists
The magicians of the Big Data era
They crunch the data, use mathematical
models to analyze it and create
narratives or visualizations to explain it,
then suggest how to use the information
to make decisions
http://www.nytimes.com/2013/04/14/education/edlife/universities-offer-courses-in-a-hot-new-field-data-science.html?_r=1&
Alan Koo | www.alankoo.com
9. Business Intelligence (BI)
A broad category of applications and technologies
for gathering, storing, analyzing,
and providing access
to data to help enterprise users
make better business decisions.
Search Data Management
Alan Koo | www.alankoo.com
10. BI solution scenarios
Operational Reporting
Access to existing data from operational systems
Business Process / Activity Management
Analysis and reporting capabilities for specific business processes or activities
Data Mart / Integrated Reporting and Analytics
Tools and access to business users of an application.
to enhance its value by improving decision making
Enterprise Data Warehousing / Information Management
Comprehensive integration of critical information across the enterprise.
Breaks down the barriers between applications.
Microsoft Developer & Platform Evangelism
Alan Koo | www.alankoo.com
11. Traditional BI: Integrated Reporting and Analytics
8:
7: Delivering canis dataprocess of continuous dirty data
6: ManualuseBI enablesmanages populated reduce contention
5: Stagingmayvarioussimplify query the cleanse business
4: The sourcesaccessperiodically datafor analyzing and reporting
3: Datadata warehousemirrored/replicated towarehouse improvement
2: Clients needaccessmay data thedata to datafrom data sources
9:
warehouse betoa be required warehouse population
areas may toolssources directly
cleansing
to
1:
Data Warehouse
Data Sources
Data Marts
Staging Area
Client
Access
Manual
Cleansing
Microsoft Developer & Platform Evangelism
Client
Access
12. Silos of Data
Call Center
Web Apps
CRM
Finance
Inventory
Data Warehouse
HR
Microsoft Developer & Platform Evangelism
ERP
15
14. Self-Service BI or simply better results?
•
•
•
•
Because the organization has insufficient insight into its data
Because traditional BI is too expensive
Because traditional BI is too slow
Because you were told to go get it
A self-serve BI tool is a means to an end
You need one to solve some combination of #1-3 above.
http://www.powerpivotpro.com/2013/06/self-serve-bi-tool-scorecard-powerpivot-vs-the-others-and-why-not-all-checkboxes-are-equal/
Alan Koo | www.alankoo.com
16. Microsoft Excel for BI???
“…self-service BI solutions to everyday business users
through the familiar tool they already use ..”
http://blogs.technet.com/b/dataplatforminsider/archive/2013/07/08/introducing-power-bi-for-office-365.aspx
Alan Koo | www.alankoo.com
17. Microsoft Excel for BI
It is very likely that Excel is already the lifeblood of your organization
These people will be the primary power users of any new self-serve tool you adopt
All of the tools tend to look a lot easier to learn than they are
Excel is FAR more flexible than ANY of the other tools
“Export to Excel” exists because of Excel’s flexibility,
not just because of Excel’s popularity
• If Excel isn’t your BI tool, all of that “Export to Excel”
activity leads to fragmented intelligence.
•
•
•
•
•
http://www.powerpivotpro.com/2013/06/self-serve-bi-tool-scorecard-powerpivot-vs-the-others-and-why-not-all-checkboxes-are-equal/
Alan Koo | www.alankoo.com
18. Power BI ()
…bring the power of big data insights to the people
who are closest to the business – not a specialist with
an expensive, specialized tool -- but everyone in the
organization can find deeper insights that will help
them make better decisions..”
http://blogs.technet.com/b/dataplatforminsider/archive/2013/07/08/introducing-power-bi-for-office-365.aspx
Alan Koo | www.alankoo.com
21. Power BI (in Excel)
Power Query
Power Pivot
• Query data
• Clean data
• Model tables
• View in Pivot Tables /
Charts
Discover & Combine
Model & Analyze
Power View / Power
Map
• “Prettier” visualizations
• Can map
Visualize
Alan Koo | www.alankoo.com
22. Power BI for Office 365 (Excel) Components
• Power Pivot
(embedded in Excel 2013) – need to be enabled
• Power View
(embedded in Excel 2013) - need to be enabled
• Power Query – need to be downloaded and installed
• Power Map – need to be downloaded and installed
Alan Koo | www.alankoo.com
23. Power BI for Excel components requirements
• The following Office versions are supported:
– Office 2013 Professional Plus
– Office 365 ProPlus
• Supported Operating System
Windows 7, Windows 8, Windows Server 2008 R2, Windows Server 2012, Windows Vista
–
–
–
–
Windows Vista (requires .NET 3.5 SP1)
Windows Server 2008 (requires .NET 3.5 SP1)
Windows 7
Windows 8
Alan Koo | www.alankoo.com
25. Power BI: Discover & Combine
Power Query
Help customers easily
discover, access, and
combine their data
Alan Koo | www.alankoo.com
26. What can I do with Power Query?
• Search public data
• Import data into Excel from a
wide variety of data sources
• Shape it:
Custom columns
Aggregate data
Combine
Advance querys (formula
language)
– Drill down
– Filter
–
–
–
–
–
–
–
–
–
–
Group rows
Remove duplicates
Replace values
Sort
Split
Unpivot / Pivot
Alan Koo | www.alankoo.com
28. Power Query: more flexibility???
“M”
language
Alan Koo | www.alankoo.com
29. Power BI: Visualize
Power View
Help business users discover and
share new insights with
colleagues through interactive
charts and graphs
Power Map
Allows user to create rich 3D
geospatial visualizations
Alan Koo | www.alankoo.com
30. Power View
An interactive data exploration, visualization, and
presentation experience.
Provides intuitive ad-hoc reporting for business users such
as data analysts, business decision makers, and information
workers.
Alan Koo | www.alankoo.com
31. With Power Map you can....
• Map Data: plot up to a million rows of data in 3-D,
visually on Bing maps.
• Discover Insights: gain new understandings by seeing
your data in geographic space and seeing time-stamped
data change over time.
• Share Stories: capture screenshots and build cinematic,
guided video tours that can be shared broadly, engaging
audiences like never before.
Alan Koo | www.alankoo.com
32. Power Map in action!
Dallas Utilities
Demo
Alan Koo | www.alankoo.com
33. Power BI: Model & Analyze
Power Pivot
Create flexible models,
process hundreds of millions
of rows of data in split
second times
Alan Koo | www.alankoo.com
34. Data Analysis Expressions (DAX)
• Programming language for PowerPivot (SSAS 2012
Tabular)
• Simple, clean, powerful, fast, not easy
• Tabular requires simpler data modeling for good result
• Thinking in DAX is a new attitude
Alan Koo | www.alankoo.com
36. Enriching your data with
a Power Pivot model
Demo
Alan Koo | www.alankoo.com
37. Power Pivot features learned today
1. Import from text files (CSV)
2. Excel as linked tables (Calendar)
3. Pivot table Slicers
4. Hierarchies
5. Create relations between tables
6. Model cleansing
7. Calculated Columns
8. Basic DAX functions (IIF, RELATED)
Alan Koo | www.alankoo.com
38. PowerPivot flavors
PowerPivot for Excel Personal Analytics
PowerPivotfor Excel Personal Analytics
PowerPivot for Sharepoint Team Analytics
Analysis Services Corporate Analytics
Alan Koo | www.alankoo.com
41. Twit analysis tool for Excel
http://social.technet.microsoft.com/wiki/contents/articles/15665.analytics-for-twitter-2013.aspx
42. Q & A Feature of Power BI (coming soon)
• Natural language based experience for interacting with
data
“Show London clients”
“Number of songs per year”
“Show number of products”
“Total number of employees for
finance, HR, marketing in Europe
by employee country”
Alan Koo | www.alankoo.com
43. What is the best selling
Song of All Time?
Power BI Video
Alan Koo | www.alankoo.com
44. Wrapping up: Self Service BI
Opens a new window of opportunities
Increase productivity while giving visibility
Scalable to an Enterprise BI Solution
Foundation for Business Intelligence (BI) to the Masses
Just play and have fun!
Alan Koo | www.alankoo.com
46. Authorized Training Center
Designed for professionals who want to use PowerPivot’s full
capabilities, the PowerPivot Workshop is a two/three-day
course that covers PowerPivot topics, starting from basic
concepts and moving on up to complex data models and DAX
formulas with the goal to facilitate the use of PowerPivot in
the real world.
Nestor Figueroa | 787.671.8244
powerpivotworkshop@nagnoi.com
Alan Koo | www.alankoo.com
48. Thank You!
Alan Koo Labrín
Senior Consultant | Nagnoi, Inc.
Blog: www.alankoo.com
Twitter: @alan_koo
49. Resources
•
•
•
•
Power BI Home Page
Gapminder
Data.gov
Microsoft Power Query for Excel Help
http://office.microsoft.com/en-us/excel-help/microsoft-power-query-for-excel-help-HA104003813.aspx
• Power Query basics
http://datapigtechnologies.com/blog/index.php/cool-things-you-can-do-with-data-explorer/
• Importing Data From Multiple Log Files
http://cwebbbi.wordpress.com/2013/03/01/importing-data-from-multiple-log-files-using-data-explorer/
Alan Koo | www.alankoo.com
Editor's Notes
As we look at the IT industry today, a number of important trends are changing the way software is being purchased, deployed and used in the organization. Data ExplosionThe volume of data in the workplace is exploding. According to IDC, digital data will grow more than 40x over the next decade. As more and more data is created digitally, we expect to see ever greater demands being placed on our data platforms to store, secure, process and manage these large volumes of data.Consumerization of ITToday we see an increasing trend toward the “consumerization” of IT which is creating the demand for highly interactive and easy-to-use experiences in the business environment. As consumers, we are accustomed to powerful user-friendly experiences, whether searching the Internet on a mobile device to find information instantly, or quickly accessing our personal financial data. In the workplace, however, we are often unable to answer even the most basic questions about our business. Increasingly, users demand business experiences that more closely mirror the convenience and ease of use in consumer life.Private and Public CloudCloud computing is changing the way data is accessed and processed, and it is creating whole new models for the way applications are delivered. According to IDC, Cloud services will account for 46% of net-new growth in overall IT spending. With private and public cloud infrastructure, organizations have an opportunity to reduce TCO dramatically as data volume increases. As we see an evolution toward greater use of private and public clouds, we see an increasing need for solutions that support hybrid cloud scenarios.
Since the goal of building a business intelligence solution is to drive better decision making, there is no single solution scenario to describe what a BI Solution looks like.There are however some broad categories of solutions that describe common approaches to BI solutions that are defined on this slide. These solutions range from low complexity / small investment (Operational Reporting) up to high complexity / large investment (Enterprise Data Warehousing)This workshop will focus on the Data Mart / Integrated Reporting and Analytics solution scenario because it covers all of the technology used in the other scenarios, and is very common in the ISV and SI space. Building a data mart means providing improved access and tools to business users of your application data at all levels of the organization (executives, analysts, information workers, front-line workers), allowing your customer to better leverage the data assets contained in your application.By understanding this solution scenario, you can decide how to approach building your first BI solution. Some developers may elect to start small by simply providing improved access to operational data as described in the Operational Reporting scenario. Other developers may decide to tackle the larger problem of providing comprehensive integrated reporting and analytics capabilities to their application as described in the Data Mart scenario. Truly adventurous developers may decide to tackle the larger problem of Enterprise Data Warehousing, and attempt to provide their customer with an Enterprise Information Management solution which solves the larger problem of providing an integrated view of enterprise information across application boundaries.
1. Get list of files2. Search: List of municipalities - Municipalities of Puerto Rico – GeoFlowMap3. Search: 2014 Movies6. Body Mass Index (BMI),Income per person (GDP/capita, PPP# inflation-adjusted), Population, total-- Body mass index (BMI) is a measure of body fat based on height and weight that applies to adult men and womenUnderweight = <18.5Normal weight = 18.5–24.9 Overweight = 25–29.9 Obesity = BMI of 30 or greater OPTIONAL 7. IMDB - http://www.imdb.com/chart/top | http://denglishbi.wordpress.com/category/data-explorer/8. Facebook Graph - https://developers.facebook.com/tools/explorer?method=GET&path=121801836%3Ffields%3DfriendlistsMiWindowsPhone – 157032490990072 = Facebook.Graph("https://graph.facebook.com/157032490990072/posts")9. Which car Brand is more popular - Twitter - http://dwjunkie.wordpress.com/2013/07/29/data-science-labs-analyze-twitter-data-with-excel-and-power-query/ | “Tweet”, “Tweeter”, “Date” and “Brand”