Microsoft Ignite The Tour Tokyo と Osaka でお話した同タイトルのセッション資料です BRK30034 @ Tokyo 2019/12/06 15:15 - 16:00 JST BRK30156 @ Osaka 2020/01/24 12:15 - 13:00 JST セッション概要： Power BI dataflows と Power Platform dataflows は両方とも Power Query でデータを集め、使いたい形に変えることが可能ですが、その用途は使い分けるべきです。(=Data Preparation, ETL) 似たような機能がなぜそれぞれに存在するのか？それは目的が異なるからです。本セッションでは、シナリオベースでそれぞれの使い方をご紹介します。

2. dataflows

3. 自己紹介：
清水 優吾 (Yugo Shimizu)
株式会社セカンドファクトリー
CTO, シニア テクニカル アーキテクト
UX を看板に掲げて、飲食業を営んでいる IT 企業に勤めている会社員で
Data Platform をメインに活動をしている Technical Architect
専門・興味:
Data Platform (Azure),
Power Platform (Power Apps, Power Automate, Power BI, Power Virtual Agents)
Qiita: https://qiita.com/yugoes1021
Power BI 勉強会: https://powerbi.connpass.com
Japan Power BI User Group: https://www.facebook.com/groups/JapanPBUG/
Japan Power Virtual Agents User Group: https://www.facebook.com/groups/JPVAUG/
Japan Power Platform User Group: https://power.users.community/
Microsoft MVP
for Data Platform -
Power BI
(2017.02 - )
MVP
プロフィールページ
Twitter: @yugoes1021
Facebook: yugoes1021

4. セッション概要
Power BI dataflows Power Platform dataflows
Power Query
Data Preparation
ETL
目的が異な
る

5. Power Platform Overview

6. Power BI
dataflows
Power Platform
Microsoft Flow Power BI
Common
Data
Service
for Apps
Common Data Model
Dynamics 365
AI
Azure Data Lake Storage Gen2 (ADLS)
PowerApps
Your Business DataPower Query
Power Query
- My Last Year Version -

7. Power BI
dataflows
Power Platform
Power Automate Power BI
Common
Data
Service
for Apps
Dynamics 365
Azure Data Lake Storage Gen2 (ADLS)
Power Apps
Power Query
- Current Version (2019.11) -
Power
Platform
dataflows
Power Query
Data Sources
AI
Builder Power
Virtual
Agents

8. Power BI
dataflows
Power Platform
Power Automate Power BI
Common
Data
Service
for Apps
Dynamics 365
Azure Data Lake Storage Gen2 (ADLS)
Power Apps
Power Query
- Current Version (2019.11) -
Power
Platform
dataflows
Power Query
Data Sources
AI
Builder Power
Virtual
Agents

9. Two Dataflows in Power Platform - Current Version (2019.11) -
Data
Sources
Power Platform dataflows
Power BI dataflows
Common
Data Service
Azure Data Lake
Storage Gen 2
CDM
Folders
Azure
Machine
Learning
Cognitive
Services
Power Query Online
Automatic replication
(Project Athena)
分析エンティティのみ
(Analytical entities only)
AI
Builder

10. Two Dataflows in Power Platform - Current Version (2019.11) -
Data
Sources
Dataflows in Power Apps
Dataflows in Power BI
Common
Data Service
Azure Data Lake
Storage Gen 2
CDM
Folders
Azure
Machine
Learning
Cognitive
Services
Power Query Online
Automatic replication
(Project Athena)
分析エンティティのみ
(Analytical entities only)
AI
Builder

11. Why is “dataflows” needed?
- The Backgroud

12. Why is “dataflows” needed?
https://powerbi.microsoft.com/en-us/blog/introducing-power-bi-data-prep-wtih-dataflows/

13. Why is “dataflows” needed?
https://powerbi.microsoft.com/en-us/blog/introducing-power-bi-data-prep-wtih-dataflows/

14. Why is “dataflows” needed?
https://powerbi.microsoft.com/en-us/blog/introducing-power-bi-data-prep-wtih-dataflows/

15. Why is “dataflows” needed?
https://powerbi.microsoft.com/en-us/blog/introducing-power-bi-data-prep-wtih-dataflows/

16. 80% data
preparation analysis decision
making.
Why is “dataflows” needed?
データの準備 80%
分析 意思決定

17. Three-quarters not able to act
data owing disjointed
systems data integration issues
Why is “dataflows” needed?
75% ばらばらのシステム データ統合の
問題 せいで 大部分のデータ

18. the automation of
data science tasks citizen data scientists surpass data scientists
Why is “dataflows” needed?
データサイエンスタスクの自動化
市民データサイエンティスト
データサイエンティスト 上回る

19. 多種多様 爆発的 天文学的
V V V
確実に負ける
専門家 レアだ
し高い
Why is “dataflows” needed?
So, let’s become Citizen data scientists(analysts).

20. Why is “dataflows” needed?
So, let’s become Citizen data scientists(analysts).
以上の背景から Dataflows は現れました。
ゆえにその特徴は…
 ちょっと学べば誰でも Data Preparation (ETL) が可能
 昔はコーディングが必要だったものが no code, less code でできる
 エンジニアである必要なし = 業務知識を持つエンドユーザーが自分
で「作る」
 基本的に環境構築不要なクラウドサービス(SaaS)

21. Power BI dataflows
(Dataflows in Power BI)

22. What is Power BI dataflows?
CDS for Analytics
https://powerbi.microsoft.com/ja-jp/blog/coming-soon-to-power-bi-common-data-service-for-analytics/
https://powerbi.microsoft.com/ja-jp/blog/introducing-power-bi-data-prep-wtih-dataflows/
https://powerbi.microsoft.com/ja-jp/blog/announcing-power-bi-dataflows-general-availability/

23. What is Power BI dataflows?
 Power BI Service Data Preparation
 Power Query Data Preparation
 Power BI Desktop
ADLS Gen2
 Power BI Premium Power BI Embedded

24. Dataflows はクリックのみで Power Query を構成可能
Power BI でのセルフサービスのデータ準備:
https://docs.microsoft.com/ja-jp/power-bi/service-dataflows-overview
[BRK3208]Democratizing self-service data preparation within Microsoft Power BI, Power Apps and Flow using Dataflows
https://myignite.techcommunity.microsoft.com/sessions/83498?source=SessionDeck

25. Dataflows はクリックのみで Power Query を構成可能
Power BI でのセルフサービスのデータ準備:
https://docs.microsoft.com/ja-jp/power-bi/service-dataflows-overview
[BRK3208]Democratizing self-service data preparation within Microsoft Power BI, Power Apps and Flow using Dataflows
https://myignite.techcommunity.microsoft.com/sessions/83498?source=SessionDeck

27. Power Platform dataflows
(Dataflows in Power Apps)

28. What is Power Platform dataflows?
https://powerapps.microsoft.com/en-us/blog/load-data-from-external-data-sources-to-the-common-data-service-using-power-query-2/
https://powerapps.microsoft.com/ja-jp/blog/cds-for-apps-march/
https://powerapps.microsoft.com/ja-jp/blog/announcing-power-platform-dataflows-general-availability/

29. What is Power Platform dataflows?
 Power Apps の画面で Data Preparation
 Power Query Data Preparation
 Power BI Desktop
２つ
 ADLS Gen2

31. Common Data Service
Architecture

32. Common Data Service
Common Data Service. . . Runs on Azure
Compute Storage
[POWA04]Connecting Power Apps, Microsoft Flow, Power BI, and the Common Data Service with data
https://myignite.techcommunity.microsoft.com/sessions/82864?source=SessionDeck

33. Common Data Service
Common Data Service. . . Extends with Azure
Compute Eventing + ExtensibilityStorage
[POWA04]Connecting Power Apps, Microsoft Flow, Power BI, and the Common Data Service with data
https://myignite.techcommunity.microsoft.com/sessions/82864?source=SessionDeck

34. Common Data Model & ADLS Gen2
Architecture

35. Decision Makers, Business analysts
No code, low code
Data scientists, Data engineers
Low to high code
Common Data
Service
Dynamics 365
ISV partners
(Informatica, etc.)
Custom
LOB +
Developer resources
Power Platform
dataflows
Power BI Azure Data Services
data ingest, data prep, AI,
machine learning, data warehousing
Office 365
Graph Data
Connect
Azure IoT
Transactional business data Profiles based on observational data
CDM foldersCDM folders

36. CDM フォルダーの構造
引用元：https://docs.microsoft.com/ja-jp/common-data-model/data-lake

37. Which and Where should we use,
Power BI dataflows or
Power Platform dataflows?
- Demos

38. 前提条件と要件
ある有名な Web
リアルタイムのアトラクション待ち時間
https://www.tokyodisneyresort.jp/tdl/realtime/attraction.html
何らかの方法で
可視化
AI

39. Power Platform
dataflows
Power BIPower BI
dataflows
http://bit.ly/TDL-WaitingTimeBot
http://bit.ly/TDL-WaitingTimeReport
http://bit.ly/TDL-WaitingTime

40. まとめ

41. このセッションでお話したこと
- Power Platform 概要、昨年から変わったところ
- Dataflows が必要な背景
- Power BI dataflows とは
- Power Platform dataflows とは
- CDS アーキテクチャ
- CDM と ADLS Gen2 のアーキテクチャ
- 簡単なデモ

42. Two Dataflows in Power Platform - Current Version (2019.11) -
Data
Sources
Power Platform dataflows
Power BI dataflows
Common
Data Service
Azure Data Lake
Storage Gen 2
CDM
Folders
Azure
Machine
Learning
Cognitive
Services
Power Query Online
Automatic replication
(Project Athena)
分析エンティティのみ
(Analytical entities only)
AI
Builder