Azure Data Factory for the SSIS Developer (Webinar with Kevin Kline from SentryOne presented on January 15th, 2020)

1. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)

2. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Presenters
Who we are
Kevin Kline
Principal Program Manager, SentryOne
sentryone.com/blog/author/kevin-kline
twitter.com/kekline
kkline@SentryOne.com
LinkedIn.com/in/kekline
Cathrine Wilhelmsen
Senior Business Intelligence Consultant, Inmeta
twitter.com/cathrinew
Cathrinew.net

3. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Why SentryOne?
Unmatched Expertise
Microsoft-only focus
7 Microsoft MVPs
Community commitment
Built by experts
Top-Rated Support
100% customer satisfaction on
tickets
50% of tickets resolved in <1hr
9.5/10 Trust Radius score
NPS 50% higher than industry
Unrivaled Scalability
Leading edge technology
End-to-end full environmental view
Lowest overhead
Deep Functionality
Fastest diagnosis
Automation
Highest granularity
Jump-to navigation
Highly configurable
We’re the One

4. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Free Resources
4
More training and education
• Courses.SentryOne.com expansive CBT
program to learn all the ins and outs of the S1
product line.
• Docs.SentryOne.com full product
documentation.
• SQLPerformance.com provides innovative and
practical solutions for improving SQL Server
performance.
• SentryOne.com/Resources offers an inside look
into the world of SentryOne with videos on
query tuning and product demos, white papers,
ebooks, case studies and tech briefs.
• Blogs.SentryOne.com is where you can find all
of our team members’ blogs as well as
important information about the latest
updates to SentryOne software, SQL Server
and server performance issues.

5. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)

6. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Azure Data Factory for the SSIS Developer

7. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
10 years ago…

8. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
SSIS
SQL Server Integration Services

9. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)

10. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Then…

11. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
ADF v1
Azure Data Factory Version 1

12. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)

13. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)

14. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Today…

15. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
ADF v2
Azure Data Factory Version 2

16. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)

17. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Why?
How?
What?

18. Azure
Data Factory

19. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What is Azure Data Factory?

20. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What to do in Azure Data Factory?
Copy Data Transform Data

21. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What is inside Azure Data Factory?
Pipelines
Activities
Datasets
Linked
Services
Data Flows
Templates
Triggers

22. DEMO
Let's look inside
Azure Data Factory!

23. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Ok, so we can copy data…
Copy Data Transform Data

24. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
…what about transforming data?
Copy Data Transform Data

25. Data Flows

26. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Mapping or Wrangling?

27. Mapping
Data Flows

28. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What are Mapping Data Flows?

29. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How do Mapping Data Flows work?

30. Wrangling
Data Flows

31. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What are Wrangling Data Flows?

32. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How do Wrangling Data Flows work?

33. DEMO
Let's transform
some data!

34. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Mapping or Wrangling?
Mapping Data Flows Wrangling Data Flows

35. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
≈
≈
≈
≈
≈
≈
ADF vs SSIS

36. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Wait…
I already have
thousands of SSIS
packages!

37. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
And…
You told me to use
this Biml thing!

38. SSIS
Lift and Shift

39. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What does Lift and Shift mean?

40. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Why should you Lift and Shift SSIS?
*

41. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How do you Lift and Shift SSIS?
1. Configure Azure-SSIS Integration Runtime
2. Deploy SSIS Packages to SSISDB in Azure
3. Orchestrate SSIS Packages in Azure Data Factory

42. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How do you Lift and Shift SSIS?
1. Configure Azure-SSIS Integration Runtime
2. Deploy SSIS Packages to SSISDB in Azure
3. Orchestrate SSIS Packages in Azure Data Factory

43. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What is the SSIS Integration Runtime?

44. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
What is the SSIS Integration Runtime?
Managed cluster of Virtual Machines running SSIS
Specify Virtual Machine size and SQL Server edition
Create setup scripts if using third-party components

45. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How to use third-party components?
1.
2.
3.
4.

46. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How to use third-party components?
http://sentryone.com/ADF-Webinar-Install

47. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How to deploy SSIS Packages?

48. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
How to orchestrate SSIS Packages?

49. DEMO
Let’s lift and shift
some SSIS Packages!

50. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Lessons Learned
like all VMs

51. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Good luck!

52. © 2019 Cathrine Wilhelmsen (hi@cathrinew.net)
Thank you!
Kevin Kline
Principal Program Manager, SentryOne
sentryone.com/blog/author/kevin-kline
twitter.com/kekline
kkline@SentryOne.com
LinkedIn.com/in/kekline
Cathrine Wilhelmsen
Senior Business Intelligence Consultant, Inmeta
twitter.com/cathrinew
cathrinew.net