Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)
•
15 likes•15,875 views
Lessons Learned: Understanding Azure Data Factory Pricing (Presented at Microsoft Ignite on November 6th, 2019)
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)
Similar to Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) (20)
More from Cathrine Wilhelmsen
More from Cathrine Wilhelmsen (20)
Recently uploaded
Recently uploaded (20)
Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)
- 4. Azure Data Factory pricing is easy!
- 5. No upfront costs! Pay only for usage!
- 6. …but how much will that actually cost?
- 7. "I guess we just have to wait for the invoice?"
- 11. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
- 12. Azure Data Factory Operations Read / Write: $0.50 per 50 000 modified entities Operations: Create, Read, Update, Delete Entities: Datasets, Linked Services, Pipelines, Integration Runtimes, Triggers Monitoring: $0.25 per 50 000 run records retrieved Operations: Get, List Run Records: Pipeline Runs, Activity Runs, Trigger Runs, Debug Runs
- 13. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
- 14. Data Pipelines: Self-Hosted $1.50 per 1000 runs $0.10 per DIU-hour $0.002 per hour $0.0001 per hour
- 15. Data Pipelines: Azure $1 per 1000 runs $0.25 per DIU-hour $0.005 per hour $0.00025 per hour
- 16. Data Pipelines: Azure Orchestration: $1 per 1000 runs Activity, trigger and debug runs Execution: Data Movement Activities: $0.25 per DIU-hour Pipeline Activities: $0.005 per hour External Activities: $0.00025 per hour All activities are prorated by the minute and rounded up
- 17. Auto = 4
- 18. Min = 2
- 19. Data Pipelines: Azure Orchestration: $1 per 1000 runs Activity, trigger and debug runs Execution: Data Movement Activities: $0.25 per DIU-hour Pipeline Activities: $0.005 per hour External Activities: $0.00025 per hour All activities are prorated by the minute and rounded up
- 20. Actual time: 1 sec = Billed for: 1 min
- 21. Actual time: 1 min 1 sec = Billed for: 2 min
- 22. Actual time: 1 min 30 sec = Billed for: 2 min
- 23. Actual time: 9 min 1 sec = Billed for: 10 min*DIUs
- 24. Data Pipelines: Additional Costs $0.80 per month $0.05 - $0.087 per GB
- 25. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
- 26. Data Flow Debugging and Execution $0.199 per vCore-hour $0.268 per vCore-hour $0.345 per vCore-hour
- 27. Data Flow Debugging and Execution Compute Optimized: $0.199 per vCore-hour General Purpose: $0.268 per vCore-hour Memory Optimized: $0.345 per vCore-hour Charges are prorated by the minute and rounded up The minimum cluster size to run a data flow is 8 vCores
- 28. Data Flow Debugging and Execution Compute Optimized: $0.199 per vCore-hour General Purpose: $0.268 per vCore-hour Memory Optimized: $0.345 per vCore-hour Charges are prorated by the minute and rounded up The minimum cluster size to run a data flow is 8 vCores
- 29. Data Flow Debugging and Execution
- 30. Data Flow Debugging and Execution $1.592 per hour $2.144 per hour $2.760 per hour
- 31. Data Flow Debugging and Execution $54.128 per hour $72.896 per hour $93.84 per hour
- 32. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
- 33. SQL Server Integration Services $0.592 per node per hour $18.212 per node per hour
- 34. SQL Server Integration Services $1.665 per node per hour $35.372 per node per hour
- 35. SQL Server Integration Services Enterprise D1 V2: $1.665 per node per hour 1 core, 3.5 GB RAM, 50 GB Temporary Storage Enterprise E64 V3: $35.372 per node per hour 64 cores, 432 GB RAM, 1600 GB Temporary Storage
- 36. SQL Server Integration Services
- 37. SQL Server Integration Services
- 38. Lessons Learned
- 39. Lessons Learned
- 40. Lessons Learned
- 42. Total cost per pipeline run: $0.17
- 43. Total cost per pipeline run: $0.17 Run once per night for 30 days: $5.1
- 44. Total cost per pipeline run: $0.17 $510
- 45. Total cost per pipeline run: $0.17 $12240
- 46. Lessons Learned
- 47. Lessons Learned
- 49. "I guess we just have to wait for the invoice?"
- 50. "No, I got this!"
- 51. Good luck!