Master Data Services (MDS) is a Microsoft platform to support Master Data Management (MDM). In this presentation, will be explained about the Data Master service, the deployment and installation of the master data service, and the basic data service master model
DevEX - reference for building teams, processes, and platforms
Sql server master data services
1.
2. Microsoft SQL Server MVP Since 2006
Milis : sqlserver-indo@yahoogroups.com
https://www.facebook.com/groups/sqlserverindonesia/
Kiki Rizki Noviandi
https://mvp.microsoft.com/en-
us/PublicProfile/33869?fullName=Kiki%20Rizki%20Noviandi
3.
4. Agenda
• Microsoft Business Intelligence (The Stack)
• What is Master Data?
• Introducing Master Data Services
• Master Data Services Deploying and Installation
• Basic Master Data Service Model
6. What is Master Data?
“Master Data is data that is at the core of an organization and used
across multiple systems, applications, and/or processes…”
Requires;
• Centralized curated activities and maintenance
• Data Quality Management
• Easy access for business users (not only IT)
• Effective collaboration and sharing
• Master Data contains different attributes for distinct usage (marketing, finance,
operations, business groups…)
7. What is Master Data Management?
“Are sets of processes, governance, policies, standards and tools that
defines and manage Master Data…”
8. Why is Master Data Management Important?
• Reduces, eliminate duplicate data entry and maintenance
• Improve compliance, reporting, profitability, decision making and data
quality
• Enables data stewards to manage critical business data
• Provide a single view of critical information funnels
9.
10. Introducing Master Data Services
Complete, Clean, Consistent and Current Data
Data Quality ServicesMaster Data ServicesIntegration Services
11. Introducing Master Data Services
• Master Data Services (MDS) is a product for master data management
delivered with SQL Server
• V1: First released with SQL Server 2008 R2
• V2: The SQL Server 2012 release included many new features and enhancements
• V3: The SQL Server 2014 release included no new capabilities or features
• V4: The SQL Server 2016 release, currently in public preview
• Delivers credible, consistent data with user-centric data governance
• Available only with Business Intelligence and Enterprise editions
The new capabilities and features of
SQL Server 2016 MDS will be
introduced later in this presentation
12. Introducing Master Data Services
• MDS is implemented as a WCF Data Service
• Internet Information Services (IIS) is required for the MDS web application
and web service
• MDS can be programmatically manipulated
• The repository for metadata and data is a SQL Server database
• The MDS database can be created on either the local or a remote computer
• Microsoft provides two user interfaces:
• Master Data Manager web application
• Excel add-in
13. Introducing Master Data Services
• The MDM web application requires Silverlight
• Capabilities and features:
• Work with master data:
• Query, add, modify, delete, annotate master data
• Manage hierarchy relationships
• Administrative tasks:
• Build models, create business rules and deploy model packages
• Import data into MDS
• Create subscription views to export data from MDS
• Create versions of master data to manage consistent snapshots
• Assign permissions to master data
14. Introducing Master Data Services
• Available for Excel 2007 or later
• Capabilities and features:
• Connect to an MDS repository
• Create new entities and manage attribute properties
• Load filtered sets of master data into Excel tables
• Store and share queries to load master data
• Make changes to master data, and even work offline
• Publish and annotate changes
15. Company A (Before using MDM)
Marketing Operations Customer Service Mail Department Subsidiary
Domain: Customer Data
15 | 43
16. Company A (After using MDM)
Marketing Operations Customer Service Mail Department Subsidiary
Master Data
16 | 43
17. Introducing Master Data Services
Data Steward
via MDM or
Excel
Outlook
MDS
WCF
Data
Service
Administration
Source
System(s)
Data
Warehouse
Data Changes
SSIS
18.
19. Installation and Configuration
1. Install Prerequisites
• PowerShell
• IIS
2. Create a new database
3. Web Configuration
• Website & Web Application
• Associate to the MDS database
• Enable DQS Integration (optional)
• Enables Matching Functionality
22 | 43
20. Installing Master Data Services
• Install Master Data Services
using SQL Server Setup on a
Windows Server 2012 R2
machine
• Double-click Setup.exe, and follow
the steps in the installation wizard.
• Select Master Data Services on the
Feature Selection page under
Shared Features
• Complete the installation wizard
21. Installing and Configuring IIS
• Click the Server Manager icon on the taskbar on the Desktop.
• In Server Manager, click, Add Roles and Features on the Manage menu
22. Installing and Configuring IIS (cont.)
• On the Installation Type page of the Add
Roles and Features Wizard, accept the
default value (Role-based or feature-based
installation) and click Next
• Click Select a server from the server pool,
and then click the server where you installed
Master Data Services
24. Installing and Configuring IIS (cont.)
• On the Features page, confirm that the
following features are selected, and then click
Next. These features are required for Master
Data Services on Windows Server 2012 R2
click Next
25. Installing and Configuring IIS (cont.)
• In the left-hand pane, click Web Server Role
(IIS) and then click Role Services.
• On the Role Services page, confirm that the
following services are selected, and then click
Next. These services are required for Master
Data Services on Windows Server 2012 R2
26. Setting up the Database and Website
1. Launch the Master Data Services Configuration Manager, and click Database
Configuration in the left pane.
2. Click Create Database, and then click Next in the Create Database Wizard.
3. On the Database Server page, specify the SQL Server instance. SQL Server 2019 adds
support for SQL Server Managed Instance. Set the value of SQL Server Instance to the
host of an Azure SQL Database managed instance. For example,
xxxxxx.xxxxxx.database.windows.net.
27. Setting up the Database and Website (Cont…)
• Select the Authentication type and then
click Test Connection to confirm that you
can connect to the database using the
credentials for the authentication type you
selected. Click Next
28. Setting up the Database and Website (Cont…)
• Type a name in the Database name field.
Optionally, to select a Windows collation,
clear the SQL Server default collation
checkbox and click one or more of the
available options such as Case-sensitive. Click
Next
29. Setting up the Database and Website (Cont…)
• In the User name field, specify the Windows
account of the user that will be the default
Super User for Master Data Services. A Super
User has access to all functional areas and can
add, delete, and update all models.
• Click Next to view a summary of the settings
for the Master Data Services database, and
then click Next again to create the database.
The Progress and Finish page appears.
• When the database is created and configured,
click Finish
30. Setting up the Database and Website (Cont…)
• On the Database Configuration page in the
Master Data Services Configuration Manager,
click Select Database.
• Click Connect, select the Master Data Services
database that you created in Step 7, and then
click OK.
31. Setting up the Database and Website (Cont…)
• You've finished setting up the database. The Database Configuration page now displays the SQL
Server instance that you're connected to for Master Data Services, the database you've created
and the current database version
32. Setting up the Database and Website (Cont…)
• In Master Data Services Configuration
Manager, and click Web Configuration in the
left pane.
• In the Website list box, click Default Web Site,
and then click Create to create a Web
application.
33. Setting up the Database and Website (Cont…)
• In the Application Pool section, do one of the
following.
• Enter the same user name that you entered in Step
5 for the database Administrator Account, enter
the password, and then click OK.
-OR-
• Enter a different user name, enter the password,
and then click OK.
34. Setting up the Database and Website (Cont…)
• On the Web Configuration page in the Web
application box, click the application you've
created, and then click Select in the Associate
Application with Database section.
• Click Connect, select the Master Data Services
database that you want to associate with the
Web application, and then click OK.
• You've finished setting up the Website. The
Web Configuration page now displays the
Website you selected, Web application you
created, and the Master Data Services
database associated with the application.
35. Configuration Complete
• Click Apply. The Configuration Complete
message box displays. Click OK in the message
box to launch the web application. The web
site address is https://server name/web
application/.
39. MDS Modeling Concepts
• Models (Database)
• Highest level of organization. Containers of related entities.
• Entities (Table)
• Base containers for data.
• Attributes (Columns)
• Attributes that describe members.
• Members (Records)
• Records that populate the entities.
24 | 43
40. Models (Databases)
• Highest level of data organization
• Models contain the following objects:
• Entities
• Attributes and attribute groups
• Explicit and derived hierarchies
• Collections
25 | 43
41. Entities (Tables)
• Contained in MDS models
• Groupings of similar data
• Contains members
• Typically one or more related entities per
model
26 | 43
42. Attributes (Columns) and Attribute Groups
• Attribute values describe the members of the entity.
• Attribute Groups help to manage many attributes and can be assigned to roles for
easy security management.
• Three types of attributes:
• Free-form
• Domain-based
• File attributes
27 | 43
43. Members (Records/Rows)
• Members are the physical master data.
• Three types of members:
• Leaf (default)
• Consolidated (Exist only when explicit hierarchies and collections are enabled for the entity)
• Collection
28 | 43
44. Excel Add-in
• New in SQL 2012
• Office 2007 or higher
• 32-bit and 64-bit available
• Good for working with 1million records or less
• Has most functionality, except:
• Business Rules
• New Models
• Hierarchies
29 | 43
46. Explicit (Ragged) Hierarchies
• Organizes members from a single entity in
any way you specify.
• Are not based on domain-based attribute
relationships.
• No limitation on where you insert
the consolidate members.
• Each member can only be used once.
• You need to create/enable explicit
hierarchies on an entity to create a
collection.
31 | 43
47. Derived Hierarchies
• Derived from the domain-based
attribute relationships.
• The leaf members from one entity are used
to group leaf members of another entity.
• Based on relationships between entities.
• Sorted by code. You cannot change the sort
order.
• Always contains a consistent number of
levels.
32 | 43
48. Collections
• A group of leaf and consolidated members from a single entity.
• Use collections when you do not need a complete hierarchy but want groupings.
• Doesn’t limit the number or types of members as long as they are within the
same entity.
• Doesn’t create a hierarchical structure, but a flat list of members.
• A collection can also contain other collections.
33 | 43
49. Business Rules
• If/Then statements that result in an action
• Rules help ensure the quality and accuracy of your data.
• Possible actions:
• Default Value
• Change Value
• Validation
• Email
• External Action
34 | 43
50. Staging
• Good for working with over 1 million records
• At least one table is created per entity
• Use the staging process to:
• Create, update, deactivate, and delete leaf and consolidate members.
• Update attribute values.
• Designate relationships in explicit hierarchies.
1. Load data into the staging tables.
• stg.name_Leaf
• stg.name_Consolidated
• stg.name_Relationship
2. Use stored procedures, or the MDS site, to load data from staging
tables into MDS.
• stg.udp_name_Leaf
• stg.udp_name_Consolidated
• stg.udp_name_Relationship
MDS
35 | 43
51. Publishing Data
• Create subscription Views in MDS
• Subscribing Systems Can:
• Use data directly from MDS
• Pull and Process data from MDS to it’s own system.
• Truncate local and copy from MDS
• Use merge statements to update the source data
• Use triggers to update the source data
36 | 43
52. Versions & Flags
• Version allow you to create copies of the master data within a model.
• Can be locked while you validate your data, and then committed after
the data has been validated.
• Use versions to:
• Create an auditable record of your data as it changes over time.
• Prevent changes while you ensure data validates against business rules.
• Lock down a model for use by subscribing systems.
• Test different hierarchies without implementing them right away.
• Use flags to mark and identify versions, such as ‘Latest’.
37 | 43
53. Security
• Used to secure & restrict data
• Based on local or Active Directory users and groups.
• Grant MDS administrators
• Able to specify security down to individual attributes.
38 | 43
MDS - Key Capabilities
Data Steward
MDS – Models, Improving Data Quality, Moving Data, Web Service
Demo
Summary
Resources
Operations
Marketing
Call Center
IT
Newly Acquired Company B
In the Master Data Services Add-in for Excel, matching functionality is provided by Data Quality Services (DQS). This functionality must be enabled to be used.
P. 56
Hierarchies and collections can be used to group members for reporting or analysis. White = Model
The dark blue are examples of entities.
Free-form: Allow free-form input for text, numbers, dates, or links.
Domain-based: An attribute with values that are populated by members from another entity. (a constrained list)
File attributes: Used to store files, documents, or images. File attributes are intended to help with the consistency of your data by requiring files to have a specific extension. File attributes cannot be guaranteed to prevent a malicious user from uploading a file of a different type.
Leaf members are the default members in an entity.
In derived hierarchies, leaf members are the only type of member. Leaf members from one entity are used as parents of leaf members from another entity.
In explicit hierarchies, leaf members are the lowest level and cannot have children.
Consolidated members exist only when explicit hierarchies and collections are enabled for the entity.
Derived hierarchies do not contain consolidated members.
In explicit hierarchies, consolidated members can be parents of other members within the hierarchy, or they can be children.
MDS Excel Add-In for Office 2013:
http://www.microsoft.com/en-us/download/details.aspx?id=35581
The yellow leaf members show the hierarchy.
Not as restrictive of a hierarchical form.
Uses consolidated members that you create for the purpose of grouping other members.
http://msdn.microsoft.com/en-us/library/ee633759
You need to create/enable explicit hierarchies on an entity to create a collection.
The yellow leaf members illustrate the derived hierarchy.
Most restrictive hierarchical form.
Derived from the domain-based attribute relationships that already exist between entities in a model.
This type of hierarchy prevents you from moving a member to a level that is not valid. For example, you couldn’t move a bike up to the Bikes or Clothing categories, but you could move it to a different subcategory.
http://msdn.microsoft.com/en-us/library/ee633747
Very loose hierarchical form. Basically just a collection of members.
http://msdn.microsoft.com/en-us/library/ee633733
Yes, it actually generates custom stored procedures per entity which can be used.