SlideShare a Scribd company logo
1 of 26
Accenture
Accelerated R&D
Standards Metadata
Management – version
control and its governance
Kevin Lee
CDISC NJ Meeting at
01/28/2015
We help our Clients deliver better
outcomes, so they can improve
the quality of people’s lives.
2© 2015 Accenture All Rights Reserved.
Happy New Year
Year of Sheep
• 2015
• 2003
• 1991
• 1979
• 1967
• 1955
• 1943
3© 2015 Accenture All Rights Reserved.
Agenda
Introduction of Standards Metadata
Management
Version Control
Governance
Final Thoughts
4© 2015 Accenture All Rights Reserved.
Introduction of Standards
• Industry Standards
• Clinical Data Interchange Standards Consortium
(CDISC) – CDASH, SDTM, ADaM and LAB
• NCI CT
• HL7
• eCTD (electronic Common Technical Document)
• Company Standards
• Global Standards
• Therapeutic Standards
• Business Unit Standards
5© 2015 Accenture All Rights Reserved.
Introduction of Metadata Management
• Definition
• Managing data about other data
• Examples of metadata
Variable
Name
Variable Label Type CT Role Core
STUDYID Study Identifier Char Identifier Req
DOMAIN Domain Abbreviation Char DM Identifier Req
USUBJID Unique Subject
Identifier
Char Identifier Req
6© 2015 Accenture All Rights Reserved.
Examples of Metadata Management
• Creating new standards (e.g., variables and domains)
• Modifying the attributes (e.g., label, type) of current standards
• Adding the new attributes to current standards
• Archiving the standards
• Managing the information that transforms data into a new
structure (e.g.: CDASH to SDTM)
• Leveraging the Schedule of Events table to determine the data
domains required for a study
• Assigning versions (e.g., major or minor) to standards after
changes
• Maintaining multiple versions of standards (e.g., SDTMIG
3.1.2, 3.1.3)
7© 2015 Accenture All Rights Reserved.
Industry CDISC Standards versions
• CDASH – 1.1
• SDTM (IG) – 1.2 (3.1.2), 1.3 (3.1.3), 1.4 (3.2)
• PRM – 1.0
• LAB – 1.01
• SENDIG – 3
• ADaM (IG) – 2.1 (1.0)
• SMD-XML – 1.0
• ODM-XML – 1.3.1, 1.3.2
• Define-XML – 1.0, 2.0
• DataSet-XML – 1.0
8© 2015 Accenture All Rights Reserved.
Company Standards versions
• Industry + company-specific standards
• Global standards version
• GS v1 – CDASH 1.1, SDTM (IG) 1.3(3.1.2), ADaM(IG)
2.1(1.0)
• GS v2 – CDASH 1.1, SDTM (IG) 1.4(3.2), ADaM(IG)
2.1(1.0)
• Annual global standards version
• GS v2013
• GS v2014
• GS v2015
9© 2015 Accenture All Rights Reserved.
Why version control is important?
• FDA Requirements
• CDISC Standards compliant data submission
• Data Standards Catalog
• Versions that FDA supports and requires.
• Submission document
• SDRG(Study Data Reviewer’s Guide)
• ADRG(Analysis Data Reviewer’s Guide)
• Multiple studies employed different versions across
the duration of a submission
• Phase I used SDTMIG 3.1.2, but Phase II and III used
SDTMIG 3.1.3.
• ISS/ISE
10© 2015 Accenture All Rights Reserved.
How to control versions/ How to
manage standards?
11© 2015 Accenture All Rights Reserved.
Standards Metadata Management vs
Governance
Management
• Making decisions
Governance
• Setting the
environment where
others can manage
effectively
12© 2015 Accenture All Rights Reserved.
What is governance?
According to a report by
Boeing, from 2001 through
2010, the number of fatalities
per one million flight hours is
less than one. It attributed
the success rate of air traffic
control to:
 Process
 Specified roles/responsibility
 Technology/system
13© 2015 Accenture All Rights Reserved.
What is standards governance?
Standards governance is:
• Oversight for the development and maintenance of clinical data
standards
• An instrument that ensures that a standard is developed efficiently,
consistently, and properly used across the clinical trials
organization
• Assurance that maximum process efficiency from a standards-
based clinical data lifecycle is achievable
 Process – change requests and governance workflow
 Specified roles/responsibility – SMEs who ensure
standards are applied appropriately
 Technology/system – technology and systems that
support change requests and governance workflow
14© 2015 Accenture All Rights Reserved.
Three key components of Standards
Governance
People
Process
Technology
15© 2015 Accenture All Rights Reserved.
People of Standards Governance
Below is a general example of
some roles and responsibilities
that sponsors implement to
effectively carry out their
standards governance.
Role Skillset Responsibility
Requestors • Programmers
• Data Management
Request a new or revised standard
Developers • Standards SME
• Programmers
• Data Management
Develop the metadata for the
standard
Approvers • Standards SME Approve the new or revised
standard
16© 2015 Accenture All Rights Reserved.
Standards Group/SME in Governance
• Types
• Functional SME
• Centralized
Standards Group
• Advisory Group
• Responsibility
• SME for each
business unit (e.g.
DM) – develop the
standards
• Advisory/Centralized
Standards Group –
approve the
new/change
standards
17© 2015 Accenture All Rights Reserved.
Governance Process
• Workflow
• Definition
• An orchestrated and repeatable pattern of business activity
enabled by the systematic organization of resources
• A sequence of operations, declared as work of a person or
group.
18© 2015 Accenture All Rights Reserved.
Examples of Governance Workflow
SDTM DM
(Developer)
QC (Validator)
CDISC
compliance
checks
(OpenCDISC)
19© 2015 Accenture All Rights Reserved.
Governance Process in Standards
• Systematic business activities by standards resources
that manage the standards.
• Examples of Types: New Request, Modify and Retire
• Workflow: Request, Development and Approval
Change
Request
• Assessment
• Impact
Development
• Technical
• Subject Matter
Implementation
• Review
• Approval
20© 2015 Accenture All Rights Reserved.
Examples of “Modification” workflow of
Standards Governance
Human task
System task
Email Notification
Requestor
System
Reviewer
Final Reviewer
email
notification to
Developer
Developer
Assign the
appropriate
SME
Notify
Developer
email
notification to
Developer
Standards
Change
Request
Review the
request
Request is
appropriate?
Notify
Requestor No
Yes
email
notification to
assigned SME
Change
Standards
Notify the
assigned
SME
Notify
Reviewer
Review
Standards
Change
Pass or Fail
for Standards
Change
No
Update on
Standards
and its
version
Yes
Notify
Requestors
and
Developers
Start
21© 2015 Accenture All Rights Reserved.
Technology of Standards Governance
Spreadsheet-
based
Team Site
or Share
point
Metadata
Repository
• Definition: The system/technology which people
and workflow of standards governance operates on
• Evolution:
22© 2015 Accenture All Rights Reserved.
Metadata Repository (MDR)
• General definition: a database created to store
metadata.
• Its function in Standards Governance:
• Stores Standards metadata – Global, TA, Compound and
Study level
• Defines the roles and responsibility of people
• Defines the business process
• Drives roles-based, system-driven business process
• Develop and maintain standards(e.g., version controls)
• Stores the history of all the activities(e.g., requestor,
approvals, dates and time, duration)
23© 2015 Accenture All Rights Reserved.
Metadata Repository (MDR) -
continued
• Benefits
• Data-based management, not document-based
• More systemic/organized metadata management
• System-based governance workflow
• Control data flow, then control business process
• Improve business process
• Time-efficient, process-efficient
• History of all the activities
• Transparency
24© 2015 Accenture All Rights Reserved.
Final Thought
Governance
ManagementStandards
25© 2015 Accenture All Rights Reserved.
Sneak preview on 2015
• Metadata Repository
• Data Modeling on Standards metadata
• Process metadata
• Study definition Metadata
• Automated E2E clinical data development
26© 2015 Accenture All Rights Reserved.
Contacts and Questions
Kevin Lee
Email:
kevin.s.lee@accenture.com
Linkedin:
www.linkedin.com/in/kevinlee
1995
Tweet: @HelloKevinLee
Blogs: HiKevinLee.tumbrl.com

More Related Content

What's hot

Tony Shannon: Health care change in the NHS: Practical considerations of VistA
Tony Shannon: Health care change in the NHS: Practical considerations of VistATony Shannon: Health care change in the NHS: Practical considerations of VistA
Tony Shannon: Health care change in the NHS: Practical considerations of VistANuffield Trust
 
Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...
Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...
Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...openEHR-Japan
 
Revolutionizing Laboratory Instrument Data for the Pharmaceutical Industry:...
Revolutionizing Laboratory  Instrument Data for the  Pharmaceutical Industry:...Revolutionizing Laboratory  Instrument Data for the  Pharmaceutical Industry:...
Revolutionizing Laboratory Instrument Data for the Pharmaceutical Industry:...OSTHUS
 
CDISC Related Services
CDISC Related ServicesCDISC Related Services
CDISC Related ServicesIstvan Janosi
 
Oracle Enterprise Metadata Management
Oracle Enterprise Metadata ManagementOracle Enterprise Metadata Management
Oracle Enterprise Metadata ManagementAndrey Akulov
 
Introduction to Open Source VistA
Introduction to Open Source VistAIntroduction to Open Source VistA
Introduction to Open Source VistAbmehling
 
Hl7 advance cda may 2019 webinar
Hl7 advance cda may 2019 webinarHl7 advance cda may 2019 webinar
Hl7 advance cda may 2019 webinarAbdul-Malik Shakir
 
oracle-database-editions-wp-12c-1896124
oracle-database-editions-wp-12c-1896124oracle-database-editions-wp-12c-1896124
oracle-database-editions-wp-12c-1896124Arjun Sathe
 
Connected Care Standard for transfer of care and shared care applications
Connected Care Standard for transfer of care and shared care applicationsConnected Care Standard for transfer of care and shared care applications
Connected Care Standard for transfer of care and shared care applicationsHealth Informatics New Zealand
 
Introduction to cda may 2019 webinar
Introduction to cda may 2019 webinarIntroduction to cda may 2019 webinar
Introduction to cda may 2019 webinarAbdul-Malik Shakir
 
Dev days 2017 referrals (brian postlethwaite)
Dev days 2017 referrals (brian postlethwaite)Dev days 2017 referrals (brian postlethwaite)
Dev days 2017 referrals (brian postlethwaite)DevDays
 
DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16
DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16
DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16Adair Turner, MS, RAC
 
Somnath_Kundu_6Yrs_Resume
Somnath_Kundu_6Yrs_ResumeSomnath_Kundu_6Yrs_Resume
Somnath_Kundu_6Yrs_ResumeSomnath Kundu
 
Defence IT 2012 - Data Quality and Financial Services - Solvency II
Defence IT 2012 - Data Quality and Financial Services - Solvency IIDefence IT 2012 - Data Quality and Financial Services - Solvency II
Defence IT 2012 - Data Quality and Financial Services - Solvency IIDavid Twaddell
 
Looking for SDTM migration specialist
Looking for SDTM migration specialistLooking for SDTM migration specialist
Looking for SDTM migration specialistAngelo Tinazzi
 
Clinical sas course syllabus
Clinical sas course syllabusClinical sas course syllabus
Clinical sas course syllabusSoftlogic Systems
 

What's hot (20)

Tony Shannon: Health care change in the NHS: Practical considerations of VistA
Tony Shannon: Health care change in the NHS: Practical considerations of VistATony Shannon: Health care change in the NHS: Practical considerations of VistA
Tony Shannon: Health care change in the NHS: Practical considerations of VistA
 
Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...
Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...
Introduction of BJU-BMR-RG and use case study of Applying openEHR archetypes ...
 
Revolutionizing Laboratory Instrument Data for the Pharmaceutical Industry:...
Revolutionizing Laboratory  Instrument Data for the  Pharmaceutical Industry:...Revolutionizing Laboratory  Instrument Data for the  Pharmaceutical Industry:...
Revolutionizing Laboratory Instrument Data for the Pharmaceutical Industry:...
 
CDISC Related Services
CDISC Related ServicesCDISC Related Services
CDISC Related Services
 
Oracle Enterprise Metadata Management
Oracle Enterprise Metadata ManagementOracle Enterprise Metadata Management
Oracle Enterprise Metadata Management
 
Introduction to Open Source VistA
Introduction to Open Source VistAIntroduction to Open Source VistA
Introduction to Open Source VistA
 
Hl7 advance cda may 2019 webinar
Hl7 advance cda may 2019 webinarHl7 advance cda may 2019 webinar
Hl7 advance cda may 2019 webinar
 
oracle-database-editions-wp-12c-1896124
oracle-database-editions-wp-12c-1896124oracle-database-editions-wp-12c-1896124
oracle-database-editions-wp-12c-1896124
 
Connected Care Standard for transfer of care and shared care applications
Connected Care Standard for transfer of care and shared care applicationsConnected Care Standard for transfer of care and shared care applications
Connected Care Standard for transfer of care and shared care applications
 
resume_pramod
resume_pramodresume_pramod
resume_pramod
 
openEHR sll-2015final
openEHR sll-2015finalopenEHR sll-2015final
openEHR sll-2015final
 
Integrating the Healthcare Enterprise (IHE)
Integrating the Healthcare Enterprise (IHE)Integrating the Healthcare Enterprise (IHE)
Integrating the Healthcare Enterprise (IHE)
 
Waterwatch2
Waterwatch2Waterwatch2
Waterwatch2
 
Introduction to cda may 2019 webinar
Introduction to cda may 2019 webinarIntroduction to cda may 2019 webinar
Introduction to cda may 2019 webinar
 
Dev days 2017 referrals (brian postlethwaite)
Dev days 2017 referrals (brian postlethwaite)Dev days 2017 referrals (brian postlethwaite)
Dev days 2017 referrals (brian postlethwaite)
 
DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16
DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16
DIA_2016_Turner_ERS 2015 Lessons Learned 2.9.16
 
Somnath_Kundu_6Yrs_Resume
Somnath_Kundu_6Yrs_ResumeSomnath_Kundu_6Yrs_Resume
Somnath_Kundu_6Yrs_Resume
 
Defence IT 2012 - Data Quality and Financial Services - Solvency II
Defence IT 2012 - Data Quality and Financial Services - Solvency IIDefence IT 2012 - Data Quality and Financial Services - Solvency II
Defence IT 2012 - Data Quality and Financial Services - Solvency II
 
Looking for SDTM migration specialist
Looking for SDTM migration specialistLooking for SDTM migration specialist
Looking for SDTM migration specialist
 
Clinical sas course syllabus
Clinical sas course syllabusClinical sas course syllabus
Clinical sas course syllabus
 

Similar to Standards metadata management - version control and its governance

Steve Tuppen - Digital Service Management
Steve Tuppen - Digital Service ManagementSteve Tuppen - Digital Service Management
Steve Tuppen - Digital Service ManagementitSMF UK
 
Expand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize ServicesExpand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize ServicesRiverbed Technology
 
Stratesys - Flyer QA-CAPA - SEP2014 - ENG
Stratesys - Flyer QA-CAPA - SEP2014 - ENGStratesys - Flyer QA-CAPA - SEP2014 - ENG
Stratesys - Flyer QA-CAPA - SEP2014 - ENGStratesys
 
Stratesys - Flyer QA-CAPA - SEP2014 ENG
Stratesys - Flyer QA-CAPA - SEP2014 ENGStratesys - Flyer QA-CAPA - SEP2014 ENG
Stratesys - Flyer QA-CAPA - SEP2014 ENGStratesysUSA
 
ITSM (IT Service Management) & ITIL V3 Foundation
ITSM (IT Service Management) & ITIL V3 FoundationITSM (IT Service Management) & ITIL V3 Foundation
ITSM (IT Service Management) & ITIL V3 FoundationPrudentialSolutions
 
IAB Nov2006 LaRowe EDS - PLM Overview.pdf
IAB Nov2006 LaRowe EDS - PLM Overview.pdfIAB Nov2006 LaRowe EDS - PLM Overview.pdf
IAB Nov2006 LaRowe EDS - PLM Overview.pdfCristianAndruMilos
 
Introduction to itil v3/ITSM Processes and Functions
Introduction to itil v3/ITSM Processes and FunctionsIntroduction to itil v3/ITSM Processes and Functions
Introduction to itil v3/ITSM Processes and FunctionsPrasad Deshpande
 
Data Governance Overview - Doreen Christian
Data Governance Overview - Doreen ChristianData Governance Overview - Doreen Christian
Data Governance Overview - Doreen ChristianDoreen Christian
 
ITIL V3 Overiview Introduction
ITIL V3 Overiview IntroductionITIL V3 Overiview Introduction
ITIL V3 Overiview IntroductionShafiq_Hamid
 
2016-06-08 FDA Inspection Readiness - Mikael Yde
2016-06-08 FDA Inspection Readiness - Mikael Yde2016-06-08 FDA Inspection Readiness - Mikael Yde
2016-06-08 FDA Inspection Readiness - Mikael Ydemikaelyde
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Microsoft Décideurs IT
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Microsoft Technet France
 
Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...
Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...
Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...Sam Garforth
 
Daniel Jasník - ITSMF pro cloudové služby - AID2019
Daniel Jasník - ITSMF pro cloudové služby - AID2019Daniel Jasník - ITSMF pro cloudové služby - AID2019
Daniel Jasník - ITSMF pro cloudové služby - AID2019ALVAO
 
Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right Qualitest
 
ISO 9001 Quality Management Systems: Implementation and Integration
ISO 9001 Quality Management Systems: Implementation and IntegrationISO 9001 Quality Management Systems: Implementation and Integration
ISO 9001 Quality Management Systems: Implementation and IntegrationSpecialty Technical Publishers
 
Narendra tomar (test manager)
Narendra tomar (test manager)Narendra tomar (test manager)
Narendra tomar (test manager)Narendra Tomar
 
GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...
GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...
GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...ennVee TechnoGroup Inc
 

Similar to Standards metadata management - version control and its governance (20)

Steve Tuppen - Digital Service Management
Steve Tuppen - Digital Service ManagementSteve Tuppen - Digital Service Management
Steve Tuppen - Digital Service Management
 
Expand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize ServicesExpand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize Services
 
Stratesys - Flyer QA-CAPA - SEP2014 - ENG
Stratesys - Flyer QA-CAPA - SEP2014 - ENGStratesys - Flyer QA-CAPA - SEP2014 - ENG
Stratesys - Flyer QA-CAPA - SEP2014 - ENG
 
Stratesys - Flyer QA-CAPA - SEP2014 ENG
Stratesys - Flyer QA-CAPA - SEP2014 ENGStratesys - Flyer QA-CAPA - SEP2014 ENG
Stratesys - Flyer QA-CAPA - SEP2014 ENG
 
About itil v3
About itil v3About itil v3
About itil v3
 
ITSM (IT Service Management) & ITIL V3 Foundation
ITSM (IT Service Management) & ITIL V3 FoundationITSM (IT Service Management) & ITIL V3 Foundation
ITSM (IT Service Management) & ITIL V3 Foundation
 
IAB Nov2006 LaRowe EDS - PLM Overview.pdf
IAB Nov2006 LaRowe EDS - PLM Overview.pdfIAB Nov2006 LaRowe EDS - PLM Overview.pdf
IAB Nov2006 LaRowe EDS - PLM Overview.pdf
 
Introduction to itil v3/ITSM Processes and Functions
Introduction to itil v3/ITSM Processes and FunctionsIntroduction to itil v3/ITSM Processes and Functions
Introduction to itil v3/ITSM Processes and Functions
 
Data Governance Overview - Doreen Christian
Data Governance Overview - Doreen ChristianData Governance Overview - Doreen Christian
Data Governance Overview - Doreen Christian
 
ITIL V3 Overiview Introduction
ITIL V3 Overiview IntroductionITIL V3 Overiview Introduction
ITIL V3 Overiview Introduction
 
2016-06-08 FDA Inspection Readiness - Mikael Yde
2016-06-08 FDA Inspection Readiness - Mikael Yde2016-06-08 FDA Inspection Readiness - Mikael Yde
2016-06-08 FDA Inspection Readiness - Mikael Yde
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
 
Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...
Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...
Salesforce Application Lifecycle Management presented to EA Forum by Sam Garf...
 
Daniel Jasník - ITSMF pro cloudové služby - AID2019
Daniel Jasník - ITSMF pro cloudové služby - AID2019Daniel Jasník - ITSMF pro cloudové služby - AID2019
Daniel Jasník - ITSMF pro cloudové služby - AID2019
 
Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right
 
ISO 9001 Quality Management Systems: Implementation and Integration
ISO 9001 Quality Management Systems: Implementation and IntegrationISO 9001 Quality Management Systems: Implementation and Integration
ISO 9001 Quality Management Systems: Implementation and Integration
 
DevOps
DevOpsDevOps
DevOps
 
Narendra tomar (test manager)
Narendra tomar (test manager)Narendra tomar (test manager)
Narendra tomar (test manager)
 
GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...
GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...
GLOC 2018: Automation or How We Eliminated Manual EBS R12.2 Upgrades and Beca...
 

More from Kevin Lee

Patient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced AnalyticsPatient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced AnalyticsKevin Lee
 
Introduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric DepartmentIntroduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric DepartmentKevin Lee
 
A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...
A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...
A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...Kevin Lee
 
Prompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data ScientistsPrompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data ScientistsKevin Lee
 
Leading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management LeadershipLeading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management LeadershipKevin Lee
 
How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1Kevin Lee
 
Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...Kevin Lee
 
How I became ML Engineer
How I became ML Engineer How I became ML Engineer
How I became ML Engineer Kevin Lee
 
Artificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical IndustryArtificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical IndustryKevin Lee
 
Tell stories with jupyter notebook
Tell stories with jupyter notebookTell stories with jupyter notebook
Tell stories with jupyter notebookKevin Lee
 
Perfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard dataPerfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard dataKevin Lee
 
Machine Learning : why we should know and how it works
Machine Learning : why we should know and how it worksMachine Learning : why we should know and how it works
Machine Learning : why we should know and how it worksKevin Lee
 
Big data for SAS programmers
Big data for SAS programmersBig data for SAS programmers
Big data for SAS programmersKevin Lee
 
Big data in pharmaceutical industry
Big data in pharmaceutical industryBig data in pharmaceutical industry
Big data in pharmaceutical industryKevin Lee
 
How FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submissionHow FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submissionKevin Lee
 
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...Kevin Lee
 
Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?Kevin Lee
 
SAS integration with NoSQL data
SAS integration with NoSQL dataSAS integration with NoSQL data
SAS integration with NoSQL dataKevin Lee
 
Introduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmersIntroduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmersKevin Lee
 
Two different use cases to obtain best response using recist 11 sdtm and a ...
Two different use cases to obtain best response using recist 11   sdtm and a ...Two different use cases to obtain best response using recist 11   sdtm and a ...
Two different use cases to obtain best response using recist 11 sdtm and a ...Kevin Lee
 

More from Kevin Lee (20)

Patient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced AnalyticsPatient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced Analytics
 
Introduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric DepartmentIntroduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric Department
 
A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...
A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...
A fear of missing out and a fear of messing up : A Strategic Roadmap for Chat...
 
Prompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data ScientistsPrompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data Scientists
 
Leading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management LeadershipLeading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management Leadership
 
How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1
 
Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...
 
How I became ML Engineer
How I became ML Engineer How I became ML Engineer
How I became ML Engineer
 
Artificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical IndustryArtificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical Industry
 
Tell stories with jupyter notebook
Tell stories with jupyter notebookTell stories with jupyter notebook
Tell stories with jupyter notebook
 
Perfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard dataPerfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard data
 
Machine Learning : why we should know and how it works
Machine Learning : why we should know and how it worksMachine Learning : why we should know and how it works
Machine Learning : why we should know and how it works
 
Big data for SAS programmers
Big data for SAS programmersBig data for SAS programmers
Big data for SAS programmers
 
Big data in pharmaceutical industry
Big data in pharmaceutical industryBig data in pharmaceutical industry
Big data in pharmaceutical industry
 
How FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submissionHow FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submission
 
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
 
Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?
 
SAS integration with NoSQL data
SAS integration with NoSQL dataSAS integration with NoSQL data
SAS integration with NoSQL data
 
Introduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmersIntroduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmers
 
Two different use cases to obtain best response using recist 11 sdtm and a ...
Two different use cases to obtain best response using recist 11   sdtm and a ...Two different use cases to obtain best response using recist 11   sdtm and a ...
Two different use cases to obtain best response using recist 11 sdtm and a ...
 

Recently uploaded

Ozhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Ozhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetOzhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Ozhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
palanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
palanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetpalanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
palanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Patna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Patna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetPatna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Patna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Tirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Tirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetTirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Tirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Sambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Sambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetSambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Sambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Thrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Thrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetThrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Thrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
kochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetkochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
kozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetkozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Rajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Rajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetRajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Rajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Dehradun Call Girls 8854095900 Call Girl in Dehradun Uttrakhand
Dehradun Call Girls 8854095900 Call Girl in Dehradun  UttrakhandDehradun Call Girls 8854095900 Call Girl in Dehradun  Uttrakhand
Dehradun Call Girls 8854095900 Call Girl in Dehradun Uttrakhandindiancallgirl4rent
 
Malda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Malda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetMalda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Malda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Muzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Muzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetMuzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Muzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
ooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
ooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
ooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetCall Girls Service
 
Vip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real Meet
Vip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real MeetVip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real Meet
Vip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real MeetAhmedabad Call Girls
 
Call Girl in Indore 8827247818 {Low Price}👉 Nitya Indore Call Girls * ITRG...
Call Girl in Indore 8827247818 {Low Price}👉   Nitya Indore Call Girls  * ITRG...Call Girl in Indore 8827247818 {Low Price}👉   Nitya Indore Call Girls  * ITRG...
Call Girl in Indore 8827247818 {Low Price}👉 Nitya Indore Call Girls * ITRG...mahaiklolahd
 
Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...
Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...
Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...mahaiklolahd
 
Kochi call girls Mallu escort girls available 7877702510
Kochi call girls Mallu escort girls available 7877702510Kochi call girls Mallu escort girls available 7877702510
Kochi call girls Mallu escort girls available 7877702510Vipesco
 
Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024Sheetaleventcompany
 
Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...
Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...
Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...Ahmedabad Call Girls
 
Jaipur Call Girls 9257276172 Call Girl in Jaipur Rajasthan
Jaipur Call Girls 9257276172 Call Girl in Jaipur RajasthanJaipur Call Girls 9257276172 Call Girl in Jaipur Rajasthan
Jaipur Call Girls 9257276172 Call Girl in Jaipur Rajasthanindiancallgirl4rent
 

Recently uploaded (20)

Ozhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Ozhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetOzhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Ozhukarai Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
palanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
palanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetpalanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
palanpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Patna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Patna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetPatna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Patna Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Tirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Tirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetTirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Tirupati Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Sambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Sambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetSambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Sambalpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Thrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Thrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetThrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Thrissur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
kochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetkochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kochi Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
kozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetkozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
kozhikode Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Rajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Rajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetRajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Rajkot Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Dehradun Call Girls 8854095900 Call Girl in Dehradun Uttrakhand
Dehradun Call Girls 8854095900 Call Girl in Dehradun  UttrakhandDehradun Call Girls 8854095900 Call Girl in Dehradun  Uttrakhand
Dehradun Call Girls 8854095900 Call Girl in Dehradun Uttrakhand
 
Malda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Malda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetMalda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Malda Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Muzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Muzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real MeetMuzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
Muzaffarpur Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
ooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
ooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meetooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
ooty Call Girls 👙 6297143586 👙 Genuine WhatsApp Number for Real Meet
 
Vip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real Meet
Vip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real MeetVip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real Meet
Vip Call Girls Makarba 👙 6367187148 👙 Genuine WhatsApp Number for Real Meet
 
Call Girl in Indore 8827247818 {Low Price}👉 Nitya Indore Call Girls * ITRG...
Call Girl in Indore 8827247818 {Low Price}👉   Nitya Indore Call Girls  * ITRG...Call Girl in Indore 8827247818 {Low Price}👉   Nitya Indore Call Girls  * ITRG...
Call Girl in Indore 8827247818 {Low Price}👉 Nitya Indore Call Girls * ITRG...
 
Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...
Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...
Call Girl in Bangalore 9632137771 {LowPrice} ❤️ (Navya) Bangalore Call Girls ...
 
Kochi call girls Mallu escort girls available 7877702510
Kochi call girls Mallu escort girls available 7877702510Kochi call girls Mallu escort girls available 7877702510
Kochi call girls Mallu escort girls available 7877702510
 
Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024
 
Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...
Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...
Independent Call Girls Hyderabad 💋 9352988975 💋 Genuine WhatsApp Number for R...
 
Jaipur Call Girls 9257276172 Call Girl in Jaipur Rajasthan
Jaipur Call Girls 9257276172 Call Girl in Jaipur RajasthanJaipur Call Girls 9257276172 Call Girl in Jaipur Rajasthan
Jaipur Call Girls 9257276172 Call Girl in Jaipur Rajasthan
 

Standards metadata management - version control and its governance

  • 1. Accenture Accelerated R&D Standards Metadata Management – version control and its governance Kevin Lee CDISC NJ Meeting at 01/28/2015 We help our Clients deliver better outcomes, so they can improve the quality of people’s lives.
  • 2. 2© 2015 Accenture All Rights Reserved. Happy New Year Year of Sheep • 2015 • 2003 • 1991 • 1979 • 1967 • 1955 • 1943
  • 3. 3© 2015 Accenture All Rights Reserved. Agenda Introduction of Standards Metadata Management Version Control Governance Final Thoughts
  • 4. 4© 2015 Accenture All Rights Reserved. Introduction of Standards • Industry Standards • Clinical Data Interchange Standards Consortium (CDISC) – CDASH, SDTM, ADaM and LAB • NCI CT • HL7 • eCTD (electronic Common Technical Document) • Company Standards • Global Standards • Therapeutic Standards • Business Unit Standards
  • 5. 5© 2015 Accenture All Rights Reserved. Introduction of Metadata Management • Definition • Managing data about other data • Examples of metadata Variable Name Variable Label Type CT Role Core STUDYID Study Identifier Char Identifier Req DOMAIN Domain Abbreviation Char DM Identifier Req USUBJID Unique Subject Identifier Char Identifier Req
  • 6. 6© 2015 Accenture All Rights Reserved. Examples of Metadata Management • Creating new standards (e.g., variables and domains) • Modifying the attributes (e.g., label, type) of current standards • Adding the new attributes to current standards • Archiving the standards • Managing the information that transforms data into a new structure (e.g.: CDASH to SDTM) • Leveraging the Schedule of Events table to determine the data domains required for a study • Assigning versions (e.g., major or minor) to standards after changes • Maintaining multiple versions of standards (e.g., SDTMIG 3.1.2, 3.1.3)
  • 7. 7© 2015 Accenture All Rights Reserved. Industry CDISC Standards versions • CDASH – 1.1 • SDTM (IG) – 1.2 (3.1.2), 1.3 (3.1.3), 1.4 (3.2) • PRM – 1.0 • LAB – 1.01 • SENDIG – 3 • ADaM (IG) – 2.1 (1.0) • SMD-XML – 1.0 • ODM-XML – 1.3.1, 1.3.2 • Define-XML – 1.0, 2.0 • DataSet-XML – 1.0
  • 8. 8© 2015 Accenture All Rights Reserved. Company Standards versions • Industry + company-specific standards • Global standards version • GS v1 – CDASH 1.1, SDTM (IG) 1.3(3.1.2), ADaM(IG) 2.1(1.0) • GS v2 – CDASH 1.1, SDTM (IG) 1.4(3.2), ADaM(IG) 2.1(1.0) • Annual global standards version • GS v2013 • GS v2014 • GS v2015
  • 9. 9© 2015 Accenture All Rights Reserved. Why version control is important? • FDA Requirements • CDISC Standards compliant data submission • Data Standards Catalog • Versions that FDA supports and requires. • Submission document • SDRG(Study Data Reviewer’s Guide) • ADRG(Analysis Data Reviewer’s Guide) • Multiple studies employed different versions across the duration of a submission • Phase I used SDTMIG 3.1.2, but Phase II and III used SDTMIG 3.1.3. • ISS/ISE
  • 10. 10© 2015 Accenture All Rights Reserved. How to control versions/ How to manage standards?
  • 11. 11© 2015 Accenture All Rights Reserved. Standards Metadata Management vs Governance Management • Making decisions Governance • Setting the environment where others can manage effectively
  • 12. 12© 2015 Accenture All Rights Reserved. What is governance? According to a report by Boeing, from 2001 through 2010, the number of fatalities per one million flight hours is less than one. It attributed the success rate of air traffic control to:  Process  Specified roles/responsibility  Technology/system
  • 13. 13© 2015 Accenture All Rights Reserved. What is standards governance? Standards governance is: • Oversight for the development and maintenance of clinical data standards • An instrument that ensures that a standard is developed efficiently, consistently, and properly used across the clinical trials organization • Assurance that maximum process efficiency from a standards- based clinical data lifecycle is achievable  Process – change requests and governance workflow  Specified roles/responsibility – SMEs who ensure standards are applied appropriately  Technology/system – technology and systems that support change requests and governance workflow
  • 14. 14© 2015 Accenture All Rights Reserved. Three key components of Standards Governance People Process Technology
  • 15. 15© 2015 Accenture All Rights Reserved. People of Standards Governance Below is a general example of some roles and responsibilities that sponsors implement to effectively carry out their standards governance. Role Skillset Responsibility Requestors • Programmers • Data Management Request a new or revised standard Developers • Standards SME • Programmers • Data Management Develop the metadata for the standard Approvers • Standards SME Approve the new or revised standard
  • 16. 16© 2015 Accenture All Rights Reserved. Standards Group/SME in Governance • Types • Functional SME • Centralized Standards Group • Advisory Group • Responsibility • SME for each business unit (e.g. DM) – develop the standards • Advisory/Centralized Standards Group – approve the new/change standards
  • 17. 17© 2015 Accenture All Rights Reserved. Governance Process • Workflow • Definition • An orchestrated and repeatable pattern of business activity enabled by the systematic organization of resources • A sequence of operations, declared as work of a person or group.
  • 18. 18© 2015 Accenture All Rights Reserved. Examples of Governance Workflow SDTM DM (Developer) QC (Validator) CDISC compliance checks (OpenCDISC)
  • 19. 19© 2015 Accenture All Rights Reserved. Governance Process in Standards • Systematic business activities by standards resources that manage the standards. • Examples of Types: New Request, Modify and Retire • Workflow: Request, Development and Approval Change Request • Assessment • Impact Development • Technical • Subject Matter Implementation • Review • Approval
  • 20. 20© 2015 Accenture All Rights Reserved. Examples of “Modification” workflow of Standards Governance Human task System task Email Notification Requestor System Reviewer Final Reviewer email notification to Developer Developer Assign the appropriate SME Notify Developer email notification to Developer Standards Change Request Review the request Request is appropriate? Notify Requestor No Yes email notification to assigned SME Change Standards Notify the assigned SME Notify Reviewer Review Standards Change Pass or Fail for Standards Change No Update on Standards and its version Yes Notify Requestors and Developers Start
  • 21. 21© 2015 Accenture All Rights Reserved. Technology of Standards Governance Spreadsheet- based Team Site or Share point Metadata Repository • Definition: The system/technology which people and workflow of standards governance operates on • Evolution:
  • 22. 22© 2015 Accenture All Rights Reserved. Metadata Repository (MDR) • General definition: a database created to store metadata. • Its function in Standards Governance: • Stores Standards metadata – Global, TA, Compound and Study level • Defines the roles and responsibility of people • Defines the business process • Drives roles-based, system-driven business process • Develop and maintain standards(e.g., version controls) • Stores the history of all the activities(e.g., requestor, approvals, dates and time, duration)
  • 23. 23© 2015 Accenture All Rights Reserved. Metadata Repository (MDR) - continued • Benefits • Data-based management, not document-based • More systemic/organized metadata management • System-based governance workflow • Control data flow, then control business process • Improve business process • Time-efficient, process-efficient • History of all the activities • Transparency
  • 24. 24© 2015 Accenture All Rights Reserved. Final Thought Governance ManagementStandards
  • 25. 25© 2015 Accenture All Rights Reserved. Sneak preview on 2015 • Metadata Repository • Data Modeling on Standards metadata • Process metadata • Study definition Metadata • Automated E2E clinical data development
  • 26. 26© 2015 Accenture All Rights Reserved. Contacts and Questions Kevin Lee Email: kevin.s.lee@accenture.com Linkedin: www.linkedin.com/in/kevinlee 1995 Tweet: @HelloKevinLee Blogs: HiKevinLee.tumbrl.com