SlideShare a Scribd company logo
1 of 14
S
Expanding Access To
Department of Labor
(DOL) Data
Building APIs
Tyrone Grandison, PhD
Presidential Innovation Fellow
Department of Labor (DOL)
Data Innovation DC
March 4th, 2015
What is the DOL?
S A system of systems:
S Many moving parts. Some connected. Some not.
1. Administrative Review Board (ARB)
2. Benefits Review Board (BRB)
3. Bureau of International Labor Affairs (ILAB)
4. Bureau of Labor Statistics (BLS)
5. Center for Faith-Based &Neighborhood Partnerships
(CFBNP)
6. Employee Benefits Security Administration (EBSA)
7. Employees' Compensation Appeals Board (ECAB)
8. Employment & Training Administration (ETA)
9. Job Corps
10. Mine Safety &Health Administration (MSHA)
11. Occupational Safety & Health Administration (OSHA)
12. Office of Administrative Law Judges (OALJ)
13. Office of Congressional & Intergovernmental Affairs
(OCIA)
14. Office of the Assistant Secretary for Administration &
Management (OASAM)
15. Civil Rights Center
16. Office of the Assistant Secretary for Policy (OASP)
17. Office of the Chief Financial Officer(OCFO)
18. Office of Disability Employment Policy (ODEP)
19. Office of Federal Contract Compliance Programs (OFCCP)
20. Office of Inspector General (OIG)
21. Office of Labor-Management Standards (OLMS)
22. Office of Public Engagement (OPE)
23. Office of the Solicitor(SOL)
24. Office of Workers' Compensation Programs (OWCP)
25. Ombudsman for the Energy Employees Occupational
Illness Compensation Program (EEOMBD)
26. Pension Benefit Guaranty Corporation (PBGC)
27. Veterans' Employment & Training Service (VETS)
28. Wage and Hour Division (WHD)
29. Women's Bureau (WB)
30. Office Of Public Affairs (OPA)
Organizational Structure
Current Landscape
S Some agencies provide raw data through text files, Excel
sheets and or API
S Examples: MSHA, BLS, OSHA, ETA, VETS, WHD, OPA
S Current API*
S Covers over 200 datasets.
S Created by OPA Division of Enterprise Communications.
S Sole mission is to provide developers with access to DOL
data.
S api.dol.gov currently runs on Windows 2008.
*The current API is often referred to as APIv1 or “the legacy API
APIv1 Backend
S Built using OData.
S Solution also
contains:
S Drupal
S Software development
kits - not required, but
eases the
development of
applications
S Databases
Sources
S Department of Labor (DOL) data primarily available at:
S DOL’s developer site
S Data.gov
Other Sources
S Career One Stop
S AJC locations; licensing, certification, education,
apprenticeship, community college and training info; job
listings and job count info.
S Occupational Information Network (O*NET)
S Detailed profiles of occupations; translations from military
occupations, profiles of interests
One Last Source
S Bureau of Labor Statistics
S Labor Market Information
Using APIv1
S Register
S Visit https://devtools.dol.gov/developer
S Click the Register link.
S Fill in the registration form and submit it.
S A confirmation email will be sent to the
address you provided during registration.
S Click on the link in the email to activate
your developer account.
S Create API Key (Token)
S Visit https://devtools.dol.gov/developer
S At the login page, enter your username
and password
S Click on the My Tokens link
S Click "Create New Token"
S Provide a Shared Secret (deprecated, but
for the moment still required for the
registration process), Application Name,
and a Description
S The token value will be auto-generated
and added to your tokens list.
S Access the API
S The API is exposed as an OData
producer, with the addition of
request authorizations.
S To make API calls you must
supply a valid Token as the
"KEY" parameter on the query
string with every request.
Example
For DOLAgency and token d9c6c290-
da4c-424e-a378-fb4bd027b58b, the
direct link to Agency data is:
http://api.dol.gov/V1/DOLAgency/Agen
cies/?KEY=d9c6c290-da4c-424e-
a378-fb4bd027b58b
Result Format
By default, the DOL API's responses
are in XML format. To receive the data
in JSON, send an "Accept" header
with "application/json.”
FYI
S A lot of the assets are utilizing APIv1.
S Some are using their own API standard.
S By Q4 2015, all (participating) agencies will move to
APIv2.
APIv2 Desired Features
1. Single sign-on and authentication for datasets with private or
sensitive data.
2. Improved readability and usability of dataset documentation for all
skill levels of developers.
3. Create Internal API with legacy functions, plus CRUD and account
deactivation.
4. Modifying External API and SDKs to facilitate end-user development.
5. Enable all open data that is available via the API to be available in
one of the accepted bulk downloadable formats with options for
filtering.
6. Update Token self-service app to integrate with APIv2, mobile
support and new datasets.
7. Expose DOL web content as structured data via the API.
APIv2 is backwards-compatible with APIv1
APIv2 High Level Requirements
S Support requests over SSL/TLS
S Support read/write transactions (it is currently read-only)
S Continue to require and support API Keys
S Continue to be a centralized API
S Should not break existing apps using the DOL API
S Support the myUSA (if available or equivalent) authentication
service
S Continue to be a RESTful service that supports all platforms
S Same codebase for internal and external deployments
S Conform to the 18F API standards to the highest degree
practicable
APIv2 Backend
S Based on the GitHub - Project Open
Data community contributed code
S Will run on the LAMP stack.
S Will also consist of:
S Code Igniter (Ellis Lab) Application
Framework
S Server Clustering using a Beowulf Cluster
to leverage load balancing and parallel
processing
S Caching using Varnish Cache
S Will incorporate Object Oriented
Design
S Results default to JSON
Live Long
and
Prosper
Questions:
innovationopenhrs@dol.gov

More Related Content

Viewers also liked

Building APIs in Government for Social Good
Building APIs in Government for Social GoodBuilding APIs in Government for Social Good
Building APIs in Government for Social GoodTyrone Grandison
 
Kirolaren onurak osasunean
Kirolaren onurak osasuneanKirolaren onurak osasunean
Kirolaren onurak osasuneannereak
 
Toward a Free Press: An Online Publisher's Toolkit
Toward a Free Press: An Online Publisher's ToolkitToward a Free Press: An Online Publisher's Toolkit
Toward a Free Press: An Online Publisher's ToolkitChristopher Spencer
 
Сколько стоит ваш ИТ-сертификат?
Сколько стоит ваш ИТ-сертификат?Сколько стоит ваш ИТ-сертификат?
Сколько стоит ваш ИТ-сертификат?Dmitry Izmestiev
 
Network Media - A Final Lecture
Network Media - A Final LectureNetwork Media - A Final Lecture
Network Media - A Final Lecturevogmae
 
Site Branding - Beyond the 404 Page
Site Branding - Beyond the 404 PageSite Branding - Beyond the 404 Page
Site Branding - Beyond the 404 Pagefarmok
 
The need for a new digital divide model
The need for a new digital divide modelThe need for a new digital divide model
The need for a new digital divide modelPetr Lupac
 
Media Curriculum
Media CurriculumMedia Curriculum
Media Curriculumvogmae
 
2010 Fairmont Firebirds Baseball
2010 Fairmont Firebirds Baseball2010 Fairmont Firebirds Baseball
2010 Fairmont Firebirds BaseballRay Marcano
 
Presentasi Powerpoint Dengan Perspektor
Presentasi Powerpoint Dengan PerspektorPresentasi Powerpoint Dengan Perspektor
Presentasi Powerpoint Dengan PerspektorGlutha
 
149 amazing pictures
149 amazing pictures149 amazing pictures
149 amazing picturesthandastuff
 

Viewers also liked (19)

CitySDK Overview and Demo
CitySDK Overview and DemoCitySDK Overview and Demo
CitySDK Overview and Demo
 
Building APIs in Government for Social Good
Building APIs in Government for Social GoodBuilding APIs in Government for Social Good
Building APIs in Government for Social Good
 
Kirolaren onurak osasunean
Kirolaren onurak osasuneanKirolaren onurak osasunean
Kirolaren onurak osasunean
 
66245374 leadership
66245374 leadership66245374 leadership
66245374 leadership
 
Toward a Free Press: An Online Publisher's Toolkit
Toward a Free Press: An Online Publisher's ToolkitToward a Free Press: An Online Publisher's Toolkit
Toward a Free Press: An Online Publisher's Toolkit
 
The Big Think
The Big ThinkThe Big Think
The Big Think
 
Сколько стоит ваш ИТ-сертификат?
Сколько стоит ваш ИТ-сертификат?Сколько стоит ваш ИТ-сертификат?
Сколько стоит ваш ИТ-сертификат?
 
Network Media - A Final Lecture
Network Media - A Final LectureNetwork Media - A Final Lecture
Network Media - A Final Lecture
 
Melhore o seu linkedin!
Melhore o seu linkedin!Melhore o seu linkedin!
Melhore o seu linkedin!
 
Cooperative Micro Flip Teaching
Cooperative Micro Flip TeachingCooperative Micro Flip Teaching
Cooperative Micro Flip Teaching
 
Site Branding - Beyond the 404 Page
Site Branding - Beyond the 404 PageSite Branding - Beyond the 404 Page
Site Branding - Beyond the 404 Page
 
The need for a new digital divide model
The need for a new digital divide modelThe need for a new digital divide model
The need for a new digital divide model
 
Media Curriculum
Media CurriculumMedia Curriculum
Media Curriculum
 
2010 Fairmont Firebirds Baseball
2010 Fairmont Firebirds Baseball2010 Fairmont Firebirds Baseball
2010 Fairmont Firebirds Baseball
 
edp
edpedp
edp
 
Presentasi Powerpoint Dengan Perspektor
Presentasi Powerpoint Dengan PerspektorPresentasi Powerpoint Dengan Perspektor
Presentasi Powerpoint Dengan Perspektor
 
149 amazing pictures
149 amazing pictures149 amazing pictures
149 amazing pictures
 
4TSC Points and Awards
4TSC Points and Awards4TSC Points and Awards
4TSC Points and Awards
 
From Coding to Computational Thinking and Back
From Coding to Computational Thinking and BackFrom Coding to Computational Thinking and Back
From Coding to Computational Thinking and Back
 

Similar to Expanding Access To Department of Labor (DOL) data

Application Engine ETL
Application Engine ETLApplication Engine ETL
Application Engine ETLkabrilake
 
Data Pipelines -Big Data Meets Salesforce
Data Pipelines -Big Data Meets SalesforceData Pipelines -Big Data Meets Salesforce
Data Pipelines -Big Data Meets SalesforceCarolEnLaNube
 
Getting Started with Splunk Enterprise
Getting Started with Splunk EnterpriseGetting Started with Splunk Enterprise
Getting Started with Splunk EnterpriseSplunk
 
Stop making tools! Nobody likes them anyway...
Stop making tools! Nobody likes them anyway...Stop making tools! Nobody likes them anyway...
Stop making tools! Nobody likes them anyway...Christophe Guéret
 
ITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and ImplementationITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and ImplementationColin Bell
 
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...Denodo
 
BarCamp KL H20 Open Social Hackathon
BarCamp KL H20 Open Social HackathonBarCamp KL H20 Open Social Hackathon
BarCamp KL H20 Open Social Hackathonmarvin337
 
How to Transform Into a Data-Driven Organization
How to Transform Into a Data-Driven OrganizationHow to Transform Into a Data-Driven Organization
How to Transform Into a Data-Driven OrganizationWarrenCruz3
 
apidays LIVE Australia 2021 - Composable data for the composable enterprise b...
apidays LIVE Australia 2021 - Composable data for the composable enterprise b...apidays LIVE Australia 2021 - Composable data for the composable enterprise b...
apidays LIVE Australia 2021 - Composable data for the composable enterprise b...apidays
 
What are ap is, how do they work, and why are they beneficial to developers a...
What are ap is, how do they work, and why are they beneficial to developers a...What are ap is, how do they work, and why are they beneficial to developers a...
What are ap is, how do they work, and why are they beneficial to developers a...Shelly Megan
 
Opensocial Haifa Seminar - 2008.04.08
Opensocial Haifa Seminar - 2008.04.08Opensocial Haifa Seminar - 2008.04.08
Opensocial Haifa Seminar - 2008.04.08Ari Leichtberg
 
Data APIs Don't Discriminate [API World Stage Talk]
Data APIs Don't Discriminate [API World Stage Talk]Data APIs Don't Discriminate [API World Stage Talk]
Data APIs Don't Discriminate [API World Stage Talk]Sumit Sarkar
 
Internship @ LEADS Corporation Limited
Internship @ LEADS Corporation LimitedInternship @ LEADS Corporation Limited
Internship @ LEADS Corporation LimitedSadia Sharmin
 
Automating your tasks with microsoft flow
Automating your tasks with microsoft flowAutomating your tasks with microsoft flow
Automating your tasks with microsoft flowDipti Chhatrapati
 
A_Complete_Guide_to_API_Development.pdf
A_Complete_Guide_to_API_Development.pdfA_Complete_Guide_to_API_Development.pdf
A_Complete_Guide_to_API_Development.pdfPamRobert
 
Surya_Iseries_Resume
Surya_Iseries_ResumeSurya_Iseries_Resume
Surya_Iseries_Resumesurya siram
 
Kumar Godasi - Resume
Kumar Godasi - ResumeKumar Godasi - Resume
Kumar Godasi - ResumeKumar Godasi
 

Similar to Expanding Access To Department of Labor (DOL) data (20)

Application Engine ETL
Application Engine ETLApplication Engine ETL
Application Engine ETL
 
RashiBansal
RashiBansalRashiBansal
RashiBansal
 
Data Pipelines -Big Data Meets Salesforce
Data Pipelines -Big Data Meets SalesforceData Pipelines -Big Data Meets Salesforce
Data Pipelines -Big Data Meets Salesforce
 
Getting Started with Splunk Enterprise
Getting Started with Splunk EnterpriseGetting Started with Splunk Enterprise
Getting Started with Splunk Enterprise
 
Stop making tools! Nobody likes them anyway...
Stop making tools! Nobody likes them anyway...Stop making tools! Nobody likes them anyway...
Stop making tools! Nobody likes them anyway...
 
TEC-Roundtable-API
TEC-Roundtable-APITEC-Roundtable-API
TEC-Roundtable-API
 
ITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and ImplementationITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and Implementation
 
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
 
BarCamp KL H20 Open Social Hackathon
BarCamp KL H20 Open Social HackathonBarCamp KL H20 Open Social Hackathon
BarCamp KL H20 Open Social Hackathon
 
How to Transform Into a Data-Driven Organization
How to Transform Into a Data-Driven OrganizationHow to Transform Into a Data-Driven Organization
How to Transform Into a Data-Driven Organization
 
apidays LIVE Australia 2021 - Composable data for the composable enterprise b...
apidays LIVE Australia 2021 - Composable data for the composable enterprise b...apidays LIVE Australia 2021 - Composable data for the composable enterprise b...
apidays LIVE Australia 2021 - Composable data for the composable enterprise b...
 
What are ap is, how do they work, and why are they beneficial to developers a...
What are ap is, how do they work, and why are they beneficial to developers a...What are ap is, how do they work, and why are they beneficial to developers a...
What are ap is, how do they work, and why are they beneficial to developers a...
 
Opensocial Haifa Seminar - 2008.04.08
Opensocial Haifa Seminar - 2008.04.08Opensocial Haifa Seminar - 2008.04.08
Opensocial Haifa Seminar - 2008.04.08
 
Data APIs Don't Discriminate [API World Stage Talk]
Data APIs Don't Discriminate [API World Stage Talk]Data APIs Don't Discriminate [API World Stage Talk]
Data APIs Don't Discriminate [API World Stage Talk]
 
Internship @ LEADS Corporation Limited
Internship @ LEADS Corporation LimitedInternship @ LEADS Corporation Limited
Internship @ LEADS Corporation Limited
 
Automating your tasks with microsoft flow
Automating your tasks with microsoft flowAutomating your tasks with microsoft flow
Automating your tasks with microsoft flow
 
A_Complete_Guide_to_API_Development.pdf
A_Complete_Guide_to_API_Development.pdfA_Complete_Guide_to_API_Development.pdf
A_Complete_Guide_to_API_Development.pdf
 
Surya_Iseries_Resume
Surya_Iseries_ResumeSurya_Iseries_Resume
Surya_Iseries_Resume
 
Kumar Godasi - Resume
Kumar Godasi - ResumeKumar Godasi - Resume
Kumar Godasi - Resume
 
NITIN_DIXIT
NITIN_DIXITNITIN_DIXIT
NITIN_DIXIT
 

More from Tyrone Grandison

Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...
Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...
Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...Tyrone Grandison
 
Learning From the COViD-19 Global Pandemic
Learning From the COViD-19 Global PandemicLearning From the COViD-19 Global Pandemic
Learning From the COViD-19 Global PandemicTyrone Grandison
 
Systemic Barriers in Technology: Striving for Equity and Access
Systemic Barriers in Technology: Striving for Equity and AccessSystemic Barriers in Technology: Striving for Equity and Access
Systemic Barriers in Technology: Striving for Equity and AccessTyrone Grandison
 
Are There Ethical Limits to What Science Can Achieve or Should Pursue?
Are There Ethical Limits to What Science Can Achieve or Should Pursue?Are There Ethical Limits to What Science Can Achieve or Should Pursue?
Are There Ethical Limits to What Science Can Achieve or Should Pursue?Tyrone Grandison
 
Using Data and Computing for the Greater Good
Using Data and Computing for the Greater GoodUsing Data and Computing for the Greater Good
Using Data and Computing for the Greater GoodTyrone Grandison
 
How to effectively collaborate with your IT Departments to Develop Secure IA ...
How to effectively collaborate with your IT Departments to Develop Secure IA ...How to effectively collaborate with your IT Departments to Develop Secure IA ...
How to effectively collaborate with your IT Departments to Develop Secure IA ...Tyrone Grandison
 
DOES innovation Lab Launch
DOES innovation Lab LaunchDOES innovation Lab Launch
DOES innovation Lab LaunchTyrone Grandison
 
Creating Chandler's IT Strategic Plan
Creating Chandler's IT Strategic PlanCreating Chandler's IT Strategic Plan
Creating Chandler's IT Strategic PlanTyrone Grandison
 
Inventing with Purpose, Intention and Focus
Inventing with Purpose, Intention and FocusInventing with Purpose, Intention and Focus
Inventing with Purpose, Intention and FocusTyrone Grandison
 
Becoming a Nation of Innovation
Becoming a Nation of InnovationBecoming a Nation of Innovation
Becoming a Nation of InnovationTyrone Grandison
 
Running Mixed Workloads on Kubernetes at IHME
Running Mixed Workloads on Kubernetes at IHMERunning Mixed Workloads on Kubernetes at IHME
Running Mixed Workloads on Kubernetes at IHMETyrone Grandison
 
ISPAB Presentation - The Commerce Data Service
ISPAB Presentation - The Commerce Data ServiceISPAB Presentation - The Commerce Data Service
ISPAB Presentation - The Commerce Data ServiceTyrone Grandison
 
Strategies and Tactics for Accelerating IT Modernization
Strategies and Tactics for Accelerating IT ModernizationStrategies and Tactics for Accelerating IT Modernization
Strategies and Tactics for Accelerating IT ModernizationTyrone Grandison
 
The Creative Economy within the United States of America
The Creative Economy within the United States of AmericaThe Creative Economy within the United States of America
The Creative Economy within the United States of AmericaTyrone Grandison
 
Enabling Data-Driven Private-Public Collaborations
Enabling Data-Driven Private-Public CollaborationsEnabling Data-Driven Private-Public Collaborations
Enabling Data-Driven Private-Public CollaborationsTyrone Grandison
 
Creating a Data-Driven Government: Big Data With Purpose
Creating a Data-Driven Government: Big Data With PurposeCreating a Data-Driven Government: Big Data With Purpose
Creating a Data-Driven Government: Big Data With PurposeTyrone Grandison
 
Security and Privacy in Healthcare
Security and Privacy in HealthcareSecurity and Privacy in Healthcare
Security and Privacy in HealthcareTyrone Grandison
 
Publishing in Biomedical Data Science
Publishing in Biomedical Data SciencePublishing in Biomedical Data Science
Publishing in Biomedical Data ScienceTyrone Grandison
 

More from Tyrone Grandison (20)

Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...
Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...
Global Scientific Research as a Tool to Unlock and Engage Talent and Expand t...
 
Learning From the COViD-19 Global Pandemic
Learning From the COViD-19 Global PandemicLearning From the COViD-19 Global Pandemic
Learning From the COViD-19 Global Pandemic
 
Systemic Barriers in Technology: Striving for Equity and Access
Systemic Barriers in Technology: Striving for Equity and AccessSystemic Barriers in Technology: Striving for Equity and Access
Systemic Barriers in Technology: Striving for Equity and Access
 
COVID and the Ederly
COVID and the EderlyCOVID and the Ederly
COVID and the Ederly
 
Are There Ethical Limits to What Science Can Achieve or Should Pursue?
Are There Ethical Limits to What Science Can Achieve or Should Pursue?Are There Ethical Limits to What Science Can Achieve or Should Pursue?
Are There Ethical Limits to What Science Can Achieve or Should Pursue?
 
Using Data and Computing for the Greater Good
Using Data and Computing for the Greater GoodUsing Data and Computing for the Greater Good
Using Data and Computing for the Greater Good
 
How to effectively collaborate with your IT Departments to Develop Secure IA ...
How to effectively collaborate with your IT Departments to Develop Secure IA ...How to effectively collaborate with your IT Departments to Develop Secure IA ...
How to effectively collaborate with your IT Departments to Develop Secure IA ...
 
DOES innovation Lab Launch
DOES innovation Lab LaunchDOES innovation Lab Launch
DOES innovation Lab Launch
 
Creating Chandler's IT Strategic Plan
Creating Chandler's IT Strategic PlanCreating Chandler's IT Strategic Plan
Creating Chandler's IT Strategic Plan
 
Inventing with Purpose, Intention and Focus
Inventing with Purpose, Intention and FocusInventing with Purpose, Intention and Focus
Inventing with Purpose, Intention and Focus
 
Becoming a Nation of Innovation
Becoming a Nation of InnovationBecoming a Nation of Innovation
Becoming a Nation of Innovation
 
Running Mixed Workloads on Kubernetes at IHME
Running Mixed Workloads on Kubernetes at IHMERunning Mixed Workloads on Kubernetes at IHME
Running Mixed Workloads on Kubernetes at IHME
 
The Power Of Open
The Power Of OpenThe Power Of Open
The Power Of Open
 
ISPAB Presentation - The Commerce Data Service
ISPAB Presentation - The Commerce Data ServiceISPAB Presentation - The Commerce Data Service
ISPAB Presentation - The Commerce Data Service
 
Strategies and Tactics for Accelerating IT Modernization
Strategies and Tactics for Accelerating IT ModernizationStrategies and Tactics for Accelerating IT Modernization
Strategies and Tactics for Accelerating IT Modernization
 
The Creative Economy within the United States of America
The Creative Economy within the United States of AmericaThe Creative Economy within the United States of America
The Creative Economy within the United States of America
 
Enabling Data-Driven Private-Public Collaborations
Enabling Data-Driven Private-Public CollaborationsEnabling Data-Driven Private-Public Collaborations
Enabling Data-Driven Private-Public Collaborations
 
Creating a Data-Driven Government: Big Data With Purpose
Creating a Data-Driven Government: Big Data With PurposeCreating a Data-Driven Government: Big Data With Purpose
Creating a Data-Driven Government: Big Data With Purpose
 
Security and Privacy in Healthcare
Security and Privacy in HealthcareSecurity and Privacy in Healthcare
Security and Privacy in Healthcare
 
Publishing in Biomedical Data Science
Publishing in Biomedical Data SciencePublishing in Biomedical Data Science
Publishing in Biomedical Data Science
 

Recently uploaded

How we prevented account sharing with MFA
How we prevented account sharing with MFAHow we prevented account sharing with MFA
How we prevented account sharing with MFAAndrei Kaleshka
 
MK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docxMK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docxUnduhUnggah1
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...Boston Institute of Analytics
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...soniya singh
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhijennyeacort
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryJeremy Anderson
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.natarajan8993
 
9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home Service9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home ServiceSapana Sha
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptSonatrach
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectBoston Institute of Analytics
 
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一fhwihughh
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024thyngster
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...limedy534
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfchwongval
 

Recently uploaded (20)

How we prevented account sharing with MFA
How we prevented account sharing with MFAHow we prevented account sharing with MFA
How we prevented account sharing with MFA
 
MK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docxMK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docx
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data Story
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.
 
9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home Service9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home Service
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis Project
 
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdf
 

Expanding Access To Department of Labor (DOL) data

  • 1. S Expanding Access To Department of Labor (DOL) Data Building APIs Tyrone Grandison, PhD Presidential Innovation Fellow Department of Labor (DOL) Data Innovation DC March 4th, 2015
  • 2. What is the DOL? S A system of systems: S Many moving parts. Some connected. Some not. 1. Administrative Review Board (ARB) 2. Benefits Review Board (BRB) 3. Bureau of International Labor Affairs (ILAB) 4. Bureau of Labor Statistics (BLS) 5. Center for Faith-Based &Neighborhood Partnerships (CFBNP) 6. Employee Benefits Security Administration (EBSA) 7. Employees' Compensation Appeals Board (ECAB) 8. Employment & Training Administration (ETA) 9. Job Corps 10. Mine Safety &Health Administration (MSHA) 11. Occupational Safety & Health Administration (OSHA) 12. Office of Administrative Law Judges (OALJ) 13. Office of Congressional & Intergovernmental Affairs (OCIA) 14. Office of the Assistant Secretary for Administration & Management (OASAM) 15. Civil Rights Center 16. Office of the Assistant Secretary for Policy (OASP) 17. Office of the Chief Financial Officer(OCFO) 18. Office of Disability Employment Policy (ODEP) 19. Office of Federal Contract Compliance Programs (OFCCP) 20. Office of Inspector General (OIG) 21. Office of Labor-Management Standards (OLMS) 22. Office of Public Engagement (OPE) 23. Office of the Solicitor(SOL) 24. Office of Workers' Compensation Programs (OWCP) 25. Ombudsman for the Energy Employees Occupational Illness Compensation Program (EEOMBD) 26. Pension Benefit Guaranty Corporation (PBGC) 27. Veterans' Employment & Training Service (VETS) 28. Wage and Hour Division (WHD) 29. Women's Bureau (WB) 30. Office Of Public Affairs (OPA)
  • 4. Current Landscape S Some agencies provide raw data through text files, Excel sheets and or API S Examples: MSHA, BLS, OSHA, ETA, VETS, WHD, OPA S Current API* S Covers over 200 datasets. S Created by OPA Division of Enterprise Communications. S Sole mission is to provide developers with access to DOL data. S api.dol.gov currently runs on Windows 2008. *The current API is often referred to as APIv1 or “the legacy API
  • 5. APIv1 Backend S Built using OData. S Solution also contains: S Drupal S Software development kits - not required, but eases the development of applications S Databases
  • 6. Sources S Department of Labor (DOL) data primarily available at: S DOL’s developer site S Data.gov
  • 7. Other Sources S Career One Stop S AJC locations; licensing, certification, education, apprenticeship, community college and training info; job listings and job count info. S Occupational Information Network (O*NET) S Detailed profiles of occupations; translations from military occupations, profiles of interests
  • 8. One Last Source S Bureau of Labor Statistics S Labor Market Information
  • 9. Using APIv1 S Register S Visit https://devtools.dol.gov/developer S Click the Register link. S Fill in the registration form and submit it. S A confirmation email will be sent to the address you provided during registration. S Click on the link in the email to activate your developer account. S Create API Key (Token) S Visit https://devtools.dol.gov/developer S At the login page, enter your username and password S Click on the My Tokens link S Click "Create New Token" S Provide a Shared Secret (deprecated, but for the moment still required for the registration process), Application Name, and a Description S The token value will be auto-generated and added to your tokens list. S Access the API S The API is exposed as an OData producer, with the addition of request authorizations. S To make API calls you must supply a valid Token as the "KEY" parameter on the query string with every request. Example For DOLAgency and token d9c6c290- da4c-424e-a378-fb4bd027b58b, the direct link to Agency data is: http://api.dol.gov/V1/DOLAgency/Agen cies/?KEY=d9c6c290-da4c-424e- a378-fb4bd027b58b Result Format By default, the DOL API's responses are in XML format. To receive the data in JSON, send an "Accept" header with "application/json.”
  • 10. FYI S A lot of the assets are utilizing APIv1. S Some are using their own API standard. S By Q4 2015, all (participating) agencies will move to APIv2.
  • 11. APIv2 Desired Features 1. Single sign-on and authentication for datasets with private or sensitive data. 2. Improved readability and usability of dataset documentation for all skill levels of developers. 3. Create Internal API with legacy functions, plus CRUD and account deactivation. 4. Modifying External API and SDKs to facilitate end-user development. 5. Enable all open data that is available via the API to be available in one of the accepted bulk downloadable formats with options for filtering. 6. Update Token self-service app to integrate with APIv2, mobile support and new datasets. 7. Expose DOL web content as structured data via the API. APIv2 is backwards-compatible with APIv1
  • 12. APIv2 High Level Requirements S Support requests over SSL/TLS S Support read/write transactions (it is currently read-only) S Continue to require and support API Keys S Continue to be a centralized API S Should not break existing apps using the DOL API S Support the myUSA (if available or equivalent) authentication service S Continue to be a RESTful service that supports all platforms S Same codebase for internal and external deployments S Conform to the 18F API standards to the highest degree practicable
  • 13. APIv2 Backend S Based on the GitHub - Project Open Data community contributed code S Will run on the LAMP stack. S Will also consist of: S Code Igniter (Ellis Lab) Application Framework S Server Clustering using a Beowulf Cluster to leverage load balancing and parallel processing S Caching using Varnish Cache S Will incorporate Object Oriented Design S Results default to JSON

Editor's Notes

  1. An open protocol to allow the creation and consumption of queryable and interoperable RESTful APIs.
  2. Executive Order -- Making Open and Machine Readable the New Default for Government Information (May 9th, 2013) http://www.whitehouse.gov/the-press-office/2013/05/09/executive-order-making-open-and-machine-readable-new-default-government-
  3. Honorable Mention: https://business.usa.gov/developer
  4. 18F is a technology team inside the US federal government.