For online jobs where data is largely unstructured and inconsistent, Python can be effectively utilized across various modelling and analysis workflows. This talk will go over a selection of Python packages employed in a text-heavy environment and a walkthrough on some text information extraction methods. Audiences will also get to hear about the application of these packages in building technological capabilities in a young, dynamic startup.
About JobTech - https://corporate.jobtech.co/
JobTech Portal - https://jobtech.co/
Jupyter Notebook and Data - https://github.com/weixuanwx/JobTech_PyCon2018
3. Jobseeker
• Aggregate jobs from
1000s of sources
• Job Recommendations
• Skills gap analysis
jobtech.co
Analytics
• Technology built over 10 years
• Semantic fingerprinting
• Insights on labour market
trends and opportunities
analytics.jobtech.co
Employer
• Taps on talent pool for source
of candidates
• Talent recommendations
vetted for quality & interest
jobtech.co/employer
1
2
3
3 Pillars of the JobTech System
4. Rank Technical Skills Number of Jobs Percentage of Jobs
1 Computer Science 15,846 25.8%
2 Troubleshooting 10,573 17.2%
3 Project Management 10,421 17%
4 Maintenance Management 9,471 15.4%
5 Java 8,556 13.9%
6 Data Analytics 8,256 13.5%
7 SQL 7,723 12.6%
8 Unix/Linux 7,552 12.3%
9 Software Development 7,066 11.5%
10 SOPs/Best Practices 7,061 11.5%
11 Cloud 6,141 10.0%
12 Monitoring And Evaluation 6,103 9.9%
13 Hardware 6,061 9.9%
14 Python 5,893 9.6%
15 Risk Management 5,540 9.0%
16 JavaScript 5,109 8.3%
17 Windows Server 4,989 8.1%
18 HTML4/HTML5 4,895 8.0%
19 Quality Audit/Management 4,815 7.8%
20 Configuration Management 4,713 7.7%
Total Number of Jobs Analysed 61,342
Ranked by number of technology
job postings that required these
skills.
Technology jobs here are defined as
jobs that involves Infocomm-
Technology related tasks and
responsibilities
Data Coverage: 1 Jul 2017 – 30 Apr
2018 (10 months)
Most Sought-after Skills/Domain among Singapore’s
Technology Jobs Postings
6. Python Packages We Love at JobTech
04/ Photography Basics
Photography is the science, art, application and practice of creating durable images by recording light or other electromagnetic radiation,
either electronically by means of an image sensor, or chemically by means of a light-sensitive material such as photographic film.
JobTech
04.
04.Visua
7. Accounting
Data Analytics
Web
Technologies
Finance
Engineering
Real-time Processing of Online Jobs Data
150 MILLION
Global Job Postings.
JobTech’s dynamic skills map is created from
millions of job postings that are fed through the
neural network every day.
Skills are automatically clustered to show
where and how they connect, and the
combination of skills necessary for a job.
JobTech’s Dynamic Skills Map
7
JobTech’s Dynamic Skills Map Allows Accurate and
Automatic Matching Between Candidates and Employers
9. FlashText on Singapore’s Online Jobs
0
10
20
30
40
50
60
Flask
ansible
pandas
selenium
regex
redis
scikit-learn
numpy
elasticsearch
sh
future
cryptography
scipy
pyramid
click
tornado
matplotlib
ssl
boto
pytest
celery
SQLAlchemy
packaging
Twisted
boto3
botocore
six
Markdown
futures
nose
bottle
hacking
Top Python Packages Mentions in Singapore's Online Jobs (1 Jul 2017 - Now)
Django is
top with
197
mentions!
10. Python Packages We Love at JobTech
04/ Photography Basics
Photography is the science, art, application and practice of creating durable images by recording light or other electromagnetic radiation,
either electronically by means of an image sensor, or chemically by means of a light-sensitive material such as photographic film.
JobTech
04.
04.Visua
https://jobtech.co/