Spark NLP is an open-source natural language processing library built on Apache Spark. The presentation introduces Spark NLP, discusses how it provides both pretrained and customizable NLP pipelines and models, and includes a code demonstration. The presenters are Veysel Kocaman, Lead Data Scientist at John Snow Labs, and David Talby, CTO of John Snow Labs.

1. Advanced Natural
Language Processing
with Spark NLP
Veysel Kocaman
David Talby

2. Agenda
• Introducing Spark NLP
• Pretrained & Custom NLP Pipelines
• Pretrained & Trainable NLP Models
• Code!
Veysel Kocaman
Lead Data Scientist, John Snow Labs
David Talby
CTO, John Snow Labs

3. ● Spark NLP is an open-source natural language
processing library, built on top of Apache Spark
and Spark ML. (Initial release: Oct 2017)
○ A single unified solution for all your NLP needs
○ Take advantage of transfer learning and
implementing the latest and greatest SOTA
algorithms and models in NLP research
○ The most widely used NLP library in industry
(2 years in a row)
○ Delivering an enterprise grade NLP library
(in production use by multiple Fortune 500’s)
○ Highly active development team & community
(26 new releases in 2018. 30 new releases in 2019.)
Daily ~ 10K
Monthly ~ 250K
Introducing Spark NLP

4. 4
Spark NLP

5. 5
Spark NLP
for Healthcare

6. The NLP Industry Survey
- September 2020

7. Pipeline of annotators
Spark NLP Pipelines

8. Let’s code!

9. Thank You!
Getting started, docs, videos, examples:
nlp.johnsnowlabs.com
Community:
spark-nlp.slack.com