Azure Search is now the smartest enterprise search engine! Come learn how you can use the new Cognitive Search feature to understand the content of your enterprise files, extract information and enrich it so that you can more quickly find the information and insights that you care about. We'll show demos, success stories and introduce the technical concepts to get you started.

5. Text
(1) Validate enrichment pipeline

6. Tags
“throwing”, “ball”, “girl”, “grass”, “basketball”
Caption
“A girl throwing a ball”

7. Entities
Persons
“Anita Christiansen”,
“Conrad Nuber”,
Locations
“Bothell”, “Woodinville”
Organization
“Litware Insurance Corp.”

8. Azure Cognitive Services
Powerful prebuilt AI models exposed as API services
Process images, video, speech, language and more
Simple REST APIs with .NET, Java, Python, Node SDKs
Easily customize your own state-of-the-art AI models
Train in the cloud and deploy anywhere
To develop applications that understand us
Vision
Speech
Language
Conversation
Bing Search
Knowledge

10. Management Free
Keyword search
Faceting
Geospatial support
Multi-Language Support
Suggestions/auto-complete
Customizable scoring models
Proximity Search
Synonyms
etc.

12. Understanding the latent value in all content

13. HOW DO WE DO THIS?
Ingest Enrich Explore

14. AN AI–FIRST APPROACH TO CONTENT UNDERSTANDING

15. Ingest Enrich Explore
Data Cognitive Skills Azure Search
AN AI–FIRST APPROACH TO CONTENT UNDERSTANDING
Cognitive Search

16. Annotated
Documents
Customer
Data
Built-in Cognitive Skills
OCR,
Key Phrase Extraction,
People Names,
Company Names,
Sentiment Analyzer,
Computer Vision,
etc.
Search
Index
.pdf
.doc
.jpeg
…
Third Party Enrichers
Custom classification models,
Custom entity extraction,
etc.
Azure Machine
Learning

18. Annotated
Documents
Built-in Cognitive Skills
OCR,
Key Phrase Extraction,
People Names,
Company Names,
Sentiment Analyzer,
Computer Vision,
etc.
Search
Index
Third Party Enrichers
Custom classification models,
Custom entity extraction,
etc.
Azure Machine
Learning
Customer
Data
.pdf
.doc
.jpeg
…

20. Annotated
Documents
Search
Index
Built-in Cognitive Skills
OCR,
Key Phrase Extraction,
People Names,
Company Names,
Sentiment Analyzer,
Computer Vision,
etc.
Third Party Enrichers
Custom classification models,
Custom entity extraction,
etc.
Customer
Data
.pdf
.doc
.jpeg
…

21. Key Phrase Extraction
Sentiment Analysis
Organization Entity Extraction
Location Entity Extraction
Persons Entity Extraction
Language Detection
Face Detection
Tag Extraction
Celebrity Recognition
Landmark Detection
Handwriting Recognition (Preview)
Printed Text Recognition

22. {
"values": [
{
"recordId": "7cad2",
"data":
{
"myOuput1": “animals"
}
},
{
"recordId": "7cad3",
"data":
{
"myOutput1": “colors"
}
},
…
]
}
{
"values": [
{
"recordId": "7cad2",
"data":
{
"myInput1": "fox",
"myInput2": "cat",
}
},
{
"recordId": "7cad3",
"data":
{
"myInput1": "blue",
"myInput2":"red",
}
},
…
]
}

23. content
keyPhrases
organizations
docClass

24. content
normalized
images
language
tags
orgs
content
content

25. "skills": [
{
"@odata.type": "#Microsoft.Skills.Text.LanguageDetectionSkill",
"inputs":
[
{ "name": "text", "source": "/document/content" }
],
"outputs":
[
{ "name": "languageCode", "targetName": "myLanguageCode" },
{ "name": "languageName", "targetName": "myLanguageName" }
]
},

26. …,
{
"@odata.type": "#Microsoft.Skills.Text.NamedEntityRecognitionSkill",
"categories": [ "Organization" ],
"defaultLanguageCode": "en",
"inputs":
[
{ "name": "text", "source": "/document/content" },
"name" "languageCode" "source" "/document/myLanguageCode"
],
"outputs":
[
{ "name": "organizations", "targetName": "organizations" }
]
},

27. content
normalized
images
language
tags
orgs
content
content

28. …,
{
"@odata.type": "#Microsoft.Skills.Text.NamedEntityRecognitionSkill",
"categories": [ "Organization" ],
"defaultLanguageCode": "en",
"inputs":
[
{ "name": "text", "source": "/document/content" },
"name" "languageCode" "source" "/document/myLanguagecode"
],
"outputs":
[
{ "name": "organizations", "targetName": "organizations" }
]
},

29. …,
{
"@odata.type": "#Microsoft.Skills.Custom.WebApiSkill",
"uri" "https://myskill.azurewebsites.net/api/OrgId"
"context": "/document/organizations/*" ,
"httpHeaders": {"Api-Key": "mySecret" },
"inputs":
[
{ "name": “organizationName", "source": "/document/organizations/*" },
],
"outputs":
[
{ "name": "organizationId", "targetName": "organizationId" }
]
},

30. Search
Index
Built-in Cognitive Skills
OCR,
Key Phrase Extraction,
People Names,
Company Names,
Sentiment Analyzer,
Computer Vision,
etc.
Third Party Enrichers
Custom classification models,
Custom entity extraction,
etc.
Customer
Data
.pdf
.doc
.jpeg
…
Annotated
Documents

31. /document
/languageCode /keyPhrases /organizations /images
/1
/2
/…
/n
/1
/2
/…
/n
organizationId
organizationId
organizationId
organizationId
/1
/2
/…
/n
tags
tags
tags
tags
document.pdf

32. Annotated
Documents
Built-in Cognitive Skills
OCR,
Key Phrase Extraction,
People Names,
Company Names,
Sentiment Analyzer,
Computer Vision,
etc.
Third Party Enrichers
Custom classification models,
Custom entity extraction,
etc.
Customer
Data
.pdf
.doc
.jpeg
…
Search
Index

33. /document
/keyPhrases
/0
/1
/…
/n
/organizations
/0
/1
/…
/n
organizationId
organizationId
organizationId
organizationId
/images
/0
/1
/…
/n
tags
tags
tags
tags
New Indexer Property
{
…
"outputFieldMappings":
[
{
"sourceFieldName":
"/document/organizations/*/organizationId",
"targetFieldName":
"orgIds"
} ,
…
]
}

34. Annotated
Documents
Customer
Data
Built-in Cognitive Skills
OCR,
Key Phrase Extraction,
People Names,
Company Names,
Sentiment Analyzer,
Computer Vision,
etc.
Search
Index
.pdf
.doc
.jpeg
…
Third Party Enrichers
Custom classification models,
Custom entity extraction,
etc.
Azure Machine
Learning

36. …,
{
"@odata.type": "#Microsoft.Skills.Custom.WebApiSkill",
"uri" "https://myskill.azurewebsites.net/api/OrgId"
"httpHeaders": {"Api-Key": "mySecret" },
"context": "/document/organizations/*" ,
"inputs":
[
{ "name": “organizationName", "source": "/document/organizations/*" },
],
"outputs":
[
{ "name": "organizationId", "targetName": "organizationId" }
]
},

37. Azure Machine
Learning

38. “Lorem ipsum dolor sit amet,
consectetur adipiscing elit, sed
do eiusmod tempor incididunt ut
labore et dolore magna aliqua. Ut
enim ad minim veniam, quis
nostrud exercitation ullamco
laboris nisi…”
Class A
Class B
Class C

39. “Lorem ipsum dolor sit amet,
consectetur adipiscing elit, sed
do eiusmod tempor incididunt ut
labore et dolore magna aliqua. Ut
enim ad minim veniam, quis
nostrud exercitation ullamco
laboris nisi…”
“Lorem ipsum dolor sit amet,
consectetur adipiscing elit, sed
do eiusmod tempor incididunt ut
labore et dolore magna aliqua. Ut
enim ad minim veniam, quis
nostrud exercitation ullamco
laboris nisi…”
Entity type A
Entity type B

46. Labeled
Data
Custom
Entity
Extraction
Template
Azure ML
Annotated
Documents
Customer
Data
Search
Index

47. Try Cognitive Search today
Documentation | Sign up for Azure Search
Azure Machine Learning Package for Text Analytics
Documentation | Create a Data Science Virtual Machine
Contact Us
cog-search-sup@microsoft.com
Cognitive Services
Documentation | Sign up