Презентация с Azure Bootcamp посвященная Azure Search

1. Welcome to the
BELARUS, MINSK

2. AZURE SEARCH
Alexej Sommer

3. Supported database types
■ Azure Cosmos DB
■ Azure SQL Database
■ SQL Server hosted in an AzureVM
■ Azure Blob Storage
■ AzureTable Storage

4. Azure Search elements
■ Datasources
■ Indexes
■ Indexers

5. Pricing
■ Free (3 indexes, up to 50 Mb storage)
■ Basic – 75$ month (15 indexes, 2Gb storage, up to 3 search
units, up to 3 replicas)
■ Standart – 250$ month (50 indexes, 25Gb storage, up to 36
search units, up to 12 replicas, up to 12 )
■ … up to 2850$ (with High Density support)

6. Create datasource with portal UI
■ Если вы используете Cosmos DB, то добавьте
Database=ИМЯ_ВАШЕЙ_БАЗЫ к connection string

7. Scoring profiles
"scoringProfiles": [
{
"name": "newDocuments",
"text": {
"weights": {
"title": 2,
“info": 1 }
} ]

8. Boosting
"functions": [ {
"type": "freshness",
"fieldName": "date",
"boost": 10,
"interpolation": "quadratic",
"freshness": {
"boostingDuration": "P7D"
} } ]

9. Suggesters
"suggesters": [
{
"name": "sg",
"searchMode": "analyzingInfixMatching",
"sourceFields": [“title", “name"]
}
]

10. Suggester vs Autocomplete
Suggestions API suggests documents and returns document Ids which
contain the query term
Autocomplete API returns potential terms from the index which match the
partial term in the query

11. Simple query syntax
wifi+luxury searching for wifi and luxury at same time
“luxury hotel” searching for phrase
wifi | luxury searching for wifi or luxury
wifi –luxury searching for wifi without luxury
motel+(wifi | luxury) you can combine with parenthesis
lux* searching for words starting from lux

12. Lucene query syntax - queryType=full
range searches are constructed in Azure Search
through $filter expressions
OR or ||
AND, && or +
NOT, ! or -

13. NOT ! или -
searchMode=any
wifi –luxury поиск содержит wifi или не содержит luxury
searchMode=all
wifi –luxury поиск содержит wifi и не содержит luxury

14. Стемминг и лемматизация
Сте́мминг — это процесс нахождения основы слова для
заданного исходного слова.
Лемматиза́ция — процесс приведения словоформы к лемме
— её нормальной (словарной) форме.

15. Analyzers
default analyzer is Standard Lucene
Lucene's English analyzer applies stemming as per Porter
Stemming algorithm
Microsoft's English analyzer performs lemmatization instead of
stemming

16. Escaping and encoding special
characters
Следующие символы
+ - && || ! ( ) { } [ ] ^ " ~ * ? : /
необходимо экранировать с помощью
Небезопасные для использования в URL символы
" ` < > # % { } | ^ ~ [ ]
необходимо энкодировать. Например, символ # станет %23

17. Fuzzy search
"blue~" or "blue~1" would return "blue", "blues", and "glue“
but…
"business~analyst" means business OR analyst.

18. Proximity search
"hotel airport"~5
will find the terms "hotel" and "airport"
within 5 words of each other in a document

19. Term boosting
rock^2 electronic
documents that contain the search term rock will be ranked
higher than the other search term electronic

20. Regular expression search
lucene.apache.org/core/4_10_2/core/org/apache/lucene
/util/automaton/RegExp.html
bit.ly/2Ug2CKq
Place RegEx expression between forward slashes "/“
/[mh]otel/

21. ODATA support
{
"name": "Scott",
"filter": "(age ge 25 and and lt 50) or surname eq 'Guthrie'"
}

22. Data Change Detection Policy for SQL
"dataChangeDetectionPolicy" : {
"@odata.type" :
"#Microsoft.Azure.Search.HighWaterMarkChangeDetectionPolicy",
"highWaterMarkColumnName" : "[a rowversion or last_updated
column name]" }
"dataChangeDetectionPolicy" : {
"@odata.type" :
"#Microsoft.Azure.Search.SqlIntegratedChangeTrackingPolicy" }

23. SQL Server ChangeTracking
ALTER DATABASE AdventureWorks
SET ALLOW_SNAPSHOT_ISOLATION ON;
ALTER DATABASE AdventureWorks
SET CHANGE_TRACKING = ON
(CHANGE_RETENTION = 2 DAYS, AUTO_CLEANUP = ON)

24. Data Change Detection Policy for
Cosmos DB
{
"@odata.type" :
"#Microsoft.Azure.Search.HighWaterMarkChangeDetectionPolicy"
,
"highWaterMarkColumnName" : "_ts"
}

25. Data Deletion Detection Policy
"dataDeletionDetectionPolicy" : {
"@odata.type" :
"#Microsoft.Azure.Search.SoftDeleteColumnDeletionDetectionPolicy",
"softDeleteColumnName" : "IsDeleted",
"softDeleteMarkerValue" : "true"
}

26. Development
NuGet package Microsoft.Azure.Search
REST API
Node.js and Java samples

27. Cognitive Search

28. Natural language processing skills
entity recognition
language detection
key phrase extraction
text manipulation
sentiment detection

29. Image processing
Optical Character Recognition (OCR)
textExtractionAlgorithm "handwritten“ (for English only)
textExtractionAlgorithm "printed“
Identification of visual features
provided by ComputerVision in Cognitive Services