IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
Cantonese spellcheck with Metaphones
1. CANTONESE SPELL CHECKING WITH
METAPHONES
/
full study on http://www.corgitoergosum.net/studies/
Tuesday, 14 June 2011
2. a study to see if this sort of spell suggestion is possible:
query:
query: Do you mean“ ”?
query:
Tuesday, 14 June 2011
3. Unlike more formal pingyin methods, the “HK Govt Cantonese
pingyin”, commonly used in street names and
identification papers in HK, is based on English
pronunciation...
Tuesday, 14 June 2011
4. In other words, two Cantonese words should have cantonese
pingyins that sound similar in English
“fung hei yue”
Tuesday, 14 June 2011
6. query: “ ”
look up pronunciation table
pronunciation: “luk ding gei”
Tuesday, 14 June 2011
7. query: “ ”
look up pronunciation table
pronunciation: “luk ding gei”
search phrase dictionary for similar sounding words
suggestion: Do you mean“ ”?
Tuesday, 14 June 2011
8. pronunciation table
pingyin char
ban
ban
ban
ban
ban
ban
Tuesday, 14 June 2011
9. using metaphone algorithm to compute “sound hashes”
(chan yik suen) XNYKXN
XNYKXN
XNYKSN
XNLKSN
XNYXN
XNSNK
Tuesday, 14 June 2011
10. finding similar sounding words: the levenshtein distance
algorithm
distance from XNYKXN
XNYJNK 3
XNYKSN 1
XNLKSN 2
XNY_XN 1
XN_SNK 4
XNYTKWN 2
XMYTSNK 4
YTYMSYPFT 8
Tuesday, 14 June 2011
11. seems like one is the safest from this limited test set
distance from XNYKXN
XNYJNK 3
XNYKSN 1
XNLKSN 2
XNY_XN 1
XN_SNK 4
XNYTKWN 2
XMYTSNK 4
YTYMSYPFT 8
Tuesday, 14 June 2011
12. some test results
query suggestion
no matches
no matches
Tuesday, 14 June 2011
15. limitations
no tonal info
HK Govt pingyin is very loose
doesn’t consider similar shaped characters, like:
, , , , ......
Tuesday, 14 June 2011
16. improvement areas
speed
only looks at of first character now
english is ignored
use libyell dict both for segmentation and common words (n-
grams) checking
simplified chinese rewrite
Tuesday, 14 June 2011