• 技术文章 >常见问题 >Python常见问题

    python实现查询纠错

    yangyang2020-04-09 10:12:33原创2987

    python实现查询纠错的方法:

    方法一:

    1、输入一个拼写错误的单词,调用 aspell -a 后得到一些候选正确单词,然后用距离编辑进一步嗮选出更精确的词。比如运行 aspell -a,输入 ‘hella’ 后得到如下结果:

    hell, Helli, hello, heal, Heall, he’ll, hells, Heller, Ella, Hall, Hill, Hull, hall, heel, hill, hula, hull, Helga, Helsa, Bella, Della, Mella, Sella, fella, Halli, Hally, Hilly, Holli, Holly, hallo, hilly, holly, hullo, Hell’s, hell’s

    2、什么是距离编辑(Edit-Distance,也叫 Levenshtein algorithm)呢?就是说给定一个单词,通过多次插入、删除、交换、替换单字符的操作后枚举出所有可能的正确拼写,比如输入 ‘hella’,经过多次插入、删除、交换、替换单字符的操作后变成:

    ‘helkla’, ‘hjlla’, ‘hylla’, ‘hellma’, ‘khella’, ‘iella’, ‘helhla’, ‘hellag’, ‘hela’, ‘vhella’, ‘hhella’, ‘hell’, ‘heglla’, ‘hvlla’, ‘hellaa’, ‘ghella’, ‘hellar’, ‘heslla’, ‘lhella’, ‘helpa’, ‘hello’, …

    3、综合上面2个集合的结果,并且考虑到一些理论知识可以提高拼写检查的准确度,比如一般来说写错单词都是无意的或者误打,完全错的单词可能性很小,而且单词的第一个字母一般不会拼错。所以可以在上面集合里去掉第一个字母不符合的单词,比如:’Sella’, ‘Mella’, khella’, ‘iella’ 等,这里 VPSee 不删除单词,而把这些单词从队列里取出来放到队列最后(优先级降低),所以实在匹配不了以 h 开头的单词才去匹配那些以其他字母开头的单词。

    4、程序中用到了外部工具 aspell,如何在 Python 里捕捉外部程序的输入和输出以便在 Python 程序里处理这些输入和输出呢?Python 2.4 以后引入了 subprocess 模块,可以用 subprocess.Popen 来处理。

    实现代码:

    1

    2

    3

    4

    5

    6

    7

    8

    9

    10

    11

    12

    13

    14

    15

    16

    17

    18

    19

    20

    21

    22

    23

    24

    25

    26

    27

    28

    29

    30

    31

    32

    33

    34

    35

    36

    37

    38

    39

    40

    41

    42

    43

    44

    45

    46

    47

    48

    49

    50

    51

    52

    53

    54

    55

    #!/usr/bin/python

    # A simple spell checker

    import os, sys, subprocess, signal

    alphabet = 'abcdefghijklmnopqrstuvwxyz'

    def found(word, args, cwd = None, shell = True):

    child = subprocess.Popen(args,

    shell = shell,

    stdin = subprocess.PIPE,

    stdout = subprocess.PIPE,

    cwd = cwd,

    universal_newlines = True)

    child.stdout.readline()

    (stdout, stderr) = child.communicate(word)

    if ": " in stdout:

    # remove \n\n

    stdout = stdout.rstrip("\n")

    # remove left part until :

    left, candidates = stdout.split(": ", 1)

    candidates = candidates.split(", ")

    # making an error on the first letter of a word is less

    # probable, so we remove those candidates and append them

    # to the tail of queue, make them less priority

    for item in candidates:

    if item[0] != word[0]:

    candidates.remove(item)

    candidates.append(item)

    return candidates

    else:

    return None

    # copy from http://norvig.com/spell-correct.html

    def edits1(word):

    n = len(word)

    return set([word[0:i]+word[i+1:] for i in range(n)] +

    [word[0:i]+word[i+1]+word[i]+word[i+2:] for i in range(n-1)] +

    [word[0:i]+c+word[i+1:] for i in range(n) for c in alphabet] +

    [word[0:i]+c+word[i:] for i in range(n+1) for c in alphabet])

    def correct(word):

    candidates1 = found(word, 'aspell -a')

    if not candidates1:

    print "no suggestion"

    return

    candidates2 = edits1(word)

    candidates = [] for word in candidates1:

    if word in candidates2:

    candidates.append(word)

    if not candidates:

    print "suggestion: %s" % candidates1[0] else:

    print "suggestion: %s" % max(candidates)

    def signal_handler(signal, frame):

    sys.exit(0)

    if __name__ == '__main__':

    signal.signal(signal.SIGINT, signal_handler)

    while True:

    input = raw_input()

    correct(input)

    方法二:

    当然直接在程序里调用相关模块最简单了,有个叫做 PyEnchant 的库支持拼写检查,安装 PyEnchant 和 Enchant 后就可以直接在 Python 程序里 import 了:

    1

    2

    3

    4

    5

    6

    7

    8

    9

    >>> import enchant

    >>> d = enchant.Dict("en_US")

    >>> d.check("Hello")

    True

    >>> d.check("Helo")

    False

    >>> d.suggest("Helo")

    ['He lo', 'He-lo', 'Hello', 'Helot', 'Help', 'Halo', 'Hell', 'Held', 'Helm', 'Hero', "He'll"]

    >>>

    更多Python知识请关注Python视频教程栏目。

    专题推荐:python
    上一篇:python为什么不适合web开发 下一篇:python判断是否完数

    相关文章推荐

    • python怎么去掉“\n”• python如何去除字符串中不可见字符(\x00)• python怎么把list变成array• 开发网站用php还是python

    全部评论我要评论

    © 2021 Python学习网 苏ICP备2021003149号-1

  • 取消发布评论
  • 

    Python学习网