用python寫腳本時(shí)，遇到處理中文（亂碼的中文）時(shí)，用decode("utf-8")會(huì)發(fā)現(xiàn)始終會(huì)報(bào)錯(cuò)

>>> txt_from = open("/home/love/ex130705.log")

>>> txt_from_iter= iter(txt_from)

>>> txt_proc = txt_from_iter.next().decode("utf-8", "ignore")

Traceback (most recent call last):

File "/tmp/py4049kjX", line 41, in

txt_proc = txt_from_iter.next().decode("utf-8")

File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode

return codecs.utf_8_decode(input, errors, True)

UnicodeDecodeError: "utf8" codec can"t decode bytes in position 84-85: invalid continuation byte

欲處理的原文件中部分顯示為亂碼：

2013-07-05 04:20:10 192.168.1.5 GET /Portals/0/鏁欒偛淇℃伅鏂囦歡澶 校園 80 - 25.XXX.10.99 Mozilla/4.0+(compatible;+MSIE+8.0;+Windows+NT+5.1;+Trident/4.0;+Alexa+Toolbar) 404 0 2 234

2013-07-05 04:20:24 192.168.1.5 GET /Portals/0/鏁欒偛淇℃伅鏂囦歡澶 校園 80 - 25.XXX.10.99 Mozilla/4.0+(compatible;+MSIE+8.0;+Windows+NT+5.1;+Trident/4.0;+Alexa+Toolbar) 404 0 2 296

這些顯示亂碼的中文字符是IIS在記錄日志過程中出現(xiàn)的。python通過decode("utf-8")解碼為UTF-8時(shí)會(huì)拋出異常UnicodeDecodeError。

解決：用 decode("utf-8", "ignore")

>>>

>>> txt_proc = txt_from_iter.next().decode("utf-8", "ignore")

>>>

查看decode的幫助：

help("".decode)

decode(...)

S.decode([encoding[,errors]]) -> object

Decodes S using the codec registered for encoding. encoding defaults

to the default encoding. errors may be given to set a different error

handling scheme. Default is "strict" meaning that encoding errors raise

a UnicodeDecodeError. Other possible values are "ignore" and "replace"

as well as any other name registered with codecs.register_error that is

able to handle UnicodeDecodeErrors.

總結(jié)

以上是生活随笔為你收集整理的python中文乱码 def decode-python处理一些乱码的中文文本时decode('utf-8')报错的处理...的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。