我正在尝试制作一个 python 脚本来查找 USB 闪存驱动器中的重复文件。
我正在关注的过程是创建一个文件名列表,对每个文件进行哈希处理,然后创建一个逆字典。但是在过程中的某个地方我得到了一个UnicodeDecodeError
. 有人可以帮我理解发生了什么吗?
from os import listdir
from os.path import isfile, join
from collections import defaultdict
import hashlib
my_path = r"F:/"
files_in_dir = [ file for file in listdir(my_path) if isfile(join(my_path, file)) ]
file_hashes = dict()
for file in files_in_dir:
file_hashes[file] = hashlib.md5(open(join(my_path, file), 'r').read()).digest()
inverse_dict = defaultdict(list)
for file, file_hash in file_hashes.iteritems():
inverse_dict[file_hash].append(file)
inverse_dict.items()
我面临的错误是:
Traceback (most recent call last):
File "C:\Users\Fotis\Desktop\check_dup.py", line 12, in <module>
file_hashes[file] = hashlib.md5(open(join(my_path, file), 'r').read()).digest()
File "C:\Python33\lib\encodings\cp1253.py", line 23, in decode
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0xff in position 2227: character maps to <undefined>