python - 读取 Glove 词嵌入实现的文本语料库中的问题

Question

我正在尝试使用此链接https://github.com/hans/glove.py/blob/master/glove.py中提到的 Glove 实现来训练我的文本语料库。我创建了一个由 a 分隔的单词的文本语料库单个空格。文件大小为 3.6 GB。当我尝试加载文件时出现此错误。

2017-08-09 12:51:47,848 Fetching vocab..
Traceback (most recent call last):
  File "Glove_python_bbc.py", line 378, in <module>
    main(parse_args())
  File "Glove_python_bbc.py", line 347, in main
    vocab = get_or_build(arguments.vocab_path, build_vocab, corpus)
  File "Glove_python_bbc.py", line 83, in get_or_build
    obj = msgpack.load(obj_f, use_list=False, encoding='utf-8')
  File "msgpack\_unpacker.pyx", line 164, in msgpack._unpacker.unpack (msgpack/_unpacker.cpp:2622)
  File "msgpack\_unpacker.pyx", line 143, in msgpack._unpacker.unpackb (msgpack/_unpacker.cpp:2143)
msgpack.exceptions.ExtraData: unpack(b) received extra data.

帮我阅读文件。谢谢