0

我正在尝试将值从 json ld 提取到 csv，因为它们在文件中。我面临几个问题。1. 在大多数情况下，为不同字段读取的值会被截断。在其余情况下，其他字段的值出现在其他字段中。2. 在大约 4,000 行之后，我也收到一个错误 - 'Additional data'。该文件很大（半 GB）。我附上了我的代码的缩短版本。请告诉我哪里出错了。

输入文件 - 我已将其缩短并保留在此处。没有办法把它放在这里。

https://github.com/Architsi/json-ld-issue

我尝试编写此脚本，也尝试了多个在线转换器

import csv, sys, math, operator, re, os, json, ijson
from pprint import pprint

filelist = []

for file in os.listdir("."):
    if file.endswith(".json"):
        filelist.append(file)

for input in filelist:

    newCsv = []
    splitlist = input.split(".")
    output = splitlist[0] + '.csv'

    newFile = open(output, 'w', newline='') #wb for windows, else you'll see newlines added to csv

    # initialize csv writer
    writer = csv.writer(newFile)

    #Name of the columns
    header_row = ('Format', 'Description', 'Object', 'DataProvider')

    writer.writerow(header_row)

    with open(input, encoding="utf8") as json_file:

        data = ijson.items(json_file, 'item')

        #passing all the values through try except
        for s in data:

            source = s['_source']

            try:
                source_resource = source['sourceResource']
            except:
                print ("Warning: No source resource in record ID: " + id)

            try:
                data_provider = source['dataProvider'].encode()
            except:
                data_provider = "N/A"

            try:
                _object = source['object'].encode()
            except:
                _object = "N/A"

            try:
                descriptions = source_resource['description']
                string = ""
                for item in descriptions:
                    if len(descriptions) > 1:
                        description = item.encode() #+ " | "
                    else:
                        description = item.encode()
                    string = string + description
                description = string.encode()
            except:
                description = "N/A"


            created = ""
#writing it to csv
            write_tuple = ('format', description, _object, data_provider)

            writer.writerow(write_tuple)

    print ("File written to " + output)
    newFile.close()

我得到的错误是这个- raise common.JSONError('Additional Data') 预期结果是一个包含所有列和正确值的 csv 文件

4

0 回答 0