77

我有几个看起来像这样的CSV文件:

Input
Name        Code
blackberry  1
wineberry   2
rasberry    1
blueberry   1
mulberry    2

我想向所有 CSV 文件添加一个新列,使其如下所示:

Output
Name        Code    Berry
blackberry  1   blackberry
wineberry   2   wineberry
rasberry    1   rasberry
blueberry   1   blueberry
mulberry    2   mulberry

我到目前为止的脚本是这样的:

import csv
with open(input.csv,'r') as csvinput:
    with open(output.csv, 'w') as csvoutput:
        writer = csv.writer(csvoutput)
        for row in csv.reader(csvinput):
            writer.writerow(row+['Berry'])

(Python 3.2)

但在输出中,脚本跳过每一行,新列中只有 Berry:

Output
Name        Code    Berry
blackberry  1   Berry

wineberry   2   Berry

rasberry    1   Berry

blueberry   1   Berry

mulberry    2   Berry
4

10 回答 10

101

这应该让您知道该怎么做:

>>> v = open('C:/test/test.csv')
>>> r = csv.reader(v)
>>> row0 = r.next()
>>> row0.append('berry')
>>> print row0
['Name', 'Code', 'berry']
>>> for item in r:
...     item.append(item[0])
...     print item
...     
['blackberry', '1', 'blackberry']
['wineberry', '2', 'wineberry']
['rasberry', '1', 'rasberry']
['blueberry', '1', 'blueberry']
['mulberry', '2', 'mulberry']
>>> 

编辑,请注意在 py3k 中您必须使用next(r)

感谢您接受答案。在这里你有一个奖金(你的工作脚本):

import csv

with open('C:/test/test.csv','r') as csvinput:
    with open('C:/test/output.csv', 'w') as csvoutput:
        writer = csv.writer(csvoutput, lineterminator='\n')
        reader = csv.reader(csvinput)

        all = []
        row = next(reader)
        row.append('Berry')
        all.append(row)

        for row in reader:
            row.append(row[0])
            all.append(row)

        writer.writerows(all)

请注意

  1. 中的lineterminator参数csv.writer。默认情况下,它设置为'\r\n',这就是为什么你有双倍间距。
  2. 使用列表附加所有行并使用writerows. 如果您的文件非常非常大,这可能不是一个好主意(RAM),但对于普通文件,我认为它更快,因为 I/O 更少。
  3. 正如这篇文章的评论中所指出的,请注意with,您可以在同一行中进行嵌套,而不是嵌套这两个语句:

    使用 open('C:/test/test.csv','r') 作为 csvinput,open('C:/test/output.csv', 'w') 作为 csvoutput:

于 2012-06-17T10:32:50.047 回答
74

我很惊讶没有人推荐熊猫。尽管使用像 Pandas 这样的一组依赖项可能看起来比完成如此简单的任务所必需的更加笨拙,但它会生成一个非常短的脚本,而且 Pandas 是一个很棒的库,用于执行各种 CSV(以及实际上所有数据类型)数据操作. 不能与 4 行代码争论:

import pandas as pd
csv_input = pd.read_csv('input.csv')
csv_input['Berries'] = csv_input['Name']
csv_input.to_csv('output.csv', index=False)

查看熊猫网站了解更多信息!

内容output.csv

Name,Code,Berries
blackberry,1,blackberry
wineberry,2,wineberry
rasberry,1,rasberry
blueberry,1,blueberry
mulberry,2,mulberry
于 2015-12-27T23:26:00.420 回答
15
import csv
with open('input.csv','r') as csvinput:
    with open('output.csv', 'w') as csvoutput:
        writer = csv.writer(csvoutput)

        for row in csv.reader(csvinput):
            if row[0] == "Name":
                writer.writerow(row+["Berry"])
            else:
                writer.writerow(row+[row[0]])

也许这样的事情是你想要的?

此外,csv 代表逗号分隔值。所以,你有点需要逗号来分隔你的价值观,我认为:

Name,Code
blackberry,1
wineberry,2
rasberry,1
blueberry,1
mulberry,2
于 2012-06-17T10:25:11.727 回答
7

我使用了 pandas,它运行良好......当我使用它时,我必须打开一个文件并向其中添加一些随机列,然后只保存回同一个文件。

此代码添加了多个列条目,您可以根据需要进行编辑。

import pandas as pd

csv_input = pd.read_csv('testcase.csv')         #reading my csv file
csv_input['Phone1'] = csv_input['Name']         #this would also copy the cell value 
csv_input['Phone2'] = csv_input['Name']
csv_input['Phone3'] = csv_input['Name']
csv_input['Phone4'] = csv_input['Name']
csv_input['Phone5'] = csv_input['Name']
csv_input['Country'] = csv_input['Name']
csv_input['Website'] = csv_input['Name']
csv_input.to_csv('testcase.csv', index=False)   #this writes back to your file

如果您希望该单元格值不被复制,那么首先在您的 csv 文件中手动创建一个空列,就像您将其命名为Hours一样 ,现在您可以在上面的代码中添加这一行,

csv_input['New Value'] = csv_input['Hours']

或者简单地说,我们可以,不添加手动列,我们可以

csv_input['New Value'] = ''    #simple and easy

我希望它有帮助。

于 2017-09-12T05:53:52.220 回答
6

是的,这是一个老问题,但它可能对一些人有所帮助

import csv
import uuid

# read and write csv files
with open('in_file','r') as r_csvfile:
    with open('out_file','w',newline='') as w_csvfile:

        dict_reader = csv.DictReader(r_csvfile,delimiter='|')
        #add new column with existing
        fieldnames = dict_reader.fieldnames + ['ADDITIONAL_COLUMN']
        writer_csv = csv.DictWriter(w_csvfile,fieldnames,delimiter='|')
        writer_csv.writeheader()


        for row in dict_reader:
            row['ADDITIONAL_COLUMN'] = str(uuid.uuid4().int >> 64) [0:6]
            writer_csv.writerow(row)
于 2019-02-06T07:50:23.533 回答
2

我看不到你在哪里添加新列,但试试这个:

    import csv
    i = 0
    Berry = open("newcolumn.csv","r").readlines()
    with open(input.csv,'r') as csvinput:
        with open(output.csv, 'w') as csvoutput:
            writer = csv.writer(csvoutput)
            for row in csv.reader(csvinput):
                writer.writerow(row+","+Berry[i])
                i++
于 2012-06-17T10:36:24.570 回答
2

此代码将满足您的要求,我已经在示例代码上进行了测试。

import csv

with open(in_path, 'r') as f_in, open(out_path, 'w') as f_out:
    csv_reader = csv.reader(f_in, delimiter=';')
    writer = csv.writer(f_out)

    for row in csv_reader:
    writer.writerow(row + [row[0]]
于 2018-04-19T04:36:08.693 回答
2

如果文件很大,您可以使用允许读取每个块的数据集pandas.read_csv的参数:chunksize

import pandas as pd

INPUT_CSV = "input.csv"
OUTPUT_CSV = "output.csv"
CHUNKSIZE = 1_000 # Maximum number of rows in memory

header = True
mode = "w"
for chunk_df in pd.read_csv(INPUT_CSV, chunksize=CHUNKSIZE):
    chunk_df["Berry"] = chunk_df["Name"]
    # You apply any other transformation to the chunk
    # ...
    chunk_df.to_csv(OUTPUT_CSV, header=header, mode=mode)
    header = False # Do not save the header for the other chunks
    mode = "a" # 'a' stands for append mode, all the other chunks will be appended

如果要就地更新文件,可以使用临时文件,最后擦除

import pandas as pd

INPUT_CSV = "input.csv"
TMP_CSV = "tmp.csv"
CHUNKSIZE = 1_000 # Maximum number of rows in memory

header = True
mode = "w"
for chunk_df in pd.read_csv(INPUT_CSV, chunksize=CHUNKSIZE):
    chunk_df["Berry"] = chunk_df["Name"]
    # You apply any other transformation to the chunk
    # ...
    chunk_df.to_csv(TMP_CSV, header=header, mode=mode)
    header = False # Do not save the header for the other chunks
    mode = "a" # 'a' stands for append mode, all the other chunks will be appended

os.replace(TMP_CSV, INPUT_CSV)
于 2020-09-02T18:49:09.443 回答
1

使用没有标题名称的python在现有csv文件中追加新列

  default_text = 'Some Text'
# Open the input_file in read mode and output_file in write mode
    with open('problem-one-answer.csv', 'r') as read_obj, \
    open('output_1.csv', 'w', newline='') as write_obj:
# Create a csv.reader object from the input file object
    csv_reader = reader(read_obj)
# Create a csv.writer object from the output file object
    csv_writer = csv.writer(write_obj)
# Read each row of the input csv file as list
    for row in csv_reader:
# Append the default text in the row / list
        row.append(default_text)
# Add the updated row / list to the output file
        csv_writer.writerow(row)

谢谢

于 2020-07-24T11:31:51.553 回答
1

对于向现有 CSV 文件(带有标题)添加新列,如果要添加的列具有足够少的值,这里有一个方便的功能(有点类似于 @joaquin 的解决方案)。该函数采用

  1. 现有 CSV 文件名
  2. 输出 CSV 文件名(将包含更新的内容)和
  3. 带有标题名称和列值的列表
def add_col_to_csv(csvfile,fileout,new_list):
    with open(csvfile, 'r') as read_f, \
        open(fileout, 'w', newline='') as write_f:
        csv_reader = csv.reader(read_f)
        csv_writer = csv.writer(write_f)
        i = 0
        for row in csv_reader:
            row.append(new_list[i])
            csv_writer.writerow(row)
            i += 1 

例子:

new_list1 = ['test_hdr',4,4,5,5,9,9,9]
add_col_to_csv('exists.csv','new-output.csv',new_list1)

现有的 CSV 文件: 在此处输入图像描述

输出(更新)CSV 文件: 在此处输入图像描述

于 2020-11-05T20:59:47.863 回答