3

有一个文件：

NAME,ANDREW,AGE 20, BD 1979
NAT ENGLISH
OCC LONDON
INC 200$
NAME,SVEN,AGE 20, BD 1979
NAT SWEDISH
OCC FALUN
INC 100$
NAME,HANS,AGE 30, BD 1988
NAT GERMAN
OCC BERLIN
NOTE, HANDSOME ONE
NAME,LUDOVIC,AGE 40, BD 1955
NAT FRENCH
OCC BORDEAUX
INC 5000$
INTERESTS, FISHING
NAME,PETER
NAT DUTCH
SUMMARY,AGE:20,BD:1979,NAT:DUTCH,OCC:TILBURG,INC:1000$

我尝试将其拆分为块，其中每个块都以“NAME”单词开头，并且在下一个“NAME”之前包含未知数量的行，当然最后一个块在文件末尾结束。例如，我想存储在列表列表中的块，至少这是我的第一次尝试。一般来说，我需要稍后单独迭代每个块，因此存储方法是为以后的目标服务。

我迄今为止的代码如下所示：

start = 'NAME,'
end = 'NAME,'
flag_append = False
my_list = []

for line in open('sample_csv.csv').readlines():
    if line.startswith(start):
        data = line[len(start):]
        flag_append = True
        my_list.append(data)
    elif flag_append:
        temp = []
        temp.append(line)
        my_list.append(temp)
    elif line.startswith(end):
        flag_append = False
        break

print my_list

但这还不是我想要的。

我想要的输出是：

[['ANDREW,AGE 20, BD 1979\n','NAT ENGLISH\n','OCC LONDON\n', 'INC 200$\n'],['SVEN,AGE 20, BD 1979\n','NAT SWEDISH\n','OCC FALUN\n','INC 100$\n'],['HANS,AGE 30, BD 1988\n', 'NAT GERMAN\n', 'OCC BERLIN\n', 'NOTE, HANDSOME ONE\n'], ['LUDOVIC,AGE 40, BD 1955\n', 'NAT FRENCH\n', 'OCC BORDEAUX\n', 'INC 5000$\n', 'INTERESTS, FISHING\n'], ['PETER\n', 'NAT DUTCH\n', 'SUMMARY,AGE:20,BD:1979,NAT:DUTCH,OCC:TILBURG,INC:1000$']]

或示意性地：

[[chunk],[chunk],[chunk],[chunk]]

提前致谢。

编辑 26.10.2012

谢谢大家非常有帮助的答案。我选择了 Kzhi 的答案，因为他的解决方案没有省略 split 关键字。对不起，我没有在我的问题中提到这个要求，你的答案依赖于我笨拙的代码，结果中省略了关键字。干杯!

4

6 回答 6

4

我认为这将是一个优雅的解决方案：

token = 'foo'
chunks = []
current_chunk = []

for line in open('sample_csv.csv'):
   if line.startswith(token) and current_chunk: 
      # if line starts with token and the current chunk is not empty
      chunks.append(current_chunk[:]) #  add not empty chunk to chunks
      current_chunk = [] #  make current chunk blank
   # just append a line to the current chunk on each iteration
   current_chunk.append(line)

chunks.append(current_chunk)  #  append the last chunk outside the loop

所以有内容的文件：

foo
asdf
asdf
foo
foo
asdf
asdf
fooo

你会得到这个结果：

[
    ['foo\n', 'asdf\n', 'asdf\n'], 
    ['foo\n'], 
    ['foo\n', 'asdf\n', 'asdf\n'], 
    ['fooo\n']
]
于 2013-10-24T20:35:48.167 回答
1

这个可以解决问题：

in_string = """NAME,ANDREW,AGE 20, BD 1979
NAT ENGLISH
OCC LONDON
INC 200$
NAME,SVEN,AGE 20, BD 1979
NAT SWEDISH
OCC FALUN
INC 100$
NAME,HANS,AGE 30, BD 1988
NAT GERMAN
OCC BERLIN
NOTE, HANDSOME ONE
NAME,LUDOVIC,AGE 40, BD 1955
NAT FRENCH
OCC BORDEAUX
INC 5000$
INTERESTS, FISHING
NAME,PETER
NAT DUTCH
SUMMARY,AGE:20,BD:1979,NAT:DUTCH,OCC:TILBURG,INC:1000$"""

out_list = []
for chunk in in_string.split('NAME,'):
    out_list.append(chunk.splitlines())
print out_list
于 2013-10-24T20:24:14.713 回答
1 
content = open('sample_csv.csv').read()
res = filter(None, [filter(None, i.split('\n')) for i in content.split('NAME,')])

[['ANDREW，20 岁，BD 1979'，'NAT ENGLISH'，'OCC LONDON'，'INC 200$']，['SVEN，AGE 20，BD 1979'，'NAT SWEDISH'，'OCC FALUN'， 'INC 100$'], ['HANS,AGE 30, BD 1988', 'NAT GERMAN', 'OCC BERLIN', 'NOTE, HANDSOME ONE'], ['LUDOVIC,AGE 40, BD 1955', 'NAT FRENCH ', 'OCC 波尔多', 'INC 5000$', '兴趣, 钓鱼'], ['彼得', 'NAT DUTCH', '摘要,年龄:20,BD:1979,NAT:DUTCH,OCC:TILBURG,INC :1000$']]

于 2013-10-24T20:27:07.293 回答
1

使用您的示例文件内容，我能够生成：

In [259]: %paste
def chunkify(infilepath):
  with open(infilepath) as infile:
    answer = []
    tinfile = iter(infile)
    while 1:
      try:
        chunk = [next(tinfile)]
        chunk.extend(itertools.takewhile(lambda line: not line.startswith("NAME"), tinfile))
        answer.append(chunk)
      except StopIteration:
        break
  return answer

## -- End pasted text --

In [260]: chunkify('blah')
Out[260]: 
[['NAME,ANDREW,AGE 20, BD 1979\n',
  'NAT ENGLISH\n',
  'OCC LONDON\n',
  'INC 200$\n'],
 ['NAT SWEDISH\n', 'OCC FALUN\n', 'INC 100$\n'],
 ['NAT GERMAN\n', 'OCC BERLIN\n', 'NOTE, HANDSOME ONE\n'],
 ['NAT FRENCH\n', 'OCC BORDEAUX\n', 'INC 5000$\n', 'INTERESTS, FISHING\n'],
 ['NAT DUTCH\n', 'SUMMARY,AGE:20,BD:1979,NAT:DUTCH,OCC:TILBURG,INC:1000$\n']]
于 2013-10-24T20:27:16.250 回答
1

您可以从以下代码开始：

>>> """NAME,ANDREW,AGE 20, BD 1979
... NAT ENGLISH
... OCC LONDON
... INC 200$
... NAME,SVEN,AGE 20, BD 1979
... NAT SWEDISH
... OCC FALUN
... INC 100$
... NAME,HANS,AGE 30, BD 1988
... NAT GERMAN
... OCC BERLIN
... NOTE, HANDSOME ONE
... NAME,LUDOVIC,AGE 40, BD 1955
... NAT FRENCH
... OCC BORDEAUX
... INC 5000$
... INTERESTS, FISHING
... NAME,PETER
... NAT DUTCH
... SUMMARY,AGE:20,BD:1979,NAT:DUTCH,OCC:TILBURG,INC:1000$""".split('NAME,')
['', 'ANDREW,AGE 20, BD 1979\nNAT ENGLISH\nOCC LONDON\nINC 200$\n', 'SVEN,AGE 20, BD 1979\nNAT SWEDISH\nOCC FALUN\nINC 100$\n', 'HANS,AGE 30, BD 1988\nNAT GERMAN\nOCC BERLIN\nNOTE, HANDSOME ONE\n', 'LUDOVIC,AGE 40, BD 1955\nNAT FRENCH\nOCC BORDEAUX\nINC 5000$\nINTERESTS, FISHING\n', 'PETER\nNATDUTCH\nSUMMARY,AGE:20,BD:1979,NAT:DUTCH,OCC:TILBURG,INC:1000$']

您还可以使用filter函数过滤掉 '' 值和列表理解，以使每个项目成为列表而不是字符串。

于 2013-10-24T20:16:16.850 回答
1

尝试这个：

token = 'NAME,'

my_list = []
data = []

for line in open('test.csv').readlines():
    if line.startswith(token):
        if len(data) > 0:
            my_list.append(data)
        data = [line[len(token):]]
    else:
        data.append(line)


if len(data) > 0:
    my_list.append(data)

print my_list
于 2013-10-24T20:19:45.983 回答