1

我有一个 python 脚本，给定的模式遍历文件，并且对于与该模式匹配的每一行，它会计算该行在文件中出现的次数。

脚本如下：

#!/usr/bin/env python

import time
fnamein = 'Log.txt'

def filter_and_count_matches(fnamein, fnameout, match):
  fin = open(fnamein, 'r')
  curr_matches = {}
  order_in_file = [] # need this because dict has no particular order
  for line in (l for l in fin if l.find(match) >= 0):
    line = line.strip()
    if line in curr_matches:
      curr_matches[line] += 1
    else:
      curr_matches[line] = 1
      order_in_file.append(line)
  #
  fout = open(fnameout, 'w')
  #for line in order_in_file:
  for line, _dummy in sorted(curr_matches.iteritems(),
      key=lambda (k, v): (v, k), reverse=True):
    fout.write(line + '\n')
    fout.write(' = {}\n'.format(curr_matches[line]))
  fout.close()

def main():
  for idx, match in enumerate(open('staffs.txt', 'r').readlines()):
    curr_time = time.time()
    match = match.strip()
    fnameout = 'm{}.txt'.format(idx+1)
    filter_and_count_matches(fnamein, fnameout, match)
    print 'Processed {}. Time = {}'.format(match, time.time() - curr_time)

main()

所以现在我每次想检查不同的模式时都会检查文件。这样做可以只检查一次文件（文件很大，所以需要一段时间来处理）。如果能够以一种优雅的“简单”方式做到这一点，那就太好了。谢谢！

谢谢

4

1 回答 1

2

看起来像Counter会做你需要的：

from collections import Counter
lines = Counter([line for line in myfile if match_string in line])

例如，如果myfile包含

123abc
abc456
789
123abc
abc456

和match_string是"abc"，那么上面的代码给你

>>> lines
Counter({'123abc': 2, 'abc456': 2})

对于多种模式，这个怎么样：

patterns = ["abc", "123"]
# initialize one Counter for each pattern
results = {pattern:Counter() for pattern in patterns}  
for line in myfile:
   for pattern in patterns:
       if pattern in line:
           results[pattern][line] += 1
于 2013-04-11T15:36:59.400 回答