python - 如何在 Python 中使用 PorterStemmer 提取 csv 文件？

Question

我最近正在使用 python 在 nlp 中做项目。我需要预处理一个 csv 文件，该文件包含具有许多行和列的文本。我只能停止简单的句子。并且无法一次阻止整个 csv 文件。我怎样才能做到这一点？？在尝试阻止简单的 csv 文件时出现错误

import csv
from nltk import PorterStemmer
port = PorterStemmer()

with open('status.csv', 'rb') as f:
    reader = csv.reader(f)
    for row in reader:
        print(port.stem(row))

错误是

Answer 1

因此，您必须执行几个步骤。

#Part 1
>>> import nltk
>>> from nltk import PorterStemmer
>>> test = 'this sentence is just a tester set of words'
>>> test_tokenize = nltk.word_tokenize(test)
>>> test_tokenize
['this', 'sentence', 'is', 'just', 'a', 'tester', 'set', 'of', 'words']
>>> port = PorterStemmer()
>>> for word in test_tokenize:
...     print port.stem(word)
... 
thi
sentenc
is
just
a
tester
set
of
word

#Part 2
with open('status.csv', 'rb') as f: 
    reader = csv.reader(f)
    for row in reader:
       #reference the column where the text is located
       #text = row[column_index_for_text]
       #then just complete the steps in part 1 to get the stemmed words