2

我正在寻找准确率至少为 80% 以上的情绪分析代码。我尝试了 Vader，发现它简单易用，但它的准确率仅为 64%。

现在，我正在查看一些 BERT 模型，我注意到它需要重新训练？那是对的吗？不是预习的吗？是否需要重新培训？

4

2 回答 2

1

您可以使用预训练的模型 HuggingFace。有很多可供选择。搜索emotion或sentiment 模型

这是一个具有 26 种情绪的模型示例。当前的实现有效，但对于大型数据集来说非常慢。

import pandas as pd
from transformers import RobertaTokenizerFast, TFRobertaForSequenceClassification, pipeline

tokenizer = RobertaTokenizerFast.from_pretrained("arpanghoshal/EmoRoBERTa")
model = TFRobertaForSequenceClassification.from_pretrained("arpanghoshal/EmoRoBERTa")


emotion = pipeline('sentiment-analysis', 
                    model='arpanghoshal/EmoRoBERTa')

# example data
DATA_URI = "https://github.com/AFAgarap/ecommerce-reviews-analysis/raw/master/Womens%20Clothing%20E-Commerce%20Reviews.csv"
dataf = pd.read_csv(DATA_URI, usecols=["Review Text",])

# This is super slow, I will find a better optimization ASAP


dataf = (dataf
         .head(50) # comment this out for the whole dataset
         .assign(Emotion = lambda d: (d["Review Text"]
                                       .fillna("")
                                       .map(lambda x: emotion(x)[0].get("label", None))
                                  ),
             
            )
)

我们也可以稍微重构一下

...
# a bit faster than the previous but still slow

def emotion_func(text:str) -> str:
    if not text:
        return None
    return emotion(text)[0].get("label", None)
    



dataf = (dataf
         .head(50) # comment this out for the whole dataset
         .assign(Emotion = lambda d: (d["Review Text"]
                                        .map(emotion_func)
                                     ),

            )
)

结果：

    Review Text Emotion
0   Absolutely wonderful - silky and sexy and comf...   admiration
1   Love this dress! it's sooo pretty. i happene... love
2   I had such high hopes for this dress and reall...   fear
3   I love, love, love this jumpsuit. it's fun, fl...   love
...
6   I aded this in my basket at hte last mintue to...   admiration
7   I ordered this in carbon for store pick up, an...   neutral
8   I love this dress. i usually get an xs but it ...   love
9   I'm 5"5' and 125 lbs. i ordered the s petite t...   love
...
16  Material and color is nice. the leg opening i...    neutral
17  Took a chance on this blouse and so glad i did...   admiration
...
26  I have been waiting for this sweater coat to s...   excitement
27  The colors weren't what i expected either. the...   disapproval
...
31  I never would have given these pants a second ...   love
32  These pants are even better in person. the onl...   disapproval
33  I ordered this 3 months ago, and it finally ca...   disappointment
34  This is such a neat dress. the color is great ...   admiration
35  Wouldn't have given them a second look but tri...   love
36  This is a comfortable skirt that can span seas...   approval
...
40  Pretty and unique. great with jeans or i have ...   admiration
41  This is a beautiful top. it's unique and not s...   admiration
42  This poncho is so cute i love the plaid check ...   love
43  First, this is thermal ,so naturally i didn't ...   love
于 2021-10-27T07:42:19.097 回答
-2

你可以用泡菜。

Pickle 让您.. 很好地腌制您的模型以供以后使用，事实上，您可以使用循环来继续训练模型，直到达到一定的准确性，然后退出循环并腌制模型以供以后使用。

您可以在 youtube 上找到许多关于如何挑选模型的教程。

于 2021-10-21T04:50:36.650 回答