0

上周我用 Jupyter Notebook 运行了这段代码,它运行得相当快。但是,本周我遇到了将 JSON 数据写入文件需要很长时间(超过一个小时)的问题。该代码有效,但我很好奇我编写它的方式是否会导致它运行缓慢?

consumer_key = hidden
consumer_secret = hidden
access_token = hidden
access_secret = hidden

auth = tweepy.OAuthHandler(consumer_key, consumer_secret)
auth.set_access_token(access_token, access_secret)

# set Twitter's rate limit
api = tweepy.API(auth, wait_on_rate_limit = True, wait_on_rate_limit_notify = True)   

# write the querying JSON data into tweet_json.txt
with open('tweet_json.txt','a',encoding = 'utf8') as f:
    for tweet_id in twitter_archive['tweet_id']:
    try:
        tweet = api.get_status(tweet_id, tweet_mode = 'extended') # set mode to extended
        json.dump(tweet._json, f)
        f.write('\n')
    except: 
        print('error')
4

0 回答 0