从拥抱面模型加载权重时出错

2024-05-20 00:55:50 发布

您现在位置:Python中文网/ 问答频道 /正文

我使用的是变形金刚,我已经加载了一个模型,效果很好:

from transformers import AutoModelForSequenceClassification
from transformers import AutoTokenizer

task='sentiment'
MODEL = "cardiffnlp/twitter-roberta-base-{task}"
tokenizer = AutoTokenizer.from_pretrained(MODEL)

# PT
model = AutoModelForSequenceClassification.from_pretrained(MODEL) 
model.save_pretrained(MODEL)

但如果我尝试加载另一个任务,如“情感”或“仇恨”,我会得到以下错误:

from transformers import AutoModelForSequenceClassification
from transformers import AutoTokenizer

task='emotion'
MODEL = "cardiffnlp/twitter-roberta-base-{task}"
tokenizer = AutoTokenizer.from_pretrained(MODEL)

# PT
model = AutoModelForSequenceClassification.from_pretrained(MODEL)  ## Here I get the error
model.save_pretrained(MODEL)

此错误:

OSError: Can't load weights for 'cardiffnlp/twitter-roberta-base-emotion'. Make sure that:

- 'cardiffnlp/twitter-roberta-base-emotion' is a correct model identifier listed on 'https://huggingface.co/models'

- or 'cardiffnlp/twitter-roberta-base-emotion' is the correct path to a directory containing a file named one of pytorch_model.bin, tf_model.h5, model.ckpt.

我已经检查过了,这些模型实际上是拥抱脸部模型,正如你所看到的here,所以我不明白为什么它不工作

编辑:我注意到,第一次运行它时,它可以处理所有任务(仇恨、情绪、情绪),但如果我再次尝试运行它,则会出现错误


Tags: from模型importtaskbasemodeltwitteremotion
1条回答
网友
1楼 · 发布于 2024-05-20 00:55:50
# PT
model = AutoModelForSequenceClassification.from_pretrained(MODEL) 
model.save_pretrained(MODEL)
tokenizer.save_pretrained(MODEL)

将第三行添加到此部分,重命名或删除已有的模型文件夹,然后重试。这一次,它确实应该不止一次起作用。我希望这能让你开心起来

相关问题 更多 >