AttributeError:模块“transformers.modeling_bert”没有属性“gelu”

Question

import pandas as pd
from ast import literal_eval

from cdqa.utils.filters import filter_paragraphs
from cdqa.utils.download import download_model, download_bnpp_data
from cdqa.pipeline.cdqa_sklearn import QAPipeline

# Download data and models
download_bnpp_data(dir='./data/bnpp_newsroom_v1.1/')
download_model(model='bert-squad_1.1', dir='./models')

# Loading data and filtering / preprocessing the documents
df = pd.read_csv('data/bnpp_newsroom_v1.1/bnpp_newsroom-v1.1.csv', converters={'paragraphs': literal_eval})
df = filter_paragraphs(df)

# Loading QAPipeline with CPU version of BERT Reader pretrained on SQuAD 1.1
cdqa_pipeline = QAPipeline(reader='C:/models/bert_qa.joblib')

# Fitting the retriever to the list of documents in the dataframe
cdqa_pipeline.fit_retriever(X=df)

我试图加载模型，但cdqa_pipeline=qappeline（reader='C:/models/bert_qa.joblib'）行抛出一个错误，称AttributeError:module'transformers.modeling_bert'没有属性'gelu'

我用的是变形金刚3.5版

Answer 1

我最终使用了不同的版本。问题是我对这个版本有一个要求，所以我也改变了我程序的其他部分