当使用多个gpu模型和分层。可训练=Tru

2024-04-27 01:01:07 发布

您现在位置:Python中文网/ 问答频道 /正文

我加载了VGG16预训练模型,添加了两个密集层,并对基础VGG16的最后5个层进行了微调。我正在用多个gpu训练我的模型。我在训练前后都保存了模型。重量是一样的,但有分层。可训练=正确。在

请帮忙!在

这是密码

    from keras import applications
    from keras import Model
    <import other relevant Keras layers, etc.>


    model = applications.VGG16(weights = "imagenet", include_top = False, input_shape = (224,224,3))

    model.save('./before_training')

    for layer in model.layers:
        layer.trainable = False

    for layer in model.layers[-5:]:
        layer.trainable = True

     x = model.output
     x = Flatten()(x)
     x = Dense(1024, activation = "relu")(x)
     x = Dropout(0.5)(x)
     x = Dense(1024, activation = "relu")(x)
     predictions = Dense(2, activation = "softmax")(x)
     model_final = Model(input = model.input, output = predictions)


     from keras.utils import multi_gpu_model
     parallel_model = multi_gpu_model(model_final, gpus = 4)
     parallel_model.compile(loss = "categorical_crossentropy" ..... )


     datagen = ImageDataGenerator(....)


     early = EarlyStopping(...)

     train_generator = datagen.flow_from_directory(train_data_dir,...)
     validation_generator = datagen.flow_from_directory(test_data_dir,...)

     parallel_model.fit_generator(train_generator, validation_data = valiudation_generator,...)

     model_final.save('./after_training)

训练前和训练后的重量是一样的!!!这不是我所期望的!在


Tags: from模型importlayerinputmodelgpuparallel