在keras中实现的前向层
keras-position-wise-feed-forward的Python项目详细描述
路缘石位置前馈
论文中位置前馈层的实现:Attention is All You Need
安装
pip install keras-position-wise-feed-forward
用法
importkerasfromkeras_position_wise_feed_forwardimportFeedForwardinput_layer=keras.layers.Input(shape=(None,32))feed_forward_layer=FeedForward(units=128)(input_layer)model=keras.models.Model(inputs=input_layer,outputs=feed_forward_layer)model.compile(optimizer='adam',loss='mse')model.summary()