如何在TensorFlow中使用分布式DNN培训？

Question

谷歌今天发布了TensorFlow。在

我一直在代码中闲逛，我在代码或API中没有看到任何关于跨GPU服务器集群进行培训的内容。在

它有分布式训练功能吗？在

Answer 1

更新：

• Distributed TensorFlow Documentation

• Distributed TensorFlow Source

该版本于2016年2月26日发布，由合著者Derek Murray在原版本here中宣布，并使用gRPC进行进程间通信。在

上一页：

在上述更新之前，TensorFlow的分布式实现尚未发布。支持分布式实现是this issue的主题，其中合著者Vijay Vasudevan wrote：

we are working on making a distributed implementation available, it's currently not in the initial release

杰夫·迪恩后来提供了an update：

Our current internal distributed extensions are somewhat entangled with Google internal infrastructure, which is why we released the single-machine version first. The code is not yet in GitHub, because it has dependencies on other parts of the Google code base at the moment, most of which have been trimmed, but there are some remaining ones.

We realize that distributed support is really important, and it's one of the top features we're prioritizing at the moment.