使用eventlet运行celery时，Fabric出现名称查找失败

Question

我有一个celery任务，目的是在远程机器上用fabric运行一个需要sudo权限的命令：

@app.task(soft_time_limit=600)
def run_puppet_agent(hostname):
    try:
        fabric_client = Fabric(hostname)
        result = fabric_client.run_command('puppet agent -t', True, True)
        if result.return_code == 0 or result.return_code == 2:
                return True, 'Puppet agent run successfully'
        else:
            raise Exception('Command %s run failed with a non zero or non-2 error code, '
                            '0 and 2 are status codes for successful puppet runs, returned     code %s'
                            % ('sudo puppet agent -t', result.return_code))
    except SoftTimeLimitExceeded:
        raise Exception('Puppet agent run took more than 600 seconds')
    except Exception as e:
        #run_puppet_agent.retry(args=[hostname], countdown=20)
        LOG.info('')
        raise Exception('Puppet agent failed with error message %s' % e.message)

如果我这样启动celery工作进程：

celery -A phantom.celery.manage worker --loglevel=info

一切都运行得很好！！但是当我用eventlet来启动工作进程时：

celery -A phantom.celery.manage worker --loglevel=info -P eventlet -c 15

情况就糟糕了，出现了这个错误：

[WARNING/MainProcess] File     "/Users/uruddarraju/Phantom/phantom/tasks/fabric_tasks.py", line 19, in run_puppet_agent
[WARNING/MainProcess] result = fabric_client.run_command('puppet agent -t', True, True)
[WARNING/MainProcess] File "/Users/uruddarraju/Phantom/phantom/util/fabric/fabric_util.py", line 43, in run_command
[WARNING/MainProcess] return sudo(command, quiet=False)
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/network.py", line 639, in host_prompting_wrapper
[WARNING/MainProcess] return func(*args, **kwargs)
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/operations.py", line 1095, in sudo
[stderr=stderr, timeout=timeout, shell_escape=shell_escape,
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/operations.py", line 909, in _run_command
[WARNING/MainProcess] channel=default_channel(), command=wrapped_command, pty=pty,
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/state.py", line 390, in default_channel
[WARNING/MainProcess] chan = _open_session()
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/state.py", line 382, in _open_session
[WARNING/MainProcess] return connections[env.host_string].get_transport().open_session()
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/network.py", line 151, in __getitem__
[WARNING/MainProcess] self.connect(key)
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/network.py", line 143, in connect
[WARNING/MainProcess] self[key] = connect(user, host, port, cache=self)
[WARNING/MainProcess] File "/Library/Python/2.7/site-packages/fabric/network.py", line 533, in connect
[WARNING/MainProcess] raise NetworkError('Name lookup failed for %s' % host, e)
[WARNING/MainProcess] NetworkError: Name lookup failed for <hostname>

警告/主进程] 没有

顺便说一下：我还有其他任务，它们有不同的HTTP API调用，所以我以为eventlet会有帮助，但在这种情况下对我来说并没有奏效。

错误处理任务调度 celery fabric 远程执行 eventlet sudo权限

使用eventlet运行celery时，Fabric出现名称查找失败

1 个回答

撰写回答