具有耗时任务的Python子进程超时

2024-04-25 09:04:28 发布

您现在位置:Python中文网/ 问答频道 /正文

下面的代码允许在超时的情况下运行子进程

p = subprocess.Popen([...])
while timeConsumedSoFar < timeoutLimit
    if proc.poll() is not None:
        doSomething
    else:
        time.sleep(2)
os.kill([...])

它与常规的linux命令一起工作。但有些命令很耗时,比如“切碎”

^{pr2}$

分解逻辑卷可能需要20分钟以上。有没有更好的方法来处理这个问题?在


Tags: 代码命令noneif进程isnot情况
1条回答
网友
1楼 · 发布于 2024-04-25 09:04:28

看起来好像子进程处理等待的中断,所以我不能使用它。在

下面是一个(可能是有缺陷的)示例,它是更传统的unix方法。 注意这不会产生任何来自stdout的输出!事实上,它根本不产生任何产出。在

因为所有的评论,它看起来不仅仅是它的样子。在

为什么你会认为这是更好的,因为我们没有持续的投票过程。相反,如果命令完成,我们会告诉内核在指定的超时之后返回给我们。在这两种情况下,响应在事件发生后的延迟时间不会超过几微秒,而且代码只需要设置第一个初始轮询。在

#!/usr/bin/python

def runwait(timeout, *args):
  from os import fork, execvp, waitpid, kill, dup2
  from signal import alarm, signal, SIGTERM, SIGALRM, SIG_DFL
  from errno import EINTR

  ## We dont do much in the alarm handler, we only care that we interrupted
  ## the wait() on the process.
  def onalarm(sig, frame):
    pass

  ## This is used for redirecting stdin/out/err to /dev/null
  devnull = open('/dev/null', 'r+')
  pid = fork()
  if not pid:
    ## The child process. Begin by redirecting all input and output.
    dup2(devnull.fileno(), 0)
    dup2(devnull.fileno(), 1)
    dup2(devnull.fileno(), 2)
    ## Probably not a great idea to pass this file descriptor to whatever we 
    ## end up executing.
    devnull.close()

    ## Overwrite child process with new execution context.
    execvp(args[0], args)
    ## If something failed (like command not found) exit 63. WARNING, because we
    ## redirected all output to /dev/null, you WILL NOT be informed the command was
    ## not found directly. Use the exit code to work that out.
    sys.exit(63)

  ## This is the parent process that initiated the fork.
  ## Arm a timer using timeout given by first parameter of function. This
  ## must be an int, not a float. I dont bother checking though cause I'm lazy.    
  signal(SIGALRM, onalarm)
  alarm(timeout)

  ## We wait on the pid, this call typically blocks forever.
  try:
    pid, rc = waitpid(pid, 0)
  except OSError as e:
    ## We will land here if the alarm triggered BEFORE the process completed!
    ## In this case, if we were interrupted to deal with the 
    ## signal handler its definitely an alarm. Otherwise
    ## a peripheral exception occurred (permissions for example) so just re-raise the exception.
    if e.errno == EINTR:
      ## We send a TERM signal to terminate the process and re-wait. This causes
      ## wait to (under normal conditions) come back immediately with the signal 
      ## we just killed it with which parse out further down.
      kill(pid, SIGTERM)
      pid, rc = waitpid(pid, 0)
    else:
      raise

  ## Waits status is a 16bit integer packing a 8bit signal and 8bit return code.
  ## Do some funky bitwise operations to separate the two..
  sig = rc & 0xff
  rc >>= 8
  ## Whatever happened above, always disable the alarm and signal handling.
  alarm(0)
  signal(SIGALRM, SIG_DFL)
  return sig, rc


if __name__ == "__main__":
  # An example when you time out
  print runwait(2, "sleep", "20")
  # An example on success
  print runwait(5, "sleep", "3")
  # More success, but demonstrating no output
  print runwait(5, "grep", "root", "/etc/passwd")

函数返回终止进程的信号号(如果有)和执行程序的返回代码。在

相关问题 更多 >