为什么Tornado的ioloop和httpserver性能不同?

1 投票
1 回答
1034 浏览
提问于 2025-04-16 23:59

我决定用Python Tornado作为我创业公司的服务器选择,并且我用httpref对两个参考的Python Tornado实现进行了压力测试,以测试Tornado的能力。以下是我用来相互比较的两段代码:

iostream:

import errno
import functools
import socket
from tornado import ioloop, iostream

def connection_ready(sock, fd, events):
    while True:
        try:
            connection, address = sock.accept()
        except socket.error, e:
            if e[0] not in (errno.EWOULDBLOCK, errno.EAGAIN):
                raise
            return
        connection.setblocking(0)
        stream = iostream.IOStream(connection)
        message = "You requested %s\n" % "hi"
        stream.write("HTTP/1.1 200 OK\r\nContent-Length: %d\r\n\r\n%s" % (len(message), message), stream.close)


sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM, 0)
sock.setsockopt(socket.SOL_SOCKET, socket.SO_REUSEADDR, 1)
sock.setblocking(0)
sock.bind(("", 8011))
sock.listen(5000)

io_loop = ioloop.IOLoop.instance()
callback = functools.partial(connection_ready, sock)
io_loop.add_handler(sock.fileno(), callback, io_loop.READ)
try:
    io_loop.start()
except KeyboardInterrupt:
    io_loop.stop()
    print "exited cleanly"

HTTPServer:

from tornado import httpserver
from tornado import ioloop

def handle_request(request):
    message = "You requested %s\n" % "hi"
    request.write("HTTP/1.1 200 OK\r\nContent-Length: %d\r\n\r\n%s" % (len(message), message))
    request.finish()


http_server = httpserver.HTTPServer(handle_request)
http_server.bind(8012)
http_server.start(0)

try:
    ioloop=ioloop.IOLoop.instance()
    ioloop.start()
except KeyboardInterrupt:
    ioloop.stop()

(注意:第一个实现来自于http://nichol.as/asynchronous-servers-in-python

我对从httperf --server=localhost --port=8011 --rate=4000 --num-conns=80000得到的结果感到担忧:

iostream:

Reply rate [replies/s]: min 3852.3 avg 3973.1 max 4094.5 stddev 112.3 (4 samples)
Reply time [ms]: response 12.2 transfer 0.0
[...]
Errors: total 499 client-timo 0 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 499 addrunavail 0 ftab-full 0 other 0

HTTPServer:

Reply rate [replies/s]: min 0.0 avg 1280.7 max 2138.5 stddev 962.8 (4 samples)
Reply time [ms]: response 334.6 transfer 0.0
[...]
Errors: total 51697 client-timo 0 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 47569 addrunavail 0 ftab-full 0 other 4128

有没有人能解释一下为什么iostream的表现比httpserver好这么多呢?提前谢谢大家!

1 个回答

1

错误:fd-unavail 47569

这意味着你的电脑没有可用的文件描述符了。

你的 httperf 运行失败了。

撰写回答