我使用txcouchbase从couchbas请求数据

Question

我使用couchbase txcouchbase to operator；我得到一个问题；我的代码如下：

1 import multiprocessing
2 from threading import Thread
3 from couchbase import Couchbase
4 from twisted.internet import reactor
5 import txcouchbase.connection as TxConnection
6 from txcouchbase.connection import Connection as TxCouchbase
7 import couchbase
8 db = None
9 class A:
10     def __init__(self):
11         pass
12 
13     def on_get(self,ret):
14         pass
15 
16 def worker(key):
17     '''
18     l = []
19     for i in range(1000000):
20         l.append(i)
21     '''
22     db = TxCouchbase(bucket = 'zonedb', 
23             host = '192.168.1.30', 
24             timeout = 100, 
25             lockmode = couchbase.connection.LOCKMODE_WAIT)
26     a = A()
27     while 1:
28         for k in key:
29             db.get(k, quiet = True).addCallback(a.on_get)
30 
31 if __name__ == "__main__":
32     TxConnection.experimental.enable()
33     keys = ['kuwo.cn', 'apple.com', \
34             'jslgroup.com', 'zjoldns.com.cn', \
35             'tmall.com', 'kaitao.cn', \
36             'alibaba.com', 'telemetryverification.net', \
37             'qq.com', 'baidu.com', 'pyrc.net', 'xh568.com']
38     p = Thread(target = worker, args = (keys,))
39     p.start()
40     reactor.run() 

网络控制台告诉我couchbase有三千opr/秒

当我拿出笔记的时候

17     '''
18     l = []
19     for i in range(1000000):
20         l.append(i)
21     '''

代码是：

1 import multiprocessing
2 from threading import Thread
3 from couchbase import Couchbase
4 from twisted.internet import reactor
5 import txcouchbase.connection as TxConnection
6 from txcouchbase.connection import Connection as TxCouchbase
7 import couchbase
8 db = None
9 class A:
10     def __init__(self):
11         pass
12 
13     def on_get(self,ret):
14         pass
15 
16 def worker(key):
17 
18     l = []
19     for i in range(1000000):
20         l.append(i)
21
22     db = TxCouchbase(bucket = 'zonedb', 
23             host = '192.168.1.30', 
24             timeout = 100, 
25             lockmode = couchbase.connection.LOCKMODE_WAIT)
26     a = A()
27     while 1:
28         for k in key:
29             db.get(k, quiet = True).addCallback(a.on_get)
30 
31 if __name__ == "__main__":
32     TxConnection.experimental.enable()
33     keys = ['kuwo.cn', 'apple.com', \
34             'jslgroup.com', 'zjoldns.com.cn', \
35             'tmall.com', 'kaitao.cn', \
36             'alibaba.com', 'telemetryverification.net', \
37             'qq.com', 'baidu.com', 'pyrc.net', 'xh568.com']
38     p = Thread(target = worker, args = (keys,))
39     p.start()
40     reactor.run() 

因此代码有一个大的列表变量；couchbase web console me couchbase的opr/秒为零； 为什么会这样；我该怎么做；我感谢这是错误的，但我不知道如何解决它

Answer 1

有几个问题：

• .addCallback()表示您正在从不同的线程调用twisted api。一般来说，twisted api不是线程安全的。你可以use ^{} to run non-thread-safe code in the event loop (main thread) from another thread
• 如果是阻塞的非异步代码（例如，无限循环），那么可以使用reactor.callInThread在不同的线程中运行函数
• 如果您想在循环中调用twisted api，您可以重新构造代码以使用twisted.internet.task.LoopingCall（code example）或twisted.internet.task.Cooperator.coiterate（这里是codeexamples）