在开发服务器上使用Appengine BulkLoader的问题

Question

我正在做一件应该很简单的事情，但总是卡住。我在把一些很简单的csv文件上传到我的开发服务器时，遇到了这个错误：

Error in WorkerThread-0: app "dev~fbdec" cannot access app "fbdec"'s data

具体的输出是：

[INFO    ] Logging to bulkloader-log-20110815.142554
[INFO    ] Throttling transfers:
[INFO    ] Bandwidth: 250000 bytes/second
[INFO    ] HTTP connections: 8/second
[INFO    ] Entities inserted/fetched/modified: 20/second
[INFO    ] Batch Size: 10
[INFO    ] Opening database: bulkloader-progress-20110815.142554.sql3
Please enter login credentials for localhost
Email: a@a.com
Password for a@a.com: 
[INFO    ] Connecting to localhost:8080/remote_api
[INFO    ] Skipping header line.
[INFO    ] Starting import; maximum 10 entities per post
[ERROR   ] [WorkerThread-0] WorkerThread:
Traceback (most recent call last):
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/adaptive_thread_pool.py", line 176, in WorkOnItems
 status, instruction = item.PerformWork(self.__thread_pool)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 764, in PerformWork
transfer_time = self._TransferItem(thread_pool)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 935, in _TransferItem
self.request_manager.PostEntities(self.content)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 1418, in PostEntities
datastore.Put(entities)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore.py", line 467, in Put
return PutAsync(entities, **kwargs).get_result()
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/datastore/datastore_rpc.py", line 658, in get_result
results = self.__rpcs[0].get_result()
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_stub_map.py", line 592, in get_result
return self.__get_result_hook(self)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/datastore/datastore_rpc.py", line 1385, in __put_hook
self.check_rpc_success(rpc)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/datastore/datastore_rpc.py", line 1074, in check_rpc_success
raise _ToDatastoreError(err)
BadRequestError: app "dev~fbdec" cannot access app "fbdec"'s data
[INFO    ] An error occurred. Shutting down...
[ERROR   ] Error in WorkerThread-0: app "dev~fbdec" cannot access app "fbdec"'s data
[INFO    ] 2 entities total, 0 previously transferred
[INFO    ] 0 entities (723 bytes) transferred in 7.9 seconds
[INFO    ] Some entities not successfully transferred

这是我的app.yaml文件：

application: fbdec
version: 1
runtime: python
api_version: 1

handlers:
- url: /static
  static_dir: static

- url: /remote_api
  script: $PYTHON_LIB/google/appengine/ext/remote_api/handler.py
  login: admin

- url: /.*
  script: fbdec.py

这是执行上传的命令：

appcfg.py upload_data --config_file=fbdec/fbuploader.py --filename=cols.csv --kind=Cols --has_header --num_threads=1 --url=http://localhost:8080/remote_api fbdec/

这是上传代码：

import cgi
import datetime
import logging
import os

import datetime
from google.appengine.ext import db
from google.appengine.tools import bulkloader
from os import environ


class Grobs(db.Model):
    coleccion = db.TextProperty()
    objeto= db.TextProperty() 
    descripcion = db.TextProperty()

class GrobLoader(bulkloader.Loader):
    def __init__(self):
        bulkloader.Loader.__init__(self, 'Grobs',
                                   [('coleccion', str),  
                                    ('objeto', str),
                                    ('descripcion', str)
                                   ])

class Cols(db.Model):
    coleccion = db.TextProperty()
    descripcion= db.TextProperty() 

class ColLoader(bulkloader.Loader):
    def __init__(self):
        bulkloader.Loader.__init__(self, 'Cols',
                                   [('coleccion', str),
                                    ('descripcion', str)
                                   ])

loaders = [GrobLoader, ColLoader]

还有这个cols.csv文件：

coleccion,descripcion
gafas,descripcion
sombreros,descripcion

任何帮助都非常欢迎。我搞不清楚我哪里出错了。

我在Mac Osx Leopard上使用Appengine 1.5.2。我尝试了python 2.5.4和2.6.6（以防万一）。

提前感谢，祝好！

Answer 1

我最近也遇到了同样的问题，所以我写了一个脚本来解决这个问题：

APP=$1 #your app name
IN=$2 #the file containing the data to upload
DIR=$3 #the folder containing your app.yaml
appcfg.py upload_data --email=foobar@nowhere.com --passin --application=dev~$APP --filename=$IN --url=http://localhost:8080/_ah/remote_api $DIR -v

Answer 2

在较新的软件开发工具包（SDK）中，使用 --application=dev~your-app 这个选项。

Answer 3

在启动 dev_appserver 时，记得加上 --default_partition="" 这个参数。