下面的代码有时会工作,它会将它推送到需要的目录,并且总是复制文件,但是有时leadparser目录中的csv文件中没有数据。你知道吗
import csv
import re
import os
import shutil
class myExporter(object):
def __init__(self):
self.i = 0
self.filename = 'output%s.csv'
self.srcfile = '/Users/poweruser/Applications/pythonwork/bbbscrap2/scrape/' + self.filename
while os.path.exists(self.srcfile % self.i):
self.i += 1
self.folderdes = '/Users/poweruser/Applications/pythonwork/leadparser/newfiles'
self.myCSV = csv.writer(open(self.filename % self.i, 'w'))
self.myCSV.writerow(['Email', 'Website', 'Phone Number', 'Location'])
def process_item(self, item, spider):
self.myCSV.writerow([item['email'],
item['website'],
item['phonenumber'],
item['location']])
self.folderPath = os.path.join(
self.folderdes, os.path.basename(self.srcfile % self.i))
shutil.copy(self.srcfile % self.i, self.folderPath)
return item
必须关闭文件才能写入所有数据:
相关问题 更多 >
编程相关推荐