无法在变量的帮助下将数据插入mongodb,但如果我打印输出并将其粘贴到db.collection.insert\u许多(输出)然后代码正常运行并存储数据,但我直接使用db.collection.insert\u许多(输出_final)它给我错误。请帮忙。在
import re
import json
from selenium import webdriver
from bs4 import BeautifulSoup
import requests
from fake_useragent import UserAgent
import pymongo
myclient = pymongo.MongoClient("mongodb://localhost:27017/")
db = myclient["db_db"]
ua = UserAgent()
header = {'user-agent':ua.chrome}
driver = webdriver.Chrome('C:/Users/MUNTAZIR/Downloads/Compressed/chromedriver_win32/chromedriver.exe')
driver.get('https://www.eduvision.edu.pk/scholarships/index.php?authority=1&level=4&field=1&cat=2&type=1')
# tr = driver.find_element_by_id('ctl00_ctl42_g_7f68baae_5353_4bdd_bfe1_b88e3367234f_csr1_table')
soup = BeautifulSoup(driver.page_source, 'lxml')
scholar = soup.findAll("div", {"class": "card-content col-xs-12"})
s_output1 = ""
for s in scholar[0:1]:
title=s.findAll("h2")[0].text
desc = s.findAll("div", {"class": "text"})[0].text.replace("\n", "").replace('"','')
url = "https://www.eduvision.edu.pk/scholarships/" + s.a['href']
type= "Higher Education Commission"
# print(type +"\n" +title +"\n" +desc +"\n" +url +"\n")
s_output1 = ("{""\n"
'"type"' + ":" + '" ' + type + ' ",' + "\n"
'"title"' + ":" + '" ' + title + ' ",' + "\n"
'"url"' + ":" + '" ' + url + ' ",' + "\n"
'"description"' + ":" + '" ' + desc + ' "' + "\n"
"}""\n"
)
s_output2_d = ""
for s in scholar[1:]:
title=s.findAll("h2")[0].text
desc=s.findAll("div",{"class": "text"})[0].text.replace("\n", "").replace('"','')
url = "https://www.eduvision.edu.pk/scholarships/" + s.a['href']
type= "Higher Education Commission"
s_output2 = (",{""\n"
'"type"' + ":" + '" ' + type + ' ",' + "\n"
'"title"' + ":" + '" ' + title + ' ",' + "\n"
'"url"' + ":" + '" ' + url + ' ",' + "\n"
'"description"' + ":" + '" ' + desc + ' "' + "\n"
"}""\n"
)
s_output2_d += s_output2
output_final = ""
output_final += s_output1 + s_output2_d
print(output_final)
db.collection2.insert_many(output_final)
print("saved")
driver.close()
Mongo的insert_many获取实际字典的实际列表,而不是一个字符串,如果“求值”将生成字典列表。所以,这是有效的:
这是无效的:
^{pr2}$编辑:如何使字符串成为一个列表?别乱串,列个单子!例如(未测试):
相关问题 更多 >
编程相关推荐