我想用Dask提取一堆数据
我正在使用
SQLAlchemy==1.3.9
dask==2.5.2
pyodbc==4.0.27
我在与scrips相同的目录中有以下文件:
odbc.ini
odbcinst.ini
我无法正确配置。我已经看到了一堆SQLAlchemy的连接字符串,但是我没有任何一个能够正常工作
此代码适用于:
#!/usr/bin/env python
import pyodbc
import getpass
#odbc is the prefered method for contacting microsoft sqlserver
sql_server_cnxn_str = 'DRIVER={ODBC Driver 17 for SQL Server};' + \
'SERVER=XXXX;DATABASE=YYYY;' + \
'Trusted_Connection=yes;'
#get username
print ("Input username then hit enter: ")
name = input()
#Get password
psswd = getpass.getpass()
#Create connection using odbc
conn = pyodbc.connect(sql_server_cnxn_str)
cursor = conn.cursor()
query = "SELECT * from Foo.Testing"
cursor.execute(query)
data = cursor.fetchall()
print(data)
所以我知道这种联系是有效的
这是我正在努力工作的代码:
#!/usr/bin/env python
import pyodbc
import getpass
import dask.dataframe as dd
from dask.diagnostics import ProgressBar
#odbc is the prefered method for contacting microsoft sqlserver
sql_server_cnxn_str = 'DRIVER={ODBC Driver 17 for SQL Server};' + \
'SERVER=XXXX;DATABASE=YYYY;' + \
'Trusted_Connection=yes;'
#get username
print ("Input username then hit enter: ")
name = input()
#Get password
psswd = getpass.getpass()
#If neither divisions or npartitions is given, the memory footprint of the first few rows will be determined, and partitions of size ~256MB will be used.
data = dd.read_sql_table("Foo.Testing", sql_server_cnxn_str, index_col="Test")
我不断地发现这个错误:
File "src/pymssql.pyx", line 642, in pymssql.connect
sqlalchemy.exc.OperationalError: (pymssql.OperationalError) (18456, b"Login failed for user 'foobar'.DB-Lib error message 20018, severity 14:\nGeneral SQL Server error: Check messages from the SQL Server\nDB-Lib error message 20002, severity 9:\nAdaptive Server connection failed (ROEFDN819Q)\nDB-Lib error message 20002, severity 9:\nAdaptive Server connection failed (ROEFDN819Q)\n")
我尝试了多种连接字符串格式,包括: “mssql+pyodbc://server_name/database_name?driver=SQL 服务器?受信任的连接=是'
"mssql+pymssql://{user}:{password}@{host}:{port}/{database}".format(user=username, password=password, host=server, database=database, port=port)
("mssql+pyodbc://%s:%s@%s/%s?driver=%s" % (username, password, server, database, driver ) )
"mssql+pyodbc://{0}:{1}@XXXX/YYYY".format(username,password)
什么都不管用。我不能从pyodbc中提取正确的配置吗?非常感谢你的帮助
这个怎么样
或者,使用登录凭据,试试这个
我以前从未使用过Dask,但这看起来很有希望
资源:
https://livebook.manning.com/book/data-science-at-scale-with-python-and-dask/chapter-4/72
相关问题 更多 >
编程相关推荐