回答此问题可获得 20 贡献值,回答如果被采纳可获得 50 分。
<p>我想把熊猫DF变成火花一号。
测向头:</p>
<pre><code>10000001,1,0,1,12:35,OK,10002,1,0,9,f,NA,24,24,0,3,9,0,0,1,1,0,0,4,543
10000001,2,0,1,12:36,OK,10002,1,0,9,f,NA,24,24,0,3,9,2,1,1,3,1,3,2,611
10000002,1,0,4,12:19,PA,10003,1,1,7,f,NA,74,74,0,2,15,2,0,2,3,1,2,2,691
</code></pre>
<p>代码:</p>
<pre><code><a href="https://www.cnpython.com/pypi/dataset" class="inner-link">dataset</a> = pd.read_csv("data/AS/test_v2.csv")
sc = SparkContext(conf=conf)
sqlCtx = SQLContext(sc)
sdf = sqlCtx.createDataFrame(dataset)
</code></pre>
<p>我犯了个错误:</p>
<pre><code>TypeError: Can not merge type <class 'pyspark.sql.types.StringType'> and <class 'pyspark.sql.types.DoubleType'>
</code></pre>