Python中的Pandas文件加载错误（例如Python中的Pandas分析错误）

Question

我遵循Python for Data Analysis一书。它告诉我从http://www.fec.gov/disclosurep/PDownload.do获取ALL文件并用pandas加载它：

import pandas as pd

fec = pd.read_csv('P00000001-ALL.csv')

但自从这本书写完之后，实际的文件已经改变了。旧文件（这里提供https://github.com/pydata/pydata-book/blob/master/ch09/P00000001-ALL.csv）可以很好地加载

^{pr2}$

但新的列加载错误，因为列似乎已移位（第一列值被删除）

^{3}$

实际行是

C00579458,"P60008059","Bush, Jeb","EASTON, AMY KELLY MRS.","KEY BISCAYNE","FL","331491716","HOMEMAKER","HOMEMAKER",2700,26-JUN-15,"","","","SA17A","1024106","SA17.114991","P2016",

所以C00579458在某个地方丢失了。在

标题看起来像这样。 cmte_id，cand_id，cand峎nm，contbr峎city，contbr峎st，contbr_zip，contbr_employer，contbr_职业，contb_receipt_amt，contb_receipt_dt，receipt_desc，备忘光盘，备忘录文本，表格tp，文件编号，事务id，选举

Answer 1

正如另一个答案已经暗示的那样，您的csv格式不正确，行尾有一个comma。因此，这导致pandas将第一列视为索引列。在

要解决这个问题，可以将index_col=False参数传递给^{}函数。示例-

In [24]: s = io.StringIO("""cmte_id,cand_id,cand_nm,contbr_nm,contbr_city,contbr_st,contbr_zip,contbr_employer,contbr_occupation,contb_receipt_amt,contb_receipt_dt,receipt_desc,memo_cd,memo_text,form_tp,file_num,tran_id,election_tp
   ....: C00579458,"P60008059","Bush, Jeb","EASTON, AMY KELLY MRS.","KEY BISCAYNE","FL","331491716","HOMEMAKER","HOMEMAKER",2700,26-JUN-15,"","","","SA17A","1024106","SA17.114991","P2016",""")

In [25]: df = pd.read_csv(s)  #Issue

In [26]: df
Out[26]:
             cmte_id    cand_id                 cand_nm     contbr_nm  \
C00579458  P60008059  Bush, Jeb  EASTON, AMY KELLY MRS.  KEY BISCAYNE

          contbr_city  contbr_st contbr_zip contbr_employer  \
C00579458          FL  331491716  HOMEMAKER       HOMEMAKER

           contbr_occupation contb_receipt_amt  contb_receipt_dt  \
C00579458               2700         26-JUN-15               NaN

           receipt_desc  memo_cd memo_text  form_tp     file_num tran_id  \
C00579458           NaN      NaN     SA17A  1024106  SA17.114991   P2016

           election_tp
C00579458          NaN

In [29]: df = pd.read_csv(s,index_col=False)  #No issue

In [30]: df
Out[30]:
     cmte_id    cand_id    cand_nm               contbr_nm   contbr_city  \
0  C00579458  P60008059  Bush, Jeb  EASTON, AMY KELLY MRS.  KEY BISCAYNE

  contbr_st  contbr_zip contbr_employer contbr_occupation  contb_receipt_amt  \
0        FL   331491716       HOMEMAKER         HOMEMAKER               2700

  contb_receipt_dt  receipt_desc  memo_cd  memo_text form_tp  file_num  \
0        26-JUN-15           NaN      NaN        NaN   SA17A   1024106

       tran_id election_tp
0  SA17.114991       P2016

这在the documentations-

index_col : int or sequence or False, default None

Column to use as the row labels of the DataFrame. If a sequence is given, a MultiIndex is used. If you have a malformed file with delimiters at the end of each line, you might consider index_col=False to force pandas to not use the first column as the index (row names)

（重点是我的）

Answer 2

原始数据中每行的末尾都有一个额外的逗号。在

C00458844,"P60006723","Rubio, Marco","HEFFERNAN, MICHAEL","APO","AE","090960009","INFORMATION REQUESTED PER BEST EFFORTS","INFORMATION REQUESTED PER BEST EFFORTS",210,27-JUN-15,"","","","SA17A","1015697","SA17.796904","P2016",

如果有两个逗号，每行将移动2列。在