Python使用2种定义类型处理csv

Question

如何处理同一文件中具有两个重复定义的csv文件。你知道吗

我的意思是，这个文件看起来像这样重复的比赛计数和数量不断增加的多匹马每一场比赛。你知道吗

Meeting,05/07/14,RHIL,Rosehill Gardens,Weights,TAB,+3m Entire Circuit,          ,
Race,1,CIVIC STAKES,CIVIC,CIVIC,1350,~         ,3U        ,~         ,QLT       ,54,0,0,5/07/2014,,          ,          ,          ,          ,No class restriction, Quality, For Three-Years-Old and Upwards, No sex restriction, (Listed),Of $100000. First $60000, second $20000, third $10000, fourth $5000, fifth $2000, sixth $1000, seventh $1000, eighth $1000
Horse,1,Bennetta,0,"Grahame Begg",Randwick,,0,0,16-3-1-3 $390450.00,,0,0,0,,98.00,M,
Horse,2,Breakfast in Bed,0,"David Vandyke",Warwick Farm,,0,0,20-6-1-5 $201250.00,,0,0,0,,81.00,M,
Horse,3,Capital Commander,0,"Gerald Ryan",Rosehill,,0,0,43-9-9-3 $438625.00,,0,0,0,,85.00,M,
Horse,4,Coup Ay Tee (NZ),0,"Chris Waller",Rosehill,,0,0,35-9-6-5 $519811.00,,0,0,0,,101.00,G,
Horse,5,Generalife,0,"John O'Shea",Warwick Farm,,0,0,19-6-1-3 $235045.00,,0,0,0,,87.00,G,
Horse,6,He's Your Man (FR),0,"Chris Waller",Rosehill,,0,0,13-2-3-1 $108110.00,,0,0,0,,93.00,G,
Horse,7,Hidden Kisses,0,"Chris Waller",Rosehill,,0,0,40-8-8-5 $565750.00,,0,0,0,,96.00,M,
Horse,8,Oakfield Commands,0,"Gerald Ryan",Rosehill,,0,0,22-7-4-6 $269530.00,,0,0,0,,94.00,G,
Horse,9,Taxmeifyoucan,0,"Gregory Hickman",Warwick Farm,,0,0,18-2-4-4 $539730.00,,0,0,0,,91.00,G,
Horse,10,The Peak,0,"Bart & James Cummings",Randwick,,0,0,15-6-1-0 $426732.00,,0,0,0,,95.00,G,
Horse,11,Tougher Than Ever (NZ),0,"Chris Waller",Rosehill,,0,0,17-3-2-3 $321613.00,,0,0,0,,97.00,H,
Horse,12,TROMSO,0,"Chris Waller",Rosehill,,0,0,47-8-11-2 $622300.00,,0,0,0,,103.00,G,
Race,2,FLYING WELTER - BENCHMARK 95 HCP,BM95,BM95,1100,BM95      ,3U        ,~         ,HCP       ,54,0,0,5/07/2014,,          ,          ,          ,          ,BenchMark 95, Handicap, For Three-Years-Old and Upwards, No sex restriction,Of $85000. First $48750, second $16750, third $8350, fourth $4150, fifth $2000, sixth $1000, seventh $1000, eighth $1000, ninth $1000, tenth $1000
Horse,1,Big Bonanza,0,"Don Robb",Wyong,,0,57.5,31-9-4-3 $366860.00,,0,0,0,,92.00,G,
Horse,2,Casual Choice,0,"Joseph Pride",Warwick Farm,,0,54,8-2-3-0 $105930.00,,0,0,0,,80.00,G,
Horse,3,Cradle Me,0,"David Pfieffer",Warwick Farm,,0,54,28-7-4-2 $268215.00,,0,0,0,,89.00,M,

我可以用reader的标准方法来解析它，这是必要的。你知道吗

In [9]: with open('/home/sayth/Scripts/test.csv') as f:
    f_csv = csv.reader(f)
    headers = next(f_csv)
    for row in f_csv:
        print row

['Race', '1', 'CIVIC STAKES', 'CIVIC', 'CIVIC', '1350', '~         ', '3U        ', '~         ', 'QLT       ', '54', '0', '0', '5/07/2014', '', '          ', '          ', '          ', '          ', 'No class restriction', ' Quality', ' For Three-Years-Old and Upwards', ' No sex restriction', ' (Listed)', 'Of $100000. First $60000', ' second $20000', ' third $10000', ' fourth $5000', ' fifth $2000', ' sixth $1000', ' seventh $1000', ' eighth $1000']
['Horse', '1', 'Bennetta', '0', 'Grahame Begg', 'Randwick', '', '0', '0', '16-3-1-3 $390450.00', '', '0', '0', '0', '', '98.00', 'M', '']
['Horse', '2', 'Breakfast in Bed', '0', 'David Vandyke', 'Warwick Farm', '', '0', '0', '20-6-1-5 $201250.00', '', '0', '0', '0', '', '81.00', 'M', '']

然而，种族的定义和其中包含的信息根本不是包含38个项目的马的标题。实际上，它是一个与马桌相连的自己的桌子。你知道吗

我已经阅读了这里的示例Python Cookbook，它们很棒，但是假设一个csv文件有一个标准的头和数据。你知道吗

使用numpy和genfromtxt只会报告文件中的所有错误，例如。你知道吗

np.genfromtxt('/home/sayth/Scripts/test.csv',)
ValueError: Some errors were detected !
    Line #2 (got 38 columns instead of 5)
    Line #3 (got 3 columns instead of 5)
    Line #4 (got 6 columns instead of 5)
    Line #5 (got 4 columns instead of 5)
    Line #6 (got 6 columns instead of 5)
    Line #7 (got 4 columns instead of 5)
    Line #8 (got 6 columns instead of 5)
    Line #9 (got 4 columns instead of 5)
    Line #10 (got 4 columns instead of 5)
...

我该如何巧妙地处理赛马与马之间的档案保管关系？你知道吗

Answer 1

不知道具体细节，但我会从这样的事情开始。。。你知道吗

races = []
racefound = False
with open('/home/sayth/Scripts/test.csv') as f:
    f_csv = csv.reader(f)
    headers = next(f_csv)
    for row in f_csv:
        if row[0] == 'Race':
            if racefound:
                races.append(raceinfo)
                raceinfo = {'info': row, 'horses': horses}
                racefound = True
            horses = []
        else:
            horses.append(row)

更新：

如果您想使用竞赛行作为标题信息，类似这样的内容可能更符合您的需要。。你知道吗

with open('/home/sayth/Scripts/test.csv') as f:
    f_csv = csv.reader(f)
    headers = next(f_csv)
    for row in f_csv:
        if row[0] == 'Race':
            raceinfo = row
        else:
            print dict(zip(raceinfo,row))