<p>伟大的建议@EdChum!正如@EdChum所建议的那样,使用<code>infer_datetime_format=True</code>可以显著地加快速度。下面是我的例子。</p>
<p>我有一个传感器日志中的温度数据文件,如下所示:</p>
<blockquote>
<pre><code>RecNum,Date,LocationID,Unused
1,11/7/2013 20:53:01,13.60,"117","1",
2,11/7/2013 21:08:01,13.60,"117","1",
3,11/7/2013 21:23:01,13.60,"117","1",
4,11/7/2013 21:38:01,13.60,"117","1",
...
</code></pre>
</blockquote>
<p>我的代码读取csv并解析日期(<code>parse_dates=['Date']</code>)。
使用<code>infer_datetime_format=False</code>,需要8分钟8秒:</p>
<blockquote>
<pre><code>Tue Jan 24 12:18:27 2017 - Loading the Temperature data file.
Tue Jan 24 12:18:27 2017 - Temperature file is 88.172 MB.
Tue Jan 24 12:18:27 2017 - Loading into memory. Please be patient.
Tue Jan 24 12:26:35 2017 - Success: loaded 2,169,903 records.
</code></pre>
</blockquote>
<p>使用<code>infer_datetime_format=True</code>,需要13秒:</p>
<blockquote>
<pre><code>Tue Jan 24 13:19:58 2017 - Loading the Temperature data file.
Tue Jan 24 13:19:58 2017 - Temperature file is 88.172 MB.
Tue Jan 24 13:19:58 2017 - Loading into memory. Please be patient.
Tue Jan 24 13:20:11 2017 - Success: loaded 2,169,903 records.
</code></pre>
</blockquote>