Python Sklearn - 随机森林与缺失值

Question

我正在尝试在一个包含缺失值的数据集上使用随机森林算法。

我的数据集长这样：

train_data = [['1' 'NaN' 'NaN' '0.0127034' '0.0435092']
 ['1' 'NaN' 'NaN' '0.0113187' '0.228205']
 ['1' '0.648' '0.248' '0.0142176' '0.202707']
 ..., 
 ['1' '0.357' '0.470' '0.0328121' '0.255039']
 ['1' 'NaN' 'NaN' '0.00311825' '0.0381745']
 ['1' 'NaN' 'NaN' '0.0332604' '0.2857']]

为了填补“NaN”这个缺失值，我使用了：

from sklearn.preprocessing import Imputer

imp=Imputer(missing_values='NaN',strategy='mean',axis=0)
imp.fit(train_data[0::,1::])
new_train_data=imp.transform(train_data)

但是我遇到了以下错误：

Traceback (most recent call last):
  File "./RandomForest.py", line 72, in <module>
    new_train_data=imp.transform(train_data)
  File "/home/aurore/.local/lib/python2.7/site-packages/sklearn/preprocessing    /imputation.py", line 388, in transform
    values = np.repeat(valid_statistics, n_missing)
  File "/usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py", line 343, in repeat
    return repeat(repeats, axis)
ValueError: a.shape[axis] != len(repeats)

我做了这个：

new_train_data = imp.fit_transform(train_data)

然后我得到了这个错误：

Traceback (most recent call last):
  File "./RandomForest.py", line 82, in <module>
    forest = forest.fit(train_data[0::,1::],train_data[0::,0])
  File "/home/aurore/.local/lib/python2.7/site-packages/sklearn/ensemble/forest.py", line 224, in fit
    X, = check_arrays(X, dtype=DTYPE, sparse_format="dense")
  File "/home/aurore/.local/lib/python2.7/site-packages/sklearn/utils/validation.py", line 283, in check_arrays
    _assert_all_finite(array)
  File "/home/aurore/.local/lib/python2.7/site-packages/sklearn/utils/validation.py", line 43, in _assert_all_finite
    " or a value too large for %r." % X.dtype)
 ValueError: Input contains NaN, infinity or a value too large for dtype('float32').

这个包有什么问题吗？有没有人能帮我一下？这是什么意思？

Answer 1

你在第 1:: 列上训练了填补缺失值的工具，但之后你却想把它应用到所有列上。这是行不通的。你应该这样做：

new_train_data = imp.fit_transform(train_data)