在保护大Pandas南部的同时丢弃复制品

Question

当使用drop_duplicates()方法时，我减少了重复项，但也将所有NaNs合并到一个条目中。如何在保留空条目的行（如np.nan, None or ''）时删除重复项？

import pandas as pd
df = pd.DataFrame({'col':['one','two',np.nan,np.nan,np.nan,'two','two']})

Out[]: 
   col
0  one
1  two
2  NaN
3  NaN
4  NaN
5  two
6  two


df.drop_duplicates(['col'])

Out[]: 
   col
0  one
1  two
2  NaN

Answer 1

试试看

df[(~df.duplicated()) | (df['col'].isnull())]

结果是：

col
0   one
1   two
2   NaN
3   NaN     
4   NaN