原始文件路径中存在的示例数据
member_id|member_name|member_birthdate
1|Rooney ,Shannon|16180705
2|Alea ,Fitzpatrick|16990120
3|Daquan ,Cooper|16681214
csvData = spark.read.option("delimiter",delim).format("csv")\
.load(raw_file_path,header='true',inferSchema='true').show()
我希望输出为pipe delmiter,但由于值中有1个逗号,因此无法获得预期的结果
结果我得到:
| member_id|member_name|member_birthdate|
+--------------------+-----------+----------------+
|1|Rooney ,Shannon...| null| null|
|2|Alea ,Fitzpatri...| null| null|
|3|Daquan ,Cooper|...| null| null|
预期结果
|member_id| member_name|member_birthdate|
|1 | Rooney ,Shannon| 16180705|
|2 | Alea ,Fitzpatri| 16990120|
|3 | Daquan ,Cooper | 16681214|
目前没有回答
相关问题 更多 >
编程相关推荐