Pytorch UnpicklingError:遇到加载持久id指令

2024-04-19 23:07:13 发布

您现在位置:Python中文网/ 问答频道 /正文

My dataloader在加载其文件时引发此错误:

UnpicklingError                           Traceback (most recent call last)
<ipython-input-14-cb081a68afbe> in <module>
----> 1 torch.load("/network/tmp1/ccai/data/labelbox_2020/imgs/AB_304.png")

~/.conda/envs/omnienv/lib/python3.8/site-packages/torch/serialization.py in load(f, map_location, pickle_module, **pickle_load_args)
    593                     return torch.jit.load(opened_file)
    594                 return _load(opened_zipfile, map_location, pickle_module, **pickle_load_args)
--> 595         return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
    596 
    597 

~/.conda/envs/omnienv/lib/python3.8/site-packages/torch/serialization.py in _legacy_load(f, map_location, pickle_module, **pickle_load_args)
    762             "functionality.")
    763 
--> 764     magic_number = pickle_module.load(f, **pickle_load_args)
    765     if magic_number != MAGIC_NUMBER:
    766         raise RuntimeError("Invalid magic number; corrupt file?")

UnpicklingError: A load persistent id instruction was encountered,
but no persistent_load function was specified.

困扰我的是,我没有像前面指出的那样从同一个进程中进行多个加载

这个错误可能是由多个python进程读取同一个文件触发的吗

ubuntu 18上的pytorch 1.7和python 3.8


Tags: 文件innumbermapreturn错误magicargs