解决RuntimeError: CUDA error: an illegal memory access was encountered问题

用pytorch在多卡训练transformers的时候出现了以下问题：
RuntimeError: CUDA error: an illegal memory access was encountered
terminate called after throwing an instance of 'c10::Error'
what(): CUDA error: an illegal memory access was encountered
Exception raised from create_event_internal at /pytorch/c10/cuda/CUDACachingAllocator.cpp:687 (most recent call first):
frame #0: c10::Error::Error(c10::SourceLocation, std::string) +

解决RuntimeError: CUDA error: an illegal memory access was encountered问题最先出现在Python成神之路。