The HF position_ids is a non-persistent buffer (registered with persistent=False) and therefore is omitted from PyTorch’s state_dict. The Relax importer currently ...