error AttributeError: 'tuple' object has no attribute 'logits'

Environment info

AttributeError Traceback (most recent call last) <ipython-input-4-594fed3b7299> in <module>() 6 input = tokenizer.encode(sequence, return_tensors=“pt”) 7 mask_token_index = torch.where(input == tokenizer.mask_token_id)[1] ----> 8 token_logits = model(input).logits 9 mask_token_logits = token_logits[0, mask_token_index, :] 10 top_5_tokens = torch.topk(mask_token_logits, 5, dim=1).indices[0].tolist()

AttributeError: ‘tuple’ object has no attribute ‘logits’

• transformers version: Successfully installed sacremoses-0.0.43 sentencepiece-0.1.91 tokenizers-0.8.1rc2 transformers-3.3.1
• Platform: Masked Language Modeling - Colab PyTorch
• Python version: Python 3.6.9
• PyTorch version (GPU?):
• Tensorflow version (GPU?):
• Using GPU in script?:
• Using distributed or parallel set-up in script?:

Who can help

Information

Model I am using (Bert, XLNet …):

The problem arises when using:

• [V ] the official example scripts: (give details below)
• my own modified scripts: (give details below)

The tasks I am working on is:

• an official GLUE/SQUaD task: (give the name)
• my own task or dataset: (give details below)

To reproduce

Steps to reproduce the behavior:

1. Summary of the tasks Open Colab Pytorch
2. Masked Language Modeling example

Expected behavior