AttributeError: 'GPT2LMHeadModel' object has no attribute 'generate'

🐛 Bug

The example script run_generation.py is broken with the error message AttributeError: 'GPT2LMHeadModel' object has no attribute 'generate'

To Reproduce

Steps to reproduce the behavior:

In a terminal, cd to transformers/examples and then python run_generation.py --model_type=gpt2 --model_name_or_path=gpt2
After the model binary is downloaded to cache, enter anything when prompted “Model prompt >>>”
And then you will see the error:

Traceback (most recent call last):
  File "run_generation.py", line 236, in <module>
    main()
  File "run_generation.py", line 216, in main
    output_sequences = model.generate(
  File "C:\Anaconda3\lib\site-packages\torch\nn\modules\module.py", line 585, in __getattr__
    type(self).__name__, name))
AttributeError: 'GPT2LMHeadModel' object has no attribute 'generate'

Expected behavior

Environment

OS: Windows 10
Python version: 3.7.3
PyTorch version: 1.3.1
PyTorch Transformers version (or branch): 2.2.2
Using GPU ? N/A
Distributed of parallel setup ? N/A
Any other relevant information:

I’m running the latest version of run_generation.py. Here is the permanent link: https://github.com/huggingface/transformers/blob/ce50305e5b8c8748b81b0c8f5539a337b6a995b9/examples/run_generation.py

Additional context

Issue Analytics

State:
Created 4 years ago
Reactions:11
Comments:6

Top GitHub Comments

5reactions

Weenkuscommented, Dec 25, 2019

@jsh9’s solution worked for me!

Also, if you want to avoid doing the manual steps, you can just pip install directly from the master branch by running:

pip install git+https://github.com/huggingface/transformers.git@master#egg=transformers

4reactions

jsh9commented, Dec 24, 2019

I have found the reason.

So it turns out that the generate() method of the PreTrainedModel class is newly added, even newer than the latest release (2.3.0). Quite understandable since this library is iterating very fast.

So to make run_generation.py work, you can install this library like this: