'BertTokenizerFast' object has no attribute '_in_target_context_manager'

I am using version 0.11.0.

This is a saved model and imported using BERTopic.load(), it worked fine last week and the before that. I just tried doing some work on it today and I got this error when I try to use, topic_model.find_topic('...') .

'BertTokenizerFast' object has no attribute '_in_target_context_manager'.

Please and Thank you 😃

Issue Analytics

State:
Created a year ago
Comments:8 (2 by maintainers)

Top GitHub Comments

1reaction

Cspellzcommented, Sep 16, 2022

Found the issue, the 4.22.x and 4.21.x versions of transformers is returning the same error.

Using an older version, transformers==4.20.1, it started working fine again.

0reactions

jpwavelycommented, Sep 20, 2022

@Cspellz The issue here is not about a fixed dependency on a specific version but that the model was saved in one environment and loaded in an environment with different versions of the dependencies. This is in general an issue with model persistence which you can read a bit more about here. Whenever you save any model, BERTopic or not, it is important to fix the versions of your environment between loading and saving the model.

Thank you! I also tried to use the new version to save and load the model. It worked well!