

TITLE
Add Unlimiformer to 🤗 transformers

COMMENTS
0

REACTIONS
+1: 7
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
### Model description

I want to add the recently released Unlimiformer (Long-Range Transformers with Unlimited Length Input) model to 🤗 transformers.

Will this be a good addition?

### Open source status

- [X] The model implementation is available
- [X] The model weights are available

### Provide useful links for the implementation

Paper: https://arxiv.org/abs/2305.01625
Code: https://github.com/abertsch72/unlimiformer
Model weights: https://github.com/abertsch72/unlimiformer#trained-models

Authors: @abertsch72 
cc @LysandreJik 