BEiT pre-training. Taken from the original paper. 
Resources
A list of official Hugging Face and community (indicated by 🌎) resources to help you get started with BEiT.

[BeitForImageClassification] is supported by this example script and notebook.
See also: Image classification task guide