VAN does not have an embedding layer, thus the hidden_states will have a length equal to the number of stages.

The figure below illustrates the architecture of a Visual Attention Layer. Taken from the original paper.

This model was contributed by Francesco. The original code can be found here.
Resources
A list of official Hugging Face and community (indicated by 🌎) resources to help you get started with VAN.