A Google Colab demo on how to run Llava on a free-tier Google colab instance leveraging 4-bit inference.
A similar notebook showcasing batched inference. 🌎

LlavaConfig
[[autodoc]] LlavaConfig
LlavaProcessor
[[autodoc]] LlavaProcessor
LlavaForConditionalGeneration
[[autodoc]] LlavaForConditionalGeneration
    - forward