--- language: - en base_model: - Qwen/Qwen2-VL-2B-Instruct pipeline_tag: image-text-to-text library_name: transformers tags: - llama-cpp - Omni-Reasoner-o1 - gguf - Q4_K_S - 2B - qwen - Reasoner - llama-cpp - prithivMLmods - code - math - chat - roleplay - text-generation - safetensors - nlp - code --- # roleplaiapp/Omni-Reasoner-2B-Q4_K_S-GGUF **Repo:** `roleplaiapp/Omni-Reasoner-2B-Q4_K_S-GGUF` **Original Model:** `Omni-Reasoner-o1` **Organization:** `prithivMLmods` **Quantized File:** `omni-reasoner-2b-q4_k_s.gguf` **Quantization:** `GGUF` **Quantization Method:** `Q4_K_S` **Use Imatrix:** `False` **Split Model:** `False` ## Overview This is an GGUF Q4_K_S quantized version of [Omni-Reasoner-o1](https://huggingface.co/prithivMLmods/Omni-Reasoner-2B). ## Quantization By I often have idle A100 GPUs while building/testing and training the RP app, so I put them to use quantizing models. I hope the community finds these quantizations useful. Andrew Webby @ [RolePlai](https://roleplai.app/)