Upload folder using huggingface_hub (#1)

- b6b6a32710b4e97c7d5896cc8397e35657db0f07c9301dbefb9f839a24a15713 (649a0202eccbeba1ef097e8f2781e255937d04cb)
- ded744607c8ac26b1b461ca6d62ca0af42bf9f1723b75dde4be3a81b8351d365 (2e788c7dcf6752b409ed141db195dec3bc336122)
- ba6d6457d63772a84e9fbf1630e9a7c700ea60a754f82edb98bcbce2d493767e (e9f02c08ff5e956f2d1fa655f15bbe5bd5a5b31e)
- a13d059c3367a34c7d6a8df1329377a7e86d0e4988ae96a0e29689fd20782a0b (a652d1c4ad38e5d38d6fbdfaecaa2ce92edd5f70)
- 17cf06f125f7275ea3d54c5a8d6c606ef4d2fc7342ba12e7b754fc3d6c0c9bf8 (6613df80e925d0ed55da750fd92b44afb13b19a9)
- 8e24a91863d5d2cb7baec2103377eee6e803679a69849f9a7e8cf676d3218a73 (5b3143555576c0ab016b15b0baf6530386a88869)

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+VICIOUS_MESH-12B-OMEGA.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+VICIOUS_MESH-12B-OMEGA.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+VICIOUS_MESH-12B-OMEGA.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+VICIOUS_MESH-12B-OMEGA.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+VICIOUS_MESH-12B-OMEGA.fp16.gguf filter=lfs diff=lfs merge=lfs -text
+VICIOUS_MESH-12B-OMEGA-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,45 @@
+---
+base_model: bamec66557/VICIOUS_MESH-12B-OMEGA
+inference: false
+model_creator: bamec66557
+model_name: VICIOUS_MESH-12B-OMEGA-GGUF
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+---
+# [MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF](https://huggingface.co/MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF)
+- Model creator: [bamec66557](https://huggingface.co/bamec66557)
+- Original model: [bamec66557/VICIOUS_MESH-12B-OMEGA](https://huggingface.co/bamec66557/VICIOUS_MESH-12B-OMEGA)
+
+## Description
+[MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF](https://huggingface.co/MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF) contains GGUF format model files for [bamec66557/VICIOUS_MESH-12B-OMEGA](https://huggingface.co/bamec66557/VICIOUS_MESH-12B-OMEGA).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

VICIOUS_MESH-12B-OMEGA-GGUF_imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5cd784a399b4138557013056c5e54a744f1990b05142bfb3096bdb2344f42d40
+size 7054394

VICIOUS_MESH-12B-OMEGA.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3f7c41519c65e9c991df8371fdb5bab32aaa45c3db7aacf024267607552f6c7
+size 8727635648

VICIOUS_MESH-12B-OMEGA.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed3f2d6ca87602e3abad7d0de5e31eb0fb1eb8e7a7c3869df171abc951fee012
+size 8518739648

VICIOUS_MESH-12B-OMEGA.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6da267c71da8a61d61032264e591728e40d4cc9e453eb343f5241b455db3c395
+size 10056214208

VICIOUS_MESH-12B-OMEGA.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:50fe6344504fabea6f703d4be6186c9cdebb73a066762d55df5d01a01a3e335d
+size 13022373568

VICIOUS_MESH-12B-OMEGA.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e7235036c9ef19f78d42adb1883ee0fc02fddd7b3e429895fb948d1a5bf3bdb5
+size 24504280512