Upload folder using huggingface_hub (#1)

- 2e83ef14fb37a9cda8e87ddc632b6e3944acc7965297abf2e747a844ec4bf007 (996cb7a4899dd83a2cc0998f0a2e1399a0f12daa)
- 0d958c66cdc5f6abc16428bcc881481bbdda2a7e2ca6d4570fdd9ae5508fa2ca (a1d795d7eb124300e00ea1374f44e23c648d5933)
- 3101a460b93b2abfe8df315437e9796c25c52e5d342b83a95f833c4d2d952434 (9a5123cf07dc509106f55073253094c6bdcdb9df)
- eb01db3c9ca7c54c0c59b7804daf248ff3d00d90018faee9d17c20b478cea76e (ee5ee6612193a82f54ca031ef2d776e51bd0c6e5)
- 8292eb0d1eda0ef916085815416b0c0fe1922c7b7682f85ba12e06230d8f381a (376e324bdfb586d0e9e3fbd1a1ede80163531575)
- 4e834ff299392d91ad18ef574607e1b449b74f4e58c45b1c0199f7a08e7c91b1 (025b9e07cd2be138b4188df9638ad138c819e8fd)

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Kosmos-EVAA-TSN-light-8B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Kosmos-EVAA-TSN-light-8B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Kosmos-EVAA-TSN-light-8B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Kosmos-EVAA-TSN-light-8B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+Kosmos-EVAA-TSN-light-8B.fp16.gguf filter=lfs diff=lfs merge=lfs -text
+Kosmos-EVAA-TSN-light-8B-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text

Kosmos-EVAA-TSN-light-8B-GGUF_imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd6bac7b043a28212611d3504e2e36fe9cbb41a568a251fdac7716fda15a3f96
+size 4988146

Kosmos-EVAA-TSN-light-8B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3e4d29276e2d6aa3876a812a31b6b77387e348fdcb2da0f2d46c9aee857937e
+size 5732987808

Kosmos-EVAA-TSN-light-8B.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e493bc1d0de33b3d59f16ec17a6c0e1808567c5deb81dcfabc1696395e00922e
+size 5599294368

Kosmos-EVAA-TSN-light-8B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5a9b56f9cc7ceaa0a6e714b205b73f5c8f161c75a08135e2b848c18ed4b7fdd7
+size 6596006816

Kosmos-EVAA-TSN-light-8B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f8e05f28dc6e8246e43369cb408abf6c950c87462ba6b41a5279cdfc31d74747
+size 8540771232

Kosmos-EVAA-TSN-light-8B.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5467ca3fc292487ad57a2df632f3df93561ee15322ccb292d150e803cf1963d2
+size 16068891328

README.md

@@ -0,0 +1,45 @@
+---
+base_model: jaspionjader/Kosmos-EVAA-TSN-light-8B
+inference: false
+model_creator: jaspionjader
+model_name: Kosmos-EVAA-TSN-light-8B-GGUF
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+---
+# [MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF](https://huggingface.co/MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF)
+- Model creator: [jaspionjader](https://huggingface.co/jaspionjader)
+- Original model: [jaspionjader/Kosmos-EVAA-TSN-light-8B](https://huggingface.co/jaspionjader/Kosmos-EVAA-TSN-light-8B)
+
+## Description
+[MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF](https://huggingface.co/MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF) contains GGUF format model files for [jaspionjader/Kosmos-EVAA-TSN-light-8B](https://huggingface.co/jaspionjader/Kosmos-EVAA-TSN-light-8B).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.