TeeZee's picture
Update README.md
a5e95a8 verified
|
raw
history blame
808 Bytes
metadata
license: other
tags:
  - merge
  - mergekit
  - lazymergekit
  - microsoft/Orca-2-13b
  - KoboldAI/LLaMA2-13B-Psyfighter2
license_name: microsoft-research-license

Psyfighter2-Orca2-ties

exllamav2 quant for tuantran1632001/Psyfighter2-Orca2-13B-ties

Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True

All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: Buy Me A Coffee