TheBloke
/

falcon-40b-instruct-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Fix eos_token_id to align with vocabulary of this model

#9

by mike-ravkine - opened May 31, 2023

base: refs/heads/main

←

from: refs/pr/9

Discussion Files changed

May 31, 2023

See https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ/discussions/8

Upstream discussion: https://huggingface.co/tiiuae/falcon-40b-instruct/discussions/11

Fix eos_token_id to align with vocabulary of this model4267759e

Owner May 31, 2023

Thank you!

TheBloke changed pull request status to merged May 31, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment