Telugu-LLM-Labs

/

Telugu-gemma-7b-finetuned-sft

like 14

trying to run the following code

from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer


max_seq_length = 2048
dtype = None


model = AutoPeftModelForCausalLM.from_pretrained(
    "Telugu-LLM-Labs/Telugu-gemma-7b-finetuned-sft",
    load_in_4bit = False,
    token = hf_token
)
tokenizer = AutoTokenizer.from_pretrained("Telugu-LLM-Labs/Telugu-gemma-7b-finetuned-sft")

---------------------------------------------------------------------------
HTTPError                                 Traceback (most recent call last)
File ~/study/tokenizer/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_errors.py:304, in hf_raise_for_status(response, endpoint_name)
    303 try:
--> 304     response.raise_for_status()
    305 except HTTPError as e:

File ~/study/tokenizer/.venv/lib/python3.11/site-packages/requests/models.py:1024, in Response.raise_for_status(self)
   1023 if http_error_msg:
-> 1024     raise HTTPError(http_error_msg, response=self)

HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/google/gemma-7b/resolve/unsloth/config.json

The above exception was the direct cause of the following exception:

RevisionNotFoundError                     Traceback (most recent call last)
File ~/study/tokenizer/.venv/lib/python3.11/site-packages/transformers/utils/hub.py:402, in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_gated_repo, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs)
    400 try:
    401     # Load from URL or cache if already cached
--> 402     resolved_file = hf_hub_download(
    403         path_or_repo_id,
    404         filename,
    405         subfolder=None if len(subfolder) == 0 else subfolder,
    406         repo_type=repo_type,
    407         revision=revision,
...
    436     ) from e
    437 except LocalEntryNotFoundError as e:
    438     resolved_file = _get_cache_file_to_return(path_or_repo_id, full_filename, cache_dir, revision)

OSError: unsloth is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/google/gemma-7b' for available revisions.

not sure why it is going for unsloth when the hf is chosen as inference engine.