Loading checkpoint shard
#203
by
Spaklak
- opened
So, i want to run simple code:
import os
os.environ['HF_HOME'] = 'E:/models'
import transformers
import torch
access_token = 'token'
model_id = "meta-llama/Meta-Llama-3-8B-Instruct"
pipeline = transformers.pipeline(
"text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, token=access_token
)
print(pipeline("Hey how are you doing today?"))
But every time i have this error:
Message from log: [error] Disposing session as kernel process died ExitCode: 3221225477, Reason:
I've already downloaded the model
Please, help me(