text
How do i access llama 3.1 70b in my space ?
How do i access llama 3.1 70b in my space ?
new_line
new_line
text
this doesn't seem to work, can someone help me with a working code 
this doesn't seem to work, can someone help me with a working code 
new_line
new_line
new_line
text
from transformers import AutoConfig
from transformers import AutoConfig
new_line
new_line
text
config = AutoConfig.from_pretrained("meta-llama/Meta-Llama-3.1-70B", revision="main")
config = AutoConfig.from_pretrained("meta-llama/Meta-Llama-3.1-70B", revision="main")
new_line
text
config.rope_scaling = {"type": "llama3", "factor": 8.0}
config.rope_scaling = {"type": "llama3", "factor": 8.0}
new_line
new_line
text
model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-70B", config=config, use_auth_token=True)
model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-70B", config=config, use_auth_token=True)
How do i access llama 3.1 70b in my space ?

this doesn't seem to work, can someone help me with a working code 


from transformers import AutoConfig

config = AutoConfig.from_pretrained("meta-llama/Meta-Llama-3.1-70B", revision="main")
config.rope_scaling = {"type": "llama3", "factor": 8.0}

model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-70B", config=config, use_auth_token=True)
👀
John6666
https://cdn-avatars.huggingface.co/v1/production/uploads/6640bbd0220cfa8cbfdce080/wiAHUu5ewawyipNs0YFBR.png
John Smith
John6666
user
/avatars/fcf9eac61e0ec82ba5503bf07c867247.svg
Rangaiah
Shamurangaiah
user