Spaces:

Akjava
/

AIChat-matcha-tts-onnx-en

Running on Zero

Akjava commited on Aug 7, 2024

Commit

3f30de8

verified ·

1 Parent(s): 2c6942f

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -18,7 +18,7 @@ def init():
     model_id = "Qwen/Qwen2-0.5B-Instruct"
     device = "auto" # torch.device("cuda" if torch.cuda.is_available() else "cpu")
-    device = "cuda"
     dtype = torch.bfloat16
     tokenizer = AutoTokenizer.from_pretrained(model_id, token=huggingface_token)

     model_id = "Qwen/Qwen2-0.5B-Instruct"
     device = "auto" # torch.device("cuda" if torch.cuda.is_available() else "cpu")
+    #device = "cuda"
     dtype = torch.bfloat16
     tokenizer = AutoTokenizer.from_pretrained(model_id, token=huggingface_token)