Spaces:

Ramji
/

slake_vqa_vlm_demo

Sleeping

Ramji commited on Oct 18, 2024

Commit

7d5c6b4

verified ·

1 Parent(s): 0d6beb2

removed 8bitload

Files changed (1) hide show

app.py CHANGED Viewed

@@ -102,7 +102,6 @@ path = 'Ramji/slake_vqa_internvl_demo'
 intern_model = AutoModel.from_pretrained(
     path,
     torch_dtype=torch.bfloat16,
-    load_in_8bit=True,
     low_cpu_mem_usage=True,
     use_flash_attn=False,
     trust_remote_code=True).eval()

 intern_model = AutoModel.from_pretrained(
     path,
     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
     use_flash_attn=False,
     trust_remote_code=True).eval()