iwaitu
/

llama-3.1-70b-chinese-chat-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

llama-3.1-70b-chinese-chat-FP8 / README.md

iwaitu's picture

Update README.md

f23ed53 verified 5 months ago

|

history blame contribute delete

220 Bytes

metadata

license: apache-2.0
language:
  - zh
  - en
base_model: shenzhi-wang/Llama3.1-70B-Chinese-Chat

base on shenzhi-wang/Llama3.1-70B-Chinese-Chat

推荐使用 2x H100 来运行

或者使用4x RTX6000 ADA 48G 来运行