--- license: apache-2.0 pipeline_tag: text-generation base_model: internlm/internlm3-8b-instruct model_creator: InternLM model_name: internlm3-8b-instruct quantized_by: Second State Inc. --- # internlm3-8b-instruct-GGUF ## Original Model [internlm/internlm3-8b-instruct](https://huggingface.co/internlm/internlm3-8b-instruct) ## Run with Gaianet **Prompt template:** prompt template: `chatml` **Context size:** chat_ctx_size: `128000` **Run with GaiaNet:** - Quick start: https://docs.gaianet.ai/node-guide/quick-start - Customize your node: https://docs.gaianet.ai/node-guide/customize *Quantized with llama.cpp b4497*