
# Shareded fp16 copy of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B)

> This is fork of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) with shareded fp16 weights implementing a custom `handler.py` as an example for how to use `gpt-j` [inference-endpoints](https://hf.co/inference-endpoints)
{"library_name": "generic", "tags": ["endpoints-template"], "duplicated_from": "philschmid/gpt-j-6B-fp16-sharded"}
generic pytorch gptj endpoints-template endpoints_compatible region:us
TAGS
#generic #pytorch #gptj #endpoints-template #endpoints_compatible #region-us 


# Shareded fp16 copy of EleutherAI/gpt-j-6B

> This is fork of EleutherAI/gpt-j-6B with shareded fp16 weights implementing a custom 'URL' as an example for how to use 'gpt-j' inference-endpoints
# Shareded fp16 copy of EleutherAI/gpt-j-6B

> This is fork of EleutherAI/gpt-j-6B with shareded fp16 weights implementing a custom 'URL' as an example for how to use 'gpt-j' inference-endpoints
TAGS
#generic #pytorch #gptj #endpoints-template #endpoints_compatible #region-us 
 # Shareded fp16 copy of EleutherAI/gpt-j-6B

> This is fork of EleutherAI/gpt-j-6B with shareded fp16 weights implementing a custom 'URL' as an example for how to use 'gpt-j' inference-endpoints
TAGS
#generic #pytorch #gptj #endpoints-template #endpoints_compatible #region-us 
# Shareded fp16 copy of EleutherAI/gpt-j-6B

> This is fork of EleutherAI/gpt-j-6B with shareded fp16 weights implementing a custom 'URL' as an example for how to use 'gpt-j' inference-endpoints