
# SpikeGPT-BookCorpus

## Model Description

SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See https://github.com/ridgerchu/SpikeGPT for details.

ctx_len = 1024
n_layer = 18
n_embd = 768


{"language": ["en"], "license": "bsd-2-clause", "tags": ["spiking neural netwroks", "text-generation", "rwkv"], "datasets": ["bookcorpus"]}
spiking neural netwroks text-generation rwkv en dataset:bookcorpus license:bsd-2-clause region:us
TAGS
#spiking neural netwroks #text-generation #rwkv #en #dataset-bookcorpus #license-bsd-2-clause #region-us 


# SpikeGPT-BookCorpus

## Model Description

SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See URL for details.

ctx_len = 1024
n_layer = 18
n_embd = 768


# SpikeGPT-BookCorpus ## Model Description

SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See URL for details.

ctx_len = 1024
n_layer = 18
n_embd = 768
TAGS
#spiking neural netwroks #text-generation #rwkv #en #dataset-bookcorpus #license-bsd-2-clause #region-us 
 # SpikeGPT-BookCorpus ## Model Description

SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See URL for details.

ctx_len = 1024
n_layer = 18
n_embd = 768
TAGS
#spiking neural netwroks #text-generation #rwkv #en #dataset-bookcorpus #license-bsd-2-clause #region-us 
# SpikeGPT-BookCorpus## Model Description

SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See URL for details.

ctx_len = 1024
n_layer = 18
n_embd = 768