
语言模型参数：vocab_size=12829,num_hidden_layers=8,num_attention_heads=8,intermediate_size=1024,max_position_embeddings=512,hidden_size=512
语言模型数据：10G数据
finetune：alpaca 51K条数据
{"language": ["zh"], "license": "apache-2.0", "library_name": "transformers", "tags": ["code"], "datasets": ["wikipedia"], "metrics": ["perplexity"], "pipeline_tag": "text-generation"}
transformers pytorch gpt_neox text-generation code zh dataset:wikipedia license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #gpt_neox #text-generation #code #zh #dataset-wikipedia #license-apache-2.0 #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 


语言模型参数：vocab_size=12829,num_hidden_layers=8,num_attention_heads=8,intermediate_size=1024,max_position_embeddings=512,hidden_size=512
语言模型数据：10G数据
finetune：alpaca 51K条数据
TAGS
#transformers #pytorch #gpt_neox #text-generation #code #zh #dataset-wikipedia #license-apache-2.0 #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

TAGS
#transformers #pytorch #gpt_neox #text-generation #code #zh #dataset-wikipedia #license-apache-2.0 #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
