
# Princeton NLP's Sheared-Pythia-160m trained on the WebGLM-QA dataset

- Base model: [princeton-nlp/Sheared-Pythia-160m](https://huggingface.co/princeton-nlp/Sheared-Pythia-160m)
- Dataset: [THUDM/webglm-qa](https://huggingface.co/datasets/THUDM/webglm-qa)

## Recommended prompt format

```
<|references|>
{references}</s>
<|question|>
{question}</s>
<|answer|>
```

{"license": "apache-2.0", "datasets": ["THUDM/webglm-qa"], "base_model": "princeton-nlp/Sheared-Pythia-160m", "widget": [{"text": "<|references|>\n[1] Volcanoes erupt because of density and pressure. The lower density of the magma relative to the surrounding rocks causes it to rise (like air bubbles in syrup). It will rise to the surface or to a depth that is determined by the density of the magma and the weight of the rocks above it. As the magma rises, bubbles start to form from the gas dissolved in the magma. The gas bubbles exert tremendous pressure. This pressure helps to bring the magma to the surface and forces it in the air, sometimes to great heights.\n[2] Volcanic eruptions are among the most stunning phenomena in the natural world. Volcanoes erupt because of the way heat moves beneath Earth\u2019s surface. Heat is conveyed from the planet\u2019s interior to its surface largely by convection\u2014the transfer of heat by movement of a heated fluid. In this case, the fluid is magma\u2014molten or partially molten rock\u2014which is formed by the partial melting of Earth's mantle and crust. The magma rises, and, in the last step in this heat-releasing process, erupts at the surface through volcanoes.\n[3] Magma rises from the hot spots and erupts as lava through cracks in the Earth's surface forming volcanoes.\n[4] A volcano is an opening or rupture in the earth\u2019s surface that allows magma (hot liquid and semi-liquid rock), volcanic ash and gases to escape. They are generally found where tectonic plates come together or separate but they can also occur in the middle of plates due to volcanic hotspots. A volcanic eruption is when lava and gas are released from a volcano\u2014sometimes explosively. The most dangerous type of eruption is called a 'glowing avalanche' which is when freshly erupted magma flows down the sides of a volcano. They can travel quickly and reach temperatures of up to 1,200 degrees Fahrenheit. Other hazards include ash fall, and lahars (mud or debris flows). Volcanoes often cause population displacement and food shortages.\n[5] An erupting volcano may include varying types of activity, along with a range of intensity. Volcanic activity includes earthquakes caused by magma movement, gas emissions, effusive emissions of lava, and cataclysmic eruptions.</s>\n<|question|>\nHow does a volcano erupt?</s>\n<|answer|>"}], "inference": {"parameters": {"max_new_tokens": 250, "repetition_penalty": 1.025, "do_sample": true, "temperature": 0.4, "top_p": 0.25, "top_k": 7}}}
transformers safetensors gpt_neox text-generation dataset:THUDM/webglm-qa base_model:princeton-nlp/Sheared-Pythia-160m license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us