Update README.md
Browse files
README.md
CHANGED
@@ -13,33 +13,34 @@ tags:
|
|
13 |
![GOAT-70B-Storytelling](https://assets.adapt.ws/files/20231117_ehznrqludevtapck.png)
|
14 |
# GOAT-70B-Storytelling model
|
15 |
|
16 |
-
GOAT-70B-Storytelling model trained by GOAT.AI lab as a core model for autonomous story-writing agent.
|
17 |
-
|
18 |
|
19 |
# GOAT-Storytelling-Agent
|
20 |
-
|
|
|
21 |
|
22 |
# Model description
|
|
|
23 |
- **Base Architecture:** LLaMA 2 70B
|
24 |
- **License:** llama2
|
25 |
- **Context window length:** 4096 tokens
|
26 |
|
27 |
### Training details
|
28 |
|
29 |
-
|
30 |
|
31 |
### Learn more
|
32 |
|
33 |
- **Blogpost:** [GOAT-Storytelling: Arbitrarily Long Story Writing Agent](https://www.blog.goat.ai/goat-st/)
|
34 |
- **GitHub:** [here](https://github.com/GOAT-AI-lab/GOAT-Storytelling-Agent)
|
35 |
- **Generated examples:** [here](https://huggingface.co/datasets/GOAT-AI/generated-novels/tree/main/generated-books)
|
|
|
36 |
## Uses
|
37 |
|
38 |
The main purpose of GOAT-70B-Storytelling is to generate books, novels, movie scripts and etc. as an agent in coping with our GOAT-Storytelling-Agent. It is specifically designed for storywriters.
|
39 |
|
40 |
## Usage
|
41 |
|
42 |
-
|
43 |
Usage can be either self-hosted via `transformers` or used with Spaces
|
44 |
|
45 |
```python
|
@@ -62,15 +63,17 @@ First, modify config.py and add your generation endpoint.
|
|
62 |
Then you can use it inside via GOAT-Storytelling-Agent:
|
63 |
|
64 |
```python
|
65 |
-
from goat_storytelling_agent
|
66 |
|
67 |
-
novel_scenes = generate_story('
|
68 |
```
|
|
|
69 |
## License
|
70 |
|
71 |
GOAT-70B-Storytelling model is based on [Meta's LLaMA-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf), and using own datasets.
|
72 |
|
73 |
GOAT-70B-Storytelling model weights are available under LLAMA-2 license.
|
|
|
74 |
### Risks and Biases
|
75 |
|
76 |
GOAT-70B-Storytelling model can produce factually incorrect output and should not be relied on to deliver factually accurate information. Therefore, the GOAT-70B-Storytelling model could possibly generate wrong, biased, or otherwise offensive outputs.
|
|
|
13 |
![GOAT-70B-Storytelling](https://assets.adapt.ws/files/20231117_ehznrqludevtapck.png)
|
14 |
# GOAT-70B-Storytelling model
|
15 |
|
16 |
+
GOAT-70B-Storytelling model trained by GOAT.AI lab as a core model for an autonomous story-writing agent.
|
|
|
17 |
|
18 |
# GOAT-Storytelling-Agent
|
19 |
+
|
20 |
+
The GOAT-70B-Storytelling model has been developed as an integral component within the GOAT-Storytelling-Agent. This agent facilitates the generation of high-quality, cohesive, and captivating narratives, including stories and books. It achieves this by utilizing inputs such as plot outlines, character profiles, their interrelationships, and other relevant details. Examples are provided below.
|
21 |
|
22 |
# Model description
|
23 |
+
|
24 |
- **Base Architecture:** LLaMA 2 70B
|
25 |
- **License:** llama2
|
26 |
- **Context window length:** 4096 tokens
|
27 |
|
28 |
### Training details
|
29 |
|
30 |
+
Training was performed on a GPU cluster of 64xH100s and FSDP ZeRO-3 sharding is employed. We instruction finetune on a dataset of 18K examples for one epoch with batch size of 336, AdamW optimizer with learning rate 1e-5.
|
31 |
|
32 |
### Learn more
|
33 |
|
34 |
- **Blogpost:** [GOAT-Storytelling: Arbitrarily Long Story Writing Agent](https://www.blog.goat.ai/goat-st/)
|
35 |
- **GitHub:** [here](https://github.com/GOAT-AI-lab/GOAT-Storytelling-Agent)
|
36 |
- **Generated examples:** [here](https://huggingface.co/datasets/GOAT-AI/generated-novels/tree/main/generated-books)
|
37 |
+
|
38 |
## Uses
|
39 |
|
40 |
The main purpose of GOAT-70B-Storytelling is to generate books, novels, movie scripts and etc. as an agent in coping with our GOAT-Storytelling-Agent. It is specifically designed for storywriters.
|
41 |
|
42 |
## Usage
|
43 |
|
|
|
44 |
Usage can be either self-hosted via `transformers` or used with Spaces
|
45 |
|
46 |
```python
|
|
|
63 |
Then you can use it inside via GOAT-Storytelling-Agent:
|
64 |
|
65 |
```python
|
66 |
+
from goat_storytelling_agent import storytelling_agent as goat
|
67 |
|
68 |
+
novel_scenes = goat.generate_story('treasure hunt in a jungle', form='novel')
|
69 |
```
|
70 |
+
|
71 |
## License
|
72 |
|
73 |
GOAT-70B-Storytelling model is based on [Meta's LLaMA-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf), and using own datasets.
|
74 |
|
75 |
GOAT-70B-Storytelling model weights are available under LLAMA-2 license.
|
76 |
+
|
77 |
### Risks and Biases
|
78 |
|
79 |
GOAT-70B-Storytelling model can produce factually incorrect output and should not be relied on to deliver factually accurate information. Therefore, the GOAT-70B-Storytelling model could possibly generate wrong, biased, or otherwise offensive outputs.
|