Sao10K commited on
Commit
714453e
·
verified ·
1 Parent(s): 39e5a3e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ language:
4
+ - en
5
+ ---
6
+
7
+ A roleplay-based model intended for multiple AI characters / group based roleplaying sessions.
8
+
9
+ This is an experimental model, trained entirely off of purely human data, none from LLMs or AI Models. Data taken is from roleplaying forum scrapes and more, etc.
10
+
11
+ Built off of Llama-3-Instruct.
12
+
13
+ This is a Test / Alpha model. A proof of concept.
14
+
15
+ Make sure to adapt your cards to a group-chat friendly style?
16
+
17
+ ---
18
+
19
+ Training Details:
20
+ ```
21
+ - Uses L3-Instruct Format.
22
+ - One designated user per entry is the GPT-turn, while all other characters are different, assigned Human-turns, if not Axolotl does a fit.
23
+ # I am experimenting with doing the opposite too, having all but 1 be GPT-turns.
24
+ - Unique Characters per entry vary from 2-5 Characters usually.
25
+ - There is roughly only ~3K sample entries.
26
+ - May not be the smartest due to all samples being roleplay / conversational data.
27
+ ```
28
+
29
+ ---
30
+
31
+ Potential Issues:
32
+ ```
33
+ - 1 on 1 RP Performance might be Affected as focus is solely on group chats.
34
+ - The names may be multiple tokens instead of one token as they replace User / Assistant -> May Affect Output Quality -> Another Idea is in the works.
35
+ - Dataset Quality? While it is filtered, a few times... there's still the occasional low quality in there. I have not gone through a manual pass, this is a proof of concept.
36
+ ```
37
+
38
+ SillyTavern Settings:
39
+ ```
40
+ Llama-3-Instruct-With-Names -->>>> Remove the Brackets in `[{{name}}]` or `[{{char}}]` or `[{{user}}]` within the instruction template to match the format used for training.
41
+ ```
42
+