TristanBehrens
commited on
Commit
·
887b167
1
Parent(s):
eefa2a9
Update README.md
Browse files
README.md
CHANGED
@@ -25,7 +25,59 @@ You are free to use this model in any open-source context without charge. Howeve
|
|
25 |
|
26 |
## Model description
|
27 |
|
28 |
-
The model is GPT-2 with 6 decoders and 8 attention
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
|
30 |
## Intended uses & limitations
|
31 |
|
|
|
25 |
|
26 |
## Model description
|
27 |
|
28 |
+
The model is GPT-2 with 6 decoders and 8 attention heads each. The context length is 2048. The embedding dimensions are 512.
|
29 |
+
|
30 |
+
## Model family
|
31 |
+
|
32 |
+
This model is part of a huge group of Transformers I have trained. Most of them are not publicly available.
|
33 |
+
|
34 |
+
If you are interested in using andor licensing one of the models, please get in touch.
|
35 |
+
|
36 |
+
### Lakhclean
|
37 |
+
|
38 |
+
These models were trained on roundabout 15K MIDI files (the same as the model you are viewing now) from the Lakhclean dataset.
|
39 |
+
|
40 |
+
- lakhclean_mmmbar_4bars_d-2048: 4 bars resolution, bar inpainting, note density conditioning
|
41 |
+
- lakhclean_mmmbar_8bars_d-2048: 8 bars resolution, bar inpainting, note density conditioning
|
42 |
+
- lakhclean_mmmtrack_4bars_chords: 4 bars resolution, chord conditioning
|
43 |
+
- lakhclean_mmmtrack_4bars_d-2048: 4 bars resolution, note density conditioning (this model)
|
44 |
+
- lakhclean_mmmtrack_4bars_simple-2048: 4 bars resolution
|
45 |
+
- lakhclean_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
46 |
+
|
47 |
+
### Lakhfull
|
48 |
+
|
49 |
+
These models were trained on roundabout 175K MIDI files from the Lakh dataset.
|
50 |
+
|
51 |
+
- lakhfull_mmmtrack_4bars_d-2048: 4 bars resolution, note density conditioning (the big brother of this model)
|
52 |
+
- lakhfull_mmmtrack_4bars_simple-2048: 4 bars resolution
|
53 |
+
|
54 |
+
### Metal
|
55 |
+
|
56 |
+
These models were trained on roundabout 7K MIDI files from my own collections. They contain genre conditioning.
|
57 |
+
|
58 |
+
- metal_mmmbar_4bars_d-2048: 4 bars resolution, bar inpainting, note density conditioning
|
59 |
+
- metal_mmmbar_8bars_d-2048: 8 bars resolution, bar inpainting, note density conditioning
|
60 |
+
- metal_mmmtrack_4bars_d-2048: 4 bars resolution, note density conditioning
|
61 |
+
- metal_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
62 |
+
|
63 |
+
### MetaMIDI Dataset genres
|
64 |
+
|
65 |
+
These models were trained on genre-specific subsets of the MetaMIDI dataset.
|
66 |
+
|
67 |
+
- mmd-baroque_mmmtrack_4bars_d-2048: 4 bars resolution, note density conditioning
|
68 |
+
- mmd-baroque_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
69 |
+
- mmd-classical_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
70 |
+
- mmd-noncontemporary_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
71 |
+
- mmd-pop_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
72 |
+
- mmd-renaissance_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
73 |
+
|
74 |
+
### MetaMIDI Dataset full
|
75 |
+
|
76 |
+
These models were trained on roundabout 400K MIDI files from the MetaMIDI dataset.
|
77 |
+
|
78 |
+
- mmd-full_mmmtrack_4bars_d-2048: 4 bars resolution, note density conditioning
|
79 |
+
- mmd-full_mmmtrack_8bars_d-2048: 8 bars resolution, note density conditioning
|
80 |
+
- mmd-full_mmmtrack_4bars_chords-d-2048: 8 bars resolution, note density conditioning, chord conditioning (most powerful model in the entire group)
|
81 |
|
82 |
## Intended uses & limitations
|
83 |
|