Update README.md
Browse files
README.md
CHANGED
@@ -22,10 +22,47 @@ library_name: diffusers
|
|
22 |
|
23 |
- **Based from SD2.1.** I know SD2.1 is hopeless, but it is the best environment for a PoC and to improve my idea.
|
24 |
|
|
|
|
|
25 |
- See [simplified description in CivitAI](https://civitai.com/articles/3409/diagram-of-unet-and-exotic-merging-methods) and [full article in Github](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/README_SD2.MD)
|
26 |
|
27 |
- *It won't look great, but at least you won't get Miku Hatsune when prompting Suzumiya Haruhi, or having a black hair boy when prompting Link.*
|
28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
## Baseline ##
|
30 |
|
31 |
- **Uniform merge** of 10 UNETs and 4 CLIPs.
|
@@ -49,7 +86,7 @@ Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 802596511, Size: 1024x576, Model
|
|
49 |
|
50 |
### Major difference of methodology ###
|
51 |
|
52 |
-
- **Model selection.** *NP Hard*. Still
|
53 |
|
54 |
- This time the CLIP is **a merge of 4 CLIPS** instead of the original SD CLIP. I thought the SD2.1's CLIP is bad in performance, but in fact it is still decent, but I found some more useful and merge them together.
|
55 |
|
@@ -66,7 +103,7 @@ Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 802596511, Size: 1024x576, Model
|
|
66 |
|`_203`|[E621 Rising v2](https://civitai.com/models/32423/e621-rising-v2-a-stable-diffusion-21-furry-model?modelVersionId=38862)|||
|
67 |
|`_204`|[hakoMayD](https://civitai.com/models/72668/hakomayd?modelVersionId=77394)|Y||
|
68 |
|`_205`|[Illuminati Diffusion v1.1](https://civitai.com/models/11193/illuminati-diffusion-v11?modelVersionId=13259)|||
|
69 |
-
|`_206`|[Mishi Anime](https://civitai.com/models/7742/mishi-anime?modelVersionId=9125)|Y||
|
70 |
|`_207`|[NijiDiffusion](https://civitai.com/models/55495/nijidiffusion?modelVersionId=59885)|||
|
71 |
|`_208`|[Plat Diffusion v1.3.1](https://huggingface.co/p1atdev/plat-diffusion)|||
|
72 |
|`_209`|[PVC v4](https://huggingface.co/p1atdev/pvc-v4/tree/checkpoints)|||
|
@@ -80,7 +117,8 @@ Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 802596511, Size: 1024x576, Model
|
|
80 |
|`_217`|[Stable Diffusion v2-1](https://huggingface.co/stabilityai/stable-diffusion-2-1)||Y|
|
81 |
|`_218`|[RuminationDiffusion](https://huggingface.co/JosephusCheung/RuminationDiffusion)|Y||
|
82 |
|`_219`|[Scream-SemiRealistic](https://civitai.com/models/99040/sd2scream-semirealistic?modelVersionId=140498)|Y||
|
83 |
-
|`_220`|[Realgar-v2.1](https://civitai.com/models/70713?modelVersionId=111486)
|
84 |
|`_221`|[RheaSilvia](https://civitai.com/models/68163?modelVersionId=78114)|Y||
|
85 |
|`_222`|[MuaccaMix](https://civitai.com/models/26087/muaccamix?modelVersionId=112322)|Y||
|
86 |
-
|`_223`|[hakoMayBoy](https://huggingface.co/852wa/hakoMay/blob/main/hakoMayBoy.safetensors)|Y||
|
|
|
|
22 |
|
23 |
- **Based from SD2.1.** I know SD2.1 is hopeless, but it is the best environment for a PoC and to improve my idea.
|
24 |
|
25 |
+
- ["All models are wrong but some are useful."](https://en.wikipedia.org/wiki/All_models_are_wrong)
|
26 |
+
|
27 |
- See [simplified description in CivitAI](https://civitai.com/articles/3409/diagram-of-unet-and-exotic-merging-methods) and [full article in Github](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/README_SD2.MD)
|
28 |
|
29 |
- *It won't look great, but at least you won't get Miku Hatsune when prompting Suzumiya Haruhi, or having a black hair boy when prompting Link.*
|
30 |
|
31 |
+
## "210b" ##
|
32 |
+
|
33 |
+
- Special case of "Add difference". Merge of "Extended" and "Reinforced".
|
34 |
+
- 12 UNETs with 4 CLIPs.
|
35 |
+
|
36 |
+
- Current version: `210b-AstolfoMix-211209b.safetensors`
|
37 |
+
- Recommended version: "210b"
|
38 |
+
- Recommended CFG: 6.0
|
39 |
+
|
40 |
+
![240240-802596570-1536-864-6-192-20240114013047.jpg](https://huggingface.co/6DammK9/AstolfoMix-SD2/resolve/main/240240-802596570-1536-864-6-192-20240114013047.jpg)
|
41 |
+
|
42 |
+
```
|
43 |
+
parameters
|
44 |
+
(aesthetic:0), (quality:0), (solo:0), (anime:0), (boy:0), (construction helmet:0.98), [[jeans]], [[braid]], [astolfo], [[new york]]
|
45 |
+
Negative prompt: (worst:0), (low:0), (bad:0), (exceptional:0), (masterpiece:0), (comic:0), (extra:0), (lowres:0), (photorealisitc:0)
|
46 |
+
Steps: 192, Sampler: Euler, CFG scale: 6, Seed: 802596570, Size: 1024x576, Model hash: 13696ee702, Model: 210b-AstolfoMix-211209b, VAE hash: df3c506e51, VAE: vae-ft-mse-840000-ema-pruned.ckpt, Denoising strength: 0.7, Clip skip: 2, FreeU Stages: "[{\"backbone_factor\": 1.1, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.2, \"skip_factor\": 0.2}]", FreeU Schedule: "0.0, 1.0, 0.0", FreeU Version: 2, Hires upscale: 1.5, Hires upscaler: Latent, Dynamic thresholding enabled: True, Mimic scale: 1, Separate Feature Channels: False, Scaling Startpoint: MEAN, Variability Measure: AD, Interpolate Phi: 0.3, Threshold percentile: 100, Version: v1.7.0
|
47 |
+
```
|
48 |
+
|
49 |
+
## Reinforced ##
|
50 |
+
|
51 |
+
- Using AutoMBW (bayesian merger but less powerful) for 10 models.
|
52 |
+
|
53 |
+
- Current version: `209b-AstolfoMix-207b_208b.safetensors`
|
54 |
+
- Recommended version: "209b"
|
55 |
+
- Recommended CFG: 6.0
|
56 |
+
|
57 |
+
![240126-372021954-1536-864-6-256-20240111000506.jpg](https://huggingface.co/6DammK9/AstolfoMix-SD2/resolve/main/240126-372021954-1536-864-6-256-20240111000506.jpg)
|
58 |
+
|
59 |
+
```
|
60 |
+
parameters
|
61 |
+
(aesthetic:0), (quality:0), (anime:0), (race queen:0.98), [[braid]], [[bulge]], [astolfo], [[[[nascar, nurburgring]]]]
|
62 |
+
Negative prompt: (worst:0), (low:0), (bad:0), (exceptional:0), (masterpiece:0), (comic:0), (extra:0), (lowres:0), (photorealisitc:0), (breasts:0.5)
|
63 |
+
Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 372021954, Size: 1024x576, Model hash: 510ede6f03, Model: 209b-AstolfoMix-207b_208b, VAE hash: df3c506e51, VAE: vae-ft-mse-840000-ema-pruned.ckpt, Denoising strength: 0.7, Clip skip: 2, FreeU Stages: "[{\"backbone_factor\": 1.1, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.2, \"skip_factor\": 0.2}]", FreeU Schedule: "0.0, 1.0, 0.0", FreeU Version: 2, Hires upscale: 1.5, Hires steps: 64, Hires upscaler: Latent, Dynamic thresholding enabled: True, Mimic scale: 1, Separate Feature Channels: False, Scaling Startpoint: MEAN, Variability Measure: AD, Interpolate Phi: 0.3, Threshold percentile: 100, Version: v1.7.0
|
64 |
+
```
|
65 |
+
|
66 |
## Baseline ##
|
67 |
|
68 |
- **Uniform merge** of 10 UNETs and 4 CLIPs.
|
|
|
86 |
|
87 |
### Major difference of methodology ###
|
88 |
|
89 |
+
- **Model selection.** *NP Hard*. Still 12 UNETs, but filtered from 24 models found. Most models are unuseable with its UNET / CLIP / VAE combo.
|
90 |
|
91 |
- This time the CLIP is **a merge of 4 CLIPS** instead of the original SD CLIP. I thought the SD2.1's CLIP is bad in performance, but in fact it is still decent, but I found some more useful and merge them together.
|
92 |
|
|
|
103 |
|`_203`|[E621 Rising v2](https://civitai.com/models/32423/e621-rising-v2-a-stable-diffusion-21-furry-model?modelVersionId=38862)|||
|
104 |
|`_204`|[hakoMayD](https://civitai.com/models/72668/hakomayd?modelVersionId=77394)|Y||
|
105 |
|`_205`|[Illuminati Diffusion v1.1](https://civitai.com/models/11193/illuminati-diffusion-v11?modelVersionId=13259)|||
|
106 |
+
|`_206`|[Mishi Anime](https://civitai.com/models/7742/mishi-anime?modelVersionId=9125)|Y(a)||
|
107 |
|`_207`|[NijiDiffusion](https://civitai.com/models/55495/nijidiffusion?modelVersionId=59885)|||
|
108 |
|`_208`|[Plat Diffusion v1.3.1](https://huggingface.co/p1atdev/plat-diffusion)|||
|
109 |
|`_209`|[PVC v4](https://huggingface.co/p1atdev/pvc-v4/tree/checkpoints)|||
|
|
|
117 |
|`_217`|[Stable Diffusion v2-1](https://huggingface.co/stabilityai/stable-diffusion-2-1)||Y|
|
118 |
|`_218`|[RuminationDiffusion](https://huggingface.co/JosephusCheung/RuminationDiffusion)|Y||
|
119 |
|`_219`|[Scream-SemiRealistic](https://civitai.com/models/99040/sd2scream-semirealistic?modelVersionId=140498)|Y||
|
120 |
+
|`_220`|[Realgar-v2.1](https://civitai.com/models/70713?modelVersionId=111486)|Y|Y|
|
121 |
|`_221`|[RheaSilvia](https://civitai.com/models/68163?modelVersionId=78114)|Y||
|
122 |
|`_222`|[MuaccaMix](https://civitai.com/models/26087/muaccamix?modelVersionId=112322)|Y||
|
123 |
+
|`_223`|[hakoMayBoy](https://huggingface.co/852wa/hakoMay/blob/main/hakoMayBoy.safetensors)|Y||
|
124 |
+
|`_224`|[Hurricane](https://civitai.com/models/204162?modelVersionId=240829)|Y(a)||
|