6DammK9 commited on
Commit
bd8c186
·
verified ·
1 Parent(s): 60b0d90

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -4
README.md CHANGED
@@ -22,10 +22,47 @@ library_name: diffusers
22
 
23
  - **Based from SD2.1.** I know SD2.1 is hopeless, but it is the best environment for a PoC and to improve my idea.
24
 
 
 
25
  - See [simplified description in CivitAI](https://civitai.com/articles/3409/diagram-of-unet-and-exotic-merging-methods) and [full article in Github](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/README_SD2.MD)
26
 
27
  - *It won't look great, but at least you won't get Miku Hatsune when prompting Suzumiya Haruhi, or having a black hair boy when prompting Link.*
28
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  ## Baseline ##
30
 
31
  - **Uniform merge** of 10 UNETs and 4 CLIPs.
@@ -49,7 +86,7 @@ Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 802596511, Size: 1024x576, Model
49
 
50
  ### Major difference of methodology ###
51
 
52
- - **Model selection.** *NP Hard*. Still 10 UNETs, but filtered from 23 models found. Most models are unuseable with its UNET / CLIP / VAE combo.
53
 
54
  - This time the CLIP is **a merge of 4 CLIPS** instead of the original SD CLIP. I thought the SD2.1's CLIP is bad in performance, but in fact it is still decent, but I found some more useful and merge them together.
55
 
@@ -66,7 +103,7 @@ Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 802596511, Size: 1024x576, Model
66
  |`_203`|[E621 Rising v2](https://civitai.com/models/32423/e621-rising-v2-a-stable-diffusion-21-furry-model?modelVersionId=38862)|||
67
  |`_204`|[hakoMayD](https://civitai.com/models/72668/hakomayd?modelVersionId=77394)|Y||
68
  |`_205`|[Illuminati Diffusion v1.1](https://civitai.com/models/11193/illuminati-diffusion-v11?modelVersionId=13259)|||
69
- |`_206`|[Mishi Anime](https://civitai.com/models/7742/mishi-anime?modelVersionId=9125)|Y||
70
  |`_207`|[NijiDiffusion](https://civitai.com/models/55495/nijidiffusion?modelVersionId=59885)|||
71
  |`_208`|[Plat Diffusion v1.3.1](https://huggingface.co/p1atdev/plat-diffusion)|||
72
  |`_209`|[PVC v4](https://huggingface.co/p1atdev/pvc-v4/tree/checkpoints)|||
@@ -80,7 +117,8 @@ Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 802596511, Size: 1024x576, Model
80
  |`_217`|[Stable Diffusion v2-1](https://huggingface.co/stabilityai/stable-diffusion-2-1)||Y|
81
  |`_218`|[RuminationDiffusion](https://huggingface.co/JosephusCheung/RuminationDiffusion)|Y||
82
  |`_219`|[Scream-SemiRealistic](https://civitai.com/models/99040/sd2scream-semirealistic?modelVersionId=140498)|Y||
83
- |`_220`|[Realgar-v2.1](https://civitai.com/models/70713?modelVersionId=111486)||Y|
84
  |`_221`|[RheaSilvia](https://civitai.com/models/68163?modelVersionId=78114)|Y||
85
  |`_222`|[MuaccaMix](https://civitai.com/models/26087/muaccamix?modelVersionId=112322)|Y||
86
- |`_223`|[hakoMayBoy](https://huggingface.co/852wa/hakoMay/blob/main/hakoMayBoy.safetensors)|Y||
 
 
22
 
23
  - **Based from SD2.1.** I know SD2.1 is hopeless, but it is the best environment for a PoC and to improve my idea.
24
 
25
+ - ["All models are wrong but some are useful."](https://en.wikipedia.org/wiki/All_models_are_wrong)
26
+
27
  - See [simplified description in CivitAI](https://civitai.com/articles/3409/diagram-of-unet-and-exotic-merging-methods) and [full article in Github](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/README_SD2.MD)
28
 
29
  - *It won't look great, but at least you won't get Miku Hatsune when prompting Suzumiya Haruhi, or having a black hair boy when prompting Link.*
30
 
31
+ ## "210b" ##
32
+
33
+ - Special case of "Add difference". Merge of "Extended" and "Reinforced".
34
+ - 12 UNETs with 4 CLIPs.
35
+
36
+ - Current version: `210b-AstolfoMix-211209b.safetensors`
37
+ - Recommended version: "210b"
38
+ - Recommended CFG: 6.0
39
+
40
+ ![240240-802596570-1536-864-6-192-20240114013047.jpg](https://huggingface.co/6DammK9/AstolfoMix-SD2/resolve/main/240240-802596570-1536-864-6-192-20240114013047.jpg)
41
+
42
+ ```
43
+ parameters
44
+ (aesthetic:0), (quality:0), (solo:0), (anime:0), (boy:0), (construction helmet:0.98), [[jeans]], [[braid]], [astolfo], [[new york]]
45
+ Negative prompt: (worst:0), (low:0), (bad:0), (exceptional:0), (masterpiece:0), (comic:0), (extra:0), (lowres:0), (photorealisitc:0)
46
+ Steps: 192, Sampler: Euler, CFG scale: 6, Seed: 802596570, Size: 1024x576, Model hash: 13696ee702, Model: 210b-AstolfoMix-211209b, VAE hash: df3c506e51, VAE: vae-ft-mse-840000-ema-pruned.ckpt, Denoising strength: 0.7, Clip skip: 2, FreeU Stages: "[{\"backbone_factor\": 1.1, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.2, \"skip_factor\": 0.2}]", FreeU Schedule: "0.0, 1.0, 0.0", FreeU Version: 2, Hires upscale: 1.5, Hires upscaler: Latent, Dynamic thresholding enabled: True, Mimic scale: 1, Separate Feature Channels: False, Scaling Startpoint: MEAN, Variability Measure: AD, Interpolate Phi: 0.3, Threshold percentile: 100, Version: v1.7.0
47
+ ```
48
+
49
+ ## Reinforced ##
50
+
51
+ - Using AutoMBW (bayesian merger but less powerful) for 10 models.
52
+
53
+ - Current version: `209b-AstolfoMix-207b_208b.safetensors`
54
+ - Recommended version: "209b"
55
+ - Recommended CFG: 6.0
56
+
57
+ ![240126-372021954-1536-864-6-256-20240111000506.jpg](https://huggingface.co/6DammK9/AstolfoMix-SD2/resolve/main/240126-372021954-1536-864-6-256-20240111000506.jpg)
58
+
59
+ ```
60
+ parameters
61
+ (aesthetic:0), (quality:0), (anime:0), (race queen:0.98), [[braid]], [[bulge]], [astolfo], [[[[nascar, nurburgring]]]]
62
+ Negative prompt: (worst:0), (low:0), (bad:0), (exceptional:0), (masterpiece:0), (comic:0), (extra:0), (lowres:0), (photorealisitc:0), (breasts:0.5)
63
+ Steps: 256, Sampler: Euler, CFG scale: 6, Seed: 372021954, Size: 1024x576, Model hash: 510ede6f03, Model: 209b-AstolfoMix-207b_208b, VAE hash: df3c506e51, VAE: vae-ft-mse-840000-ema-pruned.ckpt, Denoising strength: 0.7, Clip skip: 2, FreeU Stages: "[{\"backbone_factor\": 1.1, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.2, \"skip_factor\": 0.2}]", FreeU Schedule: "0.0, 1.0, 0.0", FreeU Version: 2, Hires upscale: 1.5, Hires steps: 64, Hires upscaler: Latent, Dynamic thresholding enabled: True, Mimic scale: 1, Separate Feature Channels: False, Scaling Startpoint: MEAN, Variability Measure: AD, Interpolate Phi: 0.3, Threshold percentile: 100, Version: v1.7.0
64
+ ```
65
+
66
  ## Baseline ##
67
 
68
  - **Uniform merge** of 10 UNETs and 4 CLIPs.
 
86
 
87
  ### Major difference of methodology ###
88
 
89
+ - **Model selection.** *NP Hard*. Still 12 UNETs, but filtered from 24 models found. Most models are unuseable with its UNET / CLIP / VAE combo.
90
 
91
  - This time the CLIP is **a merge of 4 CLIPS** instead of the original SD CLIP. I thought the SD2.1's CLIP is bad in performance, but in fact it is still decent, but I found some more useful and merge them together.
92
 
 
103
  |`_203`|[E621 Rising v2](https://civitai.com/models/32423/e621-rising-v2-a-stable-diffusion-21-furry-model?modelVersionId=38862)|||
104
  |`_204`|[hakoMayD](https://civitai.com/models/72668/hakomayd?modelVersionId=77394)|Y||
105
  |`_205`|[Illuminati Diffusion v1.1](https://civitai.com/models/11193/illuminati-diffusion-v11?modelVersionId=13259)|||
106
+ |`_206`|[Mishi Anime](https://civitai.com/models/7742/mishi-anime?modelVersionId=9125)|Y(a)||
107
  |`_207`|[NijiDiffusion](https://civitai.com/models/55495/nijidiffusion?modelVersionId=59885)|||
108
  |`_208`|[Plat Diffusion v1.3.1](https://huggingface.co/p1atdev/plat-diffusion)|||
109
  |`_209`|[PVC v4](https://huggingface.co/p1atdev/pvc-v4/tree/checkpoints)|||
 
117
  |`_217`|[Stable Diffusion v2-1](https://huggingface.co/stabilityai/stable-diffusion-2-1)||Y|
118
  |`_218`|[RuminationDiffusion](https://huggingface.co/JosephusCheung/RuminationDiffusion)|Y||
119
  |`_219`|[Scream-SemiRealistic](https://civitai.com/models/99040/sd2scream-semirealistic?modelVersionId=140498)|Y||
120
+ |`_220`|[Realgar-v2.1](https://civitai.com/models/70713?modelVersionId=111486)|Y|Y|
121
  |`_221`|[RheaSilvia](https://civitai.com/models/68163?modelVersionId=78114)|Y||
122
  |`_222`|[MuaccaMix](https://civitai.com/models/26087/muaccamix?modelVersionId=112322)|Y||
123
+ |`_223`|[hakoMayBoy](https://huggingface.co/852wa/hakoMay/blob/main/hakoMayBoy.safetensors)|Y||
124
+ |`_224`|[Hurricane](https://civitai.com/models/204162?modelVersionId=240829)|Y(a)||