--- license: mit base_model: stabilityai/stable-diffusion-xl-base-1.0 tags: - stable-diffusion - stable-diffusion-diffusers - text-to-image - diffusers - lora inference: true --- # sdxl-ugly-sonic-lora ![](img/example1.webp) A LoRA for SDXL 1.0 Base which generates Ugly Sonic, using `sonic the hedgehog` as the trigger keywords. ## Usage The LoRA can be loaded using `load_lora_weights` like any other LoRA in `diffusers`: ```py import torch from diffusers import DiffusionPipeline, AutoencoderKL vae = AutoencoderKL.from_pretrained( "madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16 ) base = DiffusionPipeline.from_pretrained( "stabilityai/stable-diffusion-xl-base-1.0", vae=vae, torch_dtype=torch.float16, variant="fp16", use_safetensors=True ) base.load_lora_weights("minimaxir/sdxl-ugly-sonic-lora") _ = base.to("cuda") ``` During image generation, use `sonic the hedgehog` in the prompt. ## Examples For all generations, the negative prompt used is `blurry, low quality`. Prompt weighting is done using the [compel](https://github.com/damian0815/compel) syntax. `sonic the hedgehog relaxing on a couch, renaissance painting, (oil on canvas, aged, worn)++++` (cfg = 13) ![](img/example2.webp) `a profile of sonic the hedgehog sitting at a desk deep in thought, (pixel art)++++, award-winning photo for vanity fair` (cfg = 13) ![](img/example3.webp) `anatomical diagram of sonic the hedgehog, (highly detailed)++++` (cfg = 13) ![](img/example4.webp) `sonic the hedgehog (eating at McDonald's)++, Ukiyo-e, minimalistic vector art` (cfg = 13) ![](img/example5.webp) `(hyperrealistic++ death metal album cover)+++ featuring edgy moody realistic human sonic the hedgehog, edgy and moody` (cfg = 13) ![](img/example6.webp) ## Methodology This LoRA was trained on frame-by-frame analysis of the [original 1080p trailer](https://www.youtube.com/watch?v=4mW9FE5ILJs) featuring "Ugly Sonic". Square-crops of Ugly Sonic were extracted and AI-upscaled to 1080p. The use of `sonic the hedgehog` as the trigger keywords ensures that you won't generate the _other_ hedgehog by accident. ## Notes - The CGI style of Ugly Sonic may overpower other style prompts. Therefore, you should weight any style prompts much higher.