|
--- |
|
tags: |
|
- text-to-image |
|
- lora |
|
- diffusers |
|
- template:diffusion-lora |
|
widget: |
|
- text: >- |
|
fractalLand A detailed fractal with vibrant yellow, pink and black spikey |
|
tree shaped fractal |
|
output: |
|
url: images/example_rc3dawiq6.png |
|
- text: fractalLand A detailed fractal with vibrant blue, black and orange blocks. |
|
output: |
|
url: images/example_hru8llyf2.png |
|
- text: fractalLand A detailed fractal with vibrant red, black and green spirals. |
|
output: |
|
url: images/example_6m9wad7a2.png |
|
- text: >- |
|
fractalLand A detailed fractal with vibrant red, & mint green gradient, with |
|
spikey tree shaped fractals |
|
output: |
|
url: images/example_r5evy947z.png |
|
- text: >- |
|
fractalLand A detailed fractal with vibrant purple, mint green gradient, |
|
with spikey tree shaped fractals |
|
output: |
|
url: images/example_ajqqlsm6d.png |
|
- text: fractalLand Gods fractal |
|
output: |
|
url: images/godsdope.jpg |
|
- text: gods fractalLand |
|
output: |
|
url: images/fractalland.jpg |
|
- text: fractalLand 3d fractal pyramid structure temple |
|
output: |
|
url: images/example_svljvqcrp.png |
|
- text: fractalLand 3d fractal futuristic cityscape |
|
output: |
|
url: images/example_dw9np3584.png |
|
- text: >- |
|
fractalLand a computer generated symmetrical fractal with rainbow coloring, |
|
shaped as a futuristic hyper dimensional cityscape in the 4Dimensional plane |
|
output: |
|
url: images/example_6vjl3fzz6.png |
|
- text: >- |
|
fractalLand a computer generated symmetrical fractal with rainbow coloring, |
|
shaped as a futuristic hyper dimensional cityscape in the 4Dimensional plane |
|
output: |
|
url: images/example_kqf344nf6.png |
|
- text: >- |
|
fractalLand a computer generated symmetrical fractal with rainbow coloring, |
|
shaped as a futuristic hyper dimensional cityscape in simulated 3D terrain |
|
output: |
|
url: images/example_h7iuq839p.png |
|
- text: fractalLand bush of leaves hexagonally symmetrical with light and shadow |
|
output: |
|
url: images/example_0u9ptutbi.png |
|
- text: fractalLand bush of leaves hexagonally symmetrical with light and shadow |
|
output: |
|
url: images/example_hl91btsf5.png |
|
- text: fractalLand bush of leaves hexagonally symmetrical with light and shadow |
|
output: |
|
url: images/example_xdu79qwi5.png |
|
- text: fractalLand symmetrical fractal robot robot |
|
output: |
|
url: images/example_qee85ftzy.png |
|
- text: fractalLand fractal ultra symmetrical geometric robot |
|
output: |
|
url: images/example_1amktzo2c.png |
|
- text: >- |
|
fractalLand 3d running engine for greasy hot mechanical mechanism |
|
hexagonally symmetrical with reflections and dynamic components |
|
output: |
|
url: images/example_sz0ce5dta.png |
|
- text: >- |
|
fractalLand running engine for greasy hot mechanical robotic mechanism |
|
hexagonally symmetrical with reflections and dynamic components |
|
output: |
|
url: images/example_2xn5zlqud.png |
|
- text: >- |
|
fractalLand 3d running engine for greasy hot mechanical mechanism |
|
hexagonally symmetrical with reflections and dynamic components |
|
output: |
|
url: images/example_cjr5h5a7s.png |
|
- text: fractalLand fractal ultra symmetrical geometric robot |
|
output: |
|
url: images/example_i7kbpf4rk.png |
|
base_model: black-forest-labs/FLUX.1-dev |
|
instance_prompt: fractalLand |
|
license: apache-2.0 |
|
|
|
--- |
|
# FLUX.1-dev-LoRA-AutumnSpringTrees |
|
|
|
<Gallery /> |
|
|
|
## Model description |
|
|
|
# FLUX.1-dev-LoRA-FractalLand-v0.1 LoRA |
|
|
|
A LoRA fine-tune for FLUX.1 [dev] that specializes in generating fractals. Trained using [Fluxgym](https://github.com/cocktailpeanut/fluxgym) by cocktail peanut, utilizing my own Fractal collection that I have made over the years with [UltraFractal](https://www.ultrafractal.com/) plotting software, deploying novel complex series for an experimental fractal dataset. (borch's ultra fractal scripts repo coming...) |
|
|
|
## Overview |
|
This LoRA enhances FLUX.1 [dev]'s ability to generate detailed fractals patterns with vibrant colors, and symmetrical details. Use the trigger word `fractalLand` to activate the fractal pattern capabilities. |
|
|
|
## Installation |
|
|
|
First, ensure you have FLUX.1 [dev] installed: |
|
|
|
```python |
|
# Install |
|
pip install -U diffusers |
|
# Loading with Diffusers |
|
import torch |
|
from diffusers import FluxPipeline |
|
# Load base model |
|
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16) |
|
pipe.enable_model_cpu_offload() |
|
# Load and apply LoRA weights |
|
pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-FractalLand-v0.1") |
|
# Generate image |
|
prompt = "fractalLand A detailed fractal with vibrant red, black and green spirals." |
|
image = pipe( |
|
prompt, |
|
height=1024, |
|
width=1024, |
|
guidance_scale=3.5, |
|
num_inference_steps=50, |
|
max_sequence_length=512, |
|
generator=torch.Generator("cpu").manual_seed(0) |
|
).images[0] |
|
image.save("autumn-scene.png") |
|
# Unload LoRA weights if needed |
|
pipe.unload_lora_weights() |
|
# Optional: Merge LoRA weights permanently |
|
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16) |
|
pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-FractalLand-v0.1") |
|
pipe.merge_lora_weights() |
|
pipe.save_pretrained("FLUX.1-dev-LoRA-FractalLand-v0.1-merged") |
|
``` |
|
|
|
# Trigger Word |
|
|
|
Use fractalLand in your prompts to activate the fractal elements. |
|
Best results achieved when placing the trigger word at the start of the prompt |
|
|
|
Prompt Examples |
|
"fractalLand A detailed fractal with vibrant red, black and green spirals." |
|
"fractalLand A symetrical round fractal with vibrant yellow, black and pink waves." |
|
"fractalLand A detailed fractal with vibrant blue, black and orange blocks." |
|
|
|
# Limitations |
|
|
|
This is a LoRA for FLUX.1 [dev] and requires the base model to function |
|
Limited training data, and poorly annotated data, leads this model to be confused when prompted, next generations will deploy more specific references to the names of specific fractal formulas, shapes, colors, and coordinates in the complex plane. |
|
Inherits base limitations from FLUX.1 [dev] |
|
|
|
License |
|
This LoRA falls under the same licensing terms as FLUX.1 [dev]. Please refer to the base model's license for usage terms. |
|
Credits |
|
|
|
Base model: FLUX.1 [dev] by Black Forest Labs |
|
LoRA training and development: [Borcherding at BorchInk] |
|
|
|
|
|
## Trigger words |
|
|
|
You should use `fractalLand` to trigger the image generation. |
|
|
|
|
|
## Download model |
|
|
|
Weights for this model are available in Safetensors format. |
|
|
|
[Download](/Borcherding/FLUX.1-dev-LoRA-FractalLand-v0.1/tree/main) them in the Files & versions tab. |