Borcherding commited on
Commit
24f7c3c
·
verified ·
1 Parent(s): 4b02db3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +95 -3
README.md CHANGED
@@ -1,3 +1,95 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - text-to-image
4
+ - lora
5
+ - diffusers
6
+ - template:diffusion-lora
7
+
8
+ base_model: black-forest-labs/FLUX.1-dev
9
+ instance_prompt: fractalLand
10
+ license: apache-2.0
11
+
12
+ ---
13
+ # FLUX.1-dev-LoRA-AutumnSpringTrees
14
+
15
+ <Gallery />
16
+
17
+ ## Model description
18
+
19
+ # FLUX.1-dev-LoRA-FractalLand-v0.1 LoRA
20
+
21
+ A LoRA fine-tune for FLUX.1 [dev] that specializes in generating fractals. Trained using ![Fluxgym](https://github.com/cocktailpeanut/fluxgym) by cocktail peanut, utilizing my own Fractal collection that I have made over the years with ![UltraFractal](https://www.ultrafractal.com/) plotting software, deploying novel complex series for an experimental fractal dataset. (borch's ultra fractal scripts repo coming...)
22
+
23
+ ## Overview
24
+ This LoRA enhances FLUX.1 [dev]&#39;s ability to generate detailed fractals patterns with vibrant colors, and symmetrical details. Use the trigger word &#x60;fractalLand&#x60; to activate the fractal pattern capabilities.
25
+
26
+ ## Installation
27
+
28
+ First, ensure you have FLUX.1 [dev] installed:
29
+
30
+ ```python
31
+ # Install
32
+ pip install -U diffusers
33
+ # Loading with Diffusers
34
+ import torch
35
+ from diffusers import FluxPipeline
36
+ # Load base model
37
+ pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
38
+ pipe.enable_model_cpu_offload()
39
+ # Load and apply LoRA weights
40
+ pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-FractalLand-v0.1")
41
+ # Generate image
42
+ prompt = "fractalLand A detailed fractal with vibrant red, black and green spirals."
43
+ image = pipe(
44
+ prompt,
45
+ height=1024,
46
+ width=1024,
47
+ guidance_scale=3.5,
48
+ num_inference_steps=50,
49
+ max_sequence_length=512,
50
+ generator=torch.Generator("cpu").manual_seed(0)
51
+ ).images[0]
52
+ image.save("autumn-scene.png")
53
+ # Unload LoRA weights if needed
54
+ pipe.unload_lora_weights()
55
+ # Optional: Merge LoRA weights permanently
56
+ pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
57
+ pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-AutumnSpringTrees")
58
+ pipe.merge_lora_weights()
59
+ pipe.save_pretrained("FLUX.1-dev-LoRA-AutumnSpringTrees-merged")
60
+ ```
61
+
62
+ # Trigger Word
63
+
64
+ Use fractalLand in your prompts to activate the fractal elements.
65
+ Best results achieved when placing the trigger word at the start of the prompt
66
+
67
+ Prompt Examples
68
+ &quot;fractalLand A detailed fractal with vibrant red, black and green spirals.&quot;
69
+ &quot;fractalLand A symetrical round fractal with vibrant yellow, black and pink waves.&quot;
70
+ &quot;fractalLand A detailed fractal with vibrant blue, black and orange blocks.&quot;
71
+
72
+ # Limitations
73
+
74
+ This is a LoRA for FLUX.1 [dev] and requires the base model to function
75
+ Limited training data, and poorly annotated data, leads this model to be confused when prompted, next generations will deploy more specific references to the names of specific fractal formulas, shapes, colors, and coordinates in the complex plane.
76
+ Inherits base limitations from FLUX.1 [dev]
77
+
78
+ License
79
+ This LoRA falls under the same licensing terms as FLUX.1 [dev]. Please refer to the base model&#39;s license for usage terms.
80
+ Credits
81
+
82
+ Base model: FLUX.1 [dev] by Black Forest Labs
83
+ LoRA training and development: [Borcherding at BorchInk]
84
+
85
+
86
+ ## Trigger words
87
+
88
+ You should use `fractalLand` to trigger the image generation.
89
+
90
+
91
+ ## Download model
92
+
93
+ Weights for this model are available in Safetensors format.
94
+
95
+ [Download](/Borcherding/FLUX.1-dev-LoRA-FractalLand-v0.1/tree/main) them in the Files & versions tab.