Training in progress, step 25

adapter_config.json

@@ -0,0 +1,29 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2.5-3B-Instruct",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v_proj",
+    "q_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f5751571a9956fe5bdcbc568380b0db5c7833099ee8f3de8cceecf0f16fb755
+size 14764792

generation_log.txt

@@ -0,0 +1,41 @@
+
+=== Step 25 ===
+Time: 2024-11-22 23:28:29
+Checkpoint: checkpoint-25
+Output: What should we make a song about today?  We have to be original.  So here are some ideas:
+
+- A friend of mine is doing an album of songs about the Beatles, so that’s one idea.
+
+- The song “Til I Die” by John Lennon, which was his first single after he got out of prison.
+
+- I’m working on a new song called “The Day They Killed Him,” about the day Lennon was killed.
+
+- I’m also writing a song about the day John Lennon was shot in
+--------------------------------------------------
+
+=== Step 50 ===
+Time: 2024-11-22 23:28:41
+Checkpoint: checkpoint-50
+Output: What should we make a song about today? It's easy to think that songs are about the things that happen in our lives, but really they're about what happens inside of us. So what is happening inside of you?
+If you could sing it, then it's a song! Even if you can't sing it, if you can tell me what it is, then it's a song!
+So what is it that's happening inside of you today? What's your favorite song about?
+I love that! I have a few favorites.
+
+--------------------------------------------------
+
+=== Step 75 ===
+Time: 2024-11-22 23:28:54
+Checkpoint: checkpoint-75
+Output: What should we make a song about today? A song about something you like to do, or someone you love. A song about something you don’t understand, or something that makes you feel sad. A song about something you’re curious about, or something that’s made you wonder. A song about something you want to change in the world, or something you hope will happen soon.
+A song about anything!
+It’s time for a song.
+You can write your own song or use one of our pre-made ones. You can sing it yourself
+--------------------------------------------------
+
+=== Step 100 ===
+Time: 2024-11-22 23:29:07
+Checkpoint: checkpoint-100
+Output: What should we make a song about today? It's hard to say. I'm not sure what the best way is to make a song about the day. Should it be a song about the day itself, or a song about the things that happened in the day? Or maybe it should be a song about the people who were in the day?
+It's hard to say. I don't think there is one right answer. But I do think there are some songs that would work really well for each of those ideas.
+A song about the
+--------------------------------------------------

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33de97aff533791ec2b84b63e6f5490d3f1a724b6eb47ea8c00303345a7792d9
+size 5368