add v3

LLM-Detector-V3-11w/README.md

@@ -0,0 +1,56 @@
+---
+license: other
+base_model: ./llama-2-7b-chat-hf
+tags:
+- llama-factory
+- lora
+- generated_from_trainer
+model-index:
+- name: llama2-7b
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# llama2-7b
+
+This model is a fine-tuned version of [./llama-2-7b-chat-hf](https://huggingface.co/./llama-2-7b-chat-hf) on the ta, the tb, the tc, the td, the te, the tf, the tg and the th datasets.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 4
+- total_train_batch_size: 32
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: cosine
+- num_epochs: 3.0
+
+### Training results
+
+
+
+### Framework versions
+
+- Transformers 4.33.0
+- Pytorch 2.1.1+cu121
+- Datasets 2.14.7
+- Tokenizers 0.13.3

LLM-Detector-V3-11w/adapter_config.json

@@ -0,0 +1,23 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "./llama-2-7b-chat-hf",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "lora_alpha": 16.0,
+  "lora_dropout": 0.1,
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "task_type": "CAUSAL_LM"
+}

LLM-Detector-V3-11w/adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b347b1e237b9d4c0e0e179d1f75553333fefa1b204baa69c4fc8eec53a2418e0
+size 16823434

LLM-Detector-V3-11w/all_results.json

@@ -0,0 +1,7 @@
+{
+    "epoch": 3.0,
+    "train_loss": 0.03027582302646779,
+    "train_runtime": 186831.816,
+    "train_samples_per_second": 1.91,
+    "train_steps_per_second": 0.06
+}

LLM-Detector-V3-11w/checkpoint-10000/README.md

@@ -0,0 +1,219 @@
+---
+library_name: peft
+base_model: ./llama-2-7b-chat-hf
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure 
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Data Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+
+
+## Training procedure
+
+
+The following `bitsandbytes` quantization config was used during training:
+- quant_method: QuantizationMethod.BITS_AND_BYTES
+- load_in_8bit: False
+- load_in_4bit: True
+- llm_int8_threshold: 6.0
+- llm_int8_skip_modules: None
+- llm_int8_enable_fp32_cpu_offload: False
+- llm_int8_has_fp16_weight: False
+- bnb_4bit_quant_type: nf4
+- bnb_4bit_use_double_quant: True
+- bnb_4bit_compute_dtype: float16
+
+### Framework versions
+
+
+- PEFT 0.6.2

LLM-Detector-V3-11w/checkpoint-10000/adapter_config.json

@@ -0,0 +1,23 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "./llama-2-7b-chat-hf",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "lora_alpha": 16.0,
+  "lora_dropout": 0.1,
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "task_type": "CAUSAL_LM"
+}

LLM-Detector-V3-11w/checkpoint-10000/adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6819f720fcc0dc21014a67b92afbec529a2247e5630de28446359429ca7f1e2d
+size 16823434

LLM-Detector-V3-11w/checkpoint-10000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf039de094cf43033d78e4253b4621b1b5470e3a61e5fcfe3e081986c7a945a5
+size 33662074

LLM-Detector-V3-11w/checkpoint-10000/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:00b7ce40285735291cef9f678608b6c4f336df409842ba575228fe594f3faa8d
+size 14244

LLM-Detector-V3-11w/checkpoint-10000/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:025b5e7ffc1afc077ea77121fab94f9d0ec396f28a05d77215027a41e48e3b62
+size 1064

LLM-Detector-V3-11w/checkpoint-10000/special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "</s>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

LLM-Detector-V3-11w/checkpoint-10000/tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

LLM-Detector-V3-11w/checkpoint-10000/tokenizer_config.json

@@ -0,0 +1,34 @@
+{
+  "bos_token": {
+    "__type": "AddedToken",
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "clean_up_tokenization_spaces": false,
+  "eos_token": {
+    "__type": "AddedToken",
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": null,
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "split_special_tokens": false,
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": {
+    "__type": "AddedToken",
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "use_default_system_prompt": true
+}

LLM-Detector-V3-11w/checkpoint-10000/trainer_state.json

@@ -0,0 +1,619 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 2.6907036189963676,
+  "eval_steps": 500,
+  "global_step": 10000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03,
+      "learning_rate": 4.9990073706856164e-05,
+      "loss": 2.3809,
+      "step": 100
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.99603027099283e-05,
+      "loss": 0.1075,
+      "step": 200
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 4.991071065046783e-05,
+      "loss": 0.0487,
+      "step": 300
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 4.984133690970033e-05,
+      "loss": 0.0357,
+      "step": 400
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 4.975223657755279e-05,
+      "loss": 0.0271,
+      "step": 500
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 4.9643480408906496e-05,
+      "loss": 0.0257,
+      "step": 600
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 4.951515476741036e-05,
+      "loss": 0.0231,
+      "step": 700
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 4.936736155689918e-05,
+      "loss": 0.0176,
+      "step": 800
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 4.920021814047156e-05,
+      "loss": 0.018,
+      "step": 900
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 4.901385724729137e-05,
+      "loss": 0.0184,
+      "step": 1000
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 4.880842686718711e-05,
+      "loss": 0.0181,
+      "step": 1100
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 4.858409013313266e-05,
+      "loss": 0.016,
+      "step": 1200
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 4.834354792422293e-05,
+      "loss": 0.0171,
+      "step": 1300
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 4.8082132142108465e-05,
+      "loss": 0.0141,
+      "step": 1400
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 4.780238675919182e-05,
+      "loss": 0.0137,
+      "step": 1500
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 4.75045339222471e-05,
+      "loss": 0.0156,
+      "step": 1600
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 4.718881015724017e-05,
+      "loss": 0.0136,
+      "step": 1700
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 4.6855466181502544e-05,
+      "loss": 0.0134,
+      "step": 1800
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 4.65047667046359e-05,
+      "loss": 0.0101,
+      "step": 1900
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 4.613699021830524e-05,
+      "loss": 0.0126,
+      "step": 2000
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 4.575635648326851e-05,
+      "loss": 0.0138,
+      "step": 2100
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.5355478705672265e-05,
+      "loss": 0.0125,
+      "step": 2200
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.4938436572178774e-05,
+      "loss": 0.0097,
+      "step": 2300
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.450556125738566e-05,
+      "loss": 0.0157,
+      "step": 2400
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.4057196509074484e-05,
+      "loss": 0.0091,
+      "step": 2500
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.359369837523941e-05,
+      "loss": 0.0131,
+      "step": 2600
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.311543492134827e-05,
+      "loss": 0.0094,
+      "step": 2700
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.2622785938060536e-05,
+      "loss": 0.0139,
+      "step": 2800
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.211614263963423e-05,
+      "loss": 0.0089,
+      "step": 2900
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.1595907353261296e-05,
+      "loss": 0.009,
+      "step": 3000
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 4.106249319957826e-05,
+      "loss": 0.0103,
+      "step": 3100
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 4.051632376460562e-05,
+      "loss": 0.0115,
+      "step": 3200
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.9957832763376815e-05,
+      "loss": 0.0106,
+      "step": 3300
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.9387463695523555e-05,
+      "loss": 0.0098,
+      "step": 3400
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.880566949309125e-05,
+      "loss": 0.0087,
+      "step": 3500
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.82129121608641e-05,
+      "loss": 0.0081,
+      "step": 3600
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.7609662409485565e-05,
+      "loss": 0.0082,
+      "step": 3700
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.699639928166532e-05,
+      "loss": 0.0067,
+      "step": 3800
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 3.6373609771769846e-05,
+      "loss": 0.0071,
+      "step": 3900
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 3.574178843909851e-05,
+      "loss": 0.0081,
+      "step": 4000
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 3.5101437015152346e-05,
+      "loss": 0.0075,
+      "step": 4100
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 3.445306400520726e-05,
+      "loss": 0.0088,
+      "step": 4200
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 3.379718428450832e-05,
+      "loss": 0.0066,
+      "step": 4300
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 3.313431868940551e-05,
+      "loss": 0.0057,
+      "step": 4400
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 3.24649936037558e-05,
+      "loss": 0.0072,
+      "step": 4500
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 3.1789740540919856e-05,
+      "loss": 0.0068,
+      "step": 4600
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 3.1109095721685525e-05,
+      "loss": 0.0068,
+      "step": 4700
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 3.0423599648453037e-05,
+      "loss": 0.008,
+      "step": 4800
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 2.9733796676020104e-05,
+      "loss": 0.0076,
+      "step": 4900
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 2.9040234579308025e-05,
+      "loss": 0.0071,
+      "step": 5000
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 2.8343464118371603e-05,
+      "loss": 0.0071,
+      "step": 5100
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 2.7644038601038813e-05,
+      "loss": 0.0082,
+      "step": 5200
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 2.6942513443527008e-05,
+      "loss": 0.0047,
+      "step": 5300
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 2.6239445729385104e-05,
+      "loss": 0.0065,
+      "step": 5400
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 2.5535393767111533e-05,
+      "loss": 0.0066,
+      "step": 5500
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 2.483091664679959e-05,
+      "loss": 0.0035,
+      "step": 5600
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 2.4126573796162015e-05,
+      "loss": 0.0048,
+      "step": 5700
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 2.3422924536287548e-05,
+      "loss": 0.0072,
+      "step": 5800
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 2.272052763748209e-05,
+      "loss": 0.0043,
+      "step": 5900
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 2.201994087554733e-05,
+      "loss": 0.008,
+      "step": 6000
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 2.1321720588848995e-05,
+      "loss": 0.0057,
+      "step": 6100
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 2.0626421236526656e-05,
+      "loss": 0.0072,
+      "step": 6200
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 1.9934594958195834e-05,
+      "loss": 0.0041,
+      "step": 6300
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 1.9246791135491982e-05,
+      "loss": 0.0065,
+      "step": 6400
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 1.8563555955804683e-05,
+      "loss": 0.0057,
+      "step": 6500
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.7885431978548305e-05,
+      "loss": 0.0032,
+      "step": 6600
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.7212957704313752e-05,
+      "loss": 0.0076,
+      "step": 6700
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.6546667147243222e-05,
+      "loss": 0.0056,
+      "step": 6800
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 1.5887089410967808e-05,
+      "loss": 0.005,
+      "step": 6900
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 1.5234748268444419e-05,
+      "loss": 0.004,
+      "step": 7000
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 1.4590161746025896e-05,
+      "loss": 0.0062,
+      "step": 7100
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.3953841712094482e-05,
+      "loss": 0.0056,
+      "step": 7200
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 1.3326293470585377e-05,
+      "loss": 0.0063,
+      "step": 7300
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 1.2708015359723158e-05,
+      "loss": 0.0057,
+      "step": 7400
+    },
+    {
+      "epoch": 2.02,
+      "learning_rate": 1.2099498356289662e-05,
+      "loss": 0.0047,
+      "step": 7500
+    },
+    {
+      "epoch": 2.04,
+      "learning_rate": 1.1501225685737607e-05,
+      "loss": 0.0032,
+      "step": 7600
+    },
+    {
+      "epoch": 2.07,
+      "learning_rate": 1.0913672438459612e-05,
+      "loss": 0.0018,
+      "step": 7700
+    },
+    {
+      "epoch": 2.1,
+      "learning_rate": 1.0337305192517294e-05,
+      "loss": 0.0029,
+      "step": 7800
+    },
+    {
+      "epoch": 2.13,
+      "learning_rate": 9.772581643129997e-06,
+      "loss": 0.0052,
+      "step": 7900
+    },
+    {
+      "epoch": 2.15,
+      "learning_rate": 9.219950239217432e-06,
+      "loss": 0.0032,
+      "step": 8000
+    },
+    {
+      "epoch": 2.18,
+      "learning_rate": 8.679849827284852e-06,
+      "loss": 0.0026,
+      "step": 8100
+    },
+    {
+      "epoch": 2.21,
+      "learning_rate": 8.152709302933523e-06,
+      "loss": 0.0051,
+      "step": 8200
+    },
+    {
+      "epoch": 2.23,
+      "learning_rate": 7.638947270273291e-06,
+      "loss": 0.0024,
+      "step": 8300
+    },
+    {
+      "epoch": 2.26,
+      "learning_rate": 7.138971709507527e-06,
+      "loss": 0.0035,
+      "step": 8400
+    },
+    {
+      "epoch": 2.29,
+      "learning_rate": 6.653179652954706e-06,
+      "loss": 0.003,
+      "step": 8500
+    },
+    {
+      "epoch": 2.31,
+      "learning_rate": 6.181956869763645e-06,
+      "loss": 0.002,
+      "step": 8600
+    },
+    {
+      "epoch": 2.34,
+      "learning_rate": 5.725677559572909e-06,
+      "loss": 0.0036,
+      "step": 8700
+    },
+    {
+      "epoch": 2.37,
+      "learning_rate": 5.284704055357578e-06,
+      "loss": 0.0013,
+      "step": 8800
+    },
+    {
+      "epoch": 2.39,
+      "learning_rate": 4.859386535699373e-06,
+      "loss": 0.002,
+      "step": 8900
+    },
+    {
+      "epoch": 2.42,
+      "learning_rate": 4.4500627467086245e-06,
+      "loss": 0.0048,
+      "step": 9000
+    },
+    {
+      "epoch": 2.45,
+      "learning_rate": 4.057057733818967e-06,
+      "loss": 0.0026,
+      "step": 9100
+    },
+    {
+      "epoch": 2.48,
+      "learning_rate": 3.680683583667599e-06,
+      "loss": 0.002,
+      "step": 9200
+    },
+    {
+      "epoch": 2.5,
+      "learning_rate": 3.321239176266211e-06,
+      "loss": 0.0039,
+      "step": 9300
+    },
+    {
+      "epoch": 2.53,
+      "learning_rate": 2.9790099476593393e-06,
+      "loss": 0.0015,
+      "step": 9400
+    },
+    {
+      "epoch": 2.56,
+      "learning_rate": 2.654267663258628e-06,
+      "loss": 0.0039,
+      "step": 9500
+    },
+    {
+      "epoch": 2.58,
+      "learning_rate": 2.3472702020329696e-06,
+      "loss": 0.0036,
+      "step": 9600
+    },
+    {
+      "epoch": 2.61,
+      "learning_rate": 2.0582613517259377e-06,
+      "loss": 0.0039,
+      "step": 9700
+    },
+    {
+      "epoch": 2.64,
+      "learning_rate": 1.7874706152630705e-06,
+      "loss": 0.0019,
+      "step": 9800
+    },
+    {
+      "epoch": 2.66,
+      "learning_rate": 1.5351130285028214e-06,
+      "loss": 0.0031,
+      "step": 9900
+    },
+    {
+      "epoch": 2.69,
+      "learning_rate": 1.301388989475863e-06,
+      "loss": 0.0034,
+      "step": 10000
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 11148,
+  "num_train_epochs": 3,
+  "save_steps": 5000,
+  "total_flos": 4.837304774375571e+18,
+  "trial_name": null,
+  "trial_params": null
+}

LLM-Detector-V3-11w/checkpoint-10000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:caa037e3a998ed330c4bc1913526fca9609cd82e17075a31e10e57e09ee90924
+size 4600

LLM-Detector-V3-11w/checkpoint-5000/README.md

@@ -0,0 +1,219 @@
+---
+library_name: peft
+base_model: ./llama-2-7b-chat-hf
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure 
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Data Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+
+
+## Training procedure
+
+
+The following `bitsandbytes` quantization config was used during training:
+- quant_method: QuantizationMethod.BITS_AND_BYTES
+- load_in_8bit: False
+- load_in_4bit: True
+- llm_int8_threshold: 6.0
+- llm_int8_skip_modules: None
+- llm_int8_enable_fp32_cpu_offload: False
+- llm_int8_has_fp16_weight: False
+- bnb_4bit_quant_type: nf4
+- bnb_4bit_use_double_quant: True
+- bnb_4bit_compute_dtype: float16
+
+### Framework versions
+
+
+- PEFT 0.6.2

LLM-Detector-V3-11w/checkpoint-5000/adapter_config.json

@@ -0,0 +1,23 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "./llama-2-7b-chat-hf",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "lora_alpha": 16.0,
+  "lora_dropout": 0.1,
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "task_type": "CAUSAL_LM"
+}

LLM-Detector-V3-11w/checkpoint-5000/adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1a422f725493f9fea2f08a231350bda5778a61eeac704736e2d87272b488f6f
+size 16823434

LLM-Detector-V3-11w/checkpoint-5000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:877676f301f24fe546eb51425f4fd69e9b38bb21710fa28ece7406e195c44e56
+size 33662074

LLM-Detector-V3-11w/checkpoint-5000/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77826f6c2d1254fa8288d813edd8d49851748cfc269881bf1b19e5ffd31100af
+size 14244

LLM-Detector-V3-11w/checkpoint-5000/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1523d8f8af5808094e286995ac3fc91b59edc76936bbf4625f51be112fabe0cc
+size 1064

LLM-Detector-V3-11w/checkpoint-5000/special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "</s>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

LLM-Detector-V3-11w/checkpoint-5000/tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

LLM-Detector-V3-11w/checkpoint-5000/tokenizer_config.json

@@ -0,0 +1,34 @@
+{
+  "bos_token": {
+    "__type": "AddedToken",
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "clean_up_tokenization_spaces": false,
+  "eos_token": {
+    "__type": "AddedToken",
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": null,
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "split_special_tokens": false,
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": {
+    "__type": "AddedToken",
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "use_default_system_prompt": true
+}

LLM-Detector-V3-11w/checkpoint-5000/trainer_state.json

@@ -0,0 +1,319 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.3453518094981838,
+  "eval_steps": 500,
+  "global_step": 5000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03,
+      "learning_rate": 4.9990073706856164e-05,
+      "loss": 2.3809,
+      "step": 100
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.99603027099283e-05,
+      "loss": 0.1075,
+      "step": 200
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 4.991071065046783e-05,
+      "loss": 0.0487,
+      "step": 300
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 4.984133690970033e-05,
+      "loss": 0.0357,
+      "step": 400
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 4.975223657755279e-05,
+      "loss": 0.0271,
+      "step": 500
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 4.9643480408906496e-05,
+      "loss": 0.0257,
+      "step": 600
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 4.951515476741036e-05,
+      "loss": 0.0231,
+      "step": 700
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 4.936736155689918e-05,
+      "loss": 0.0176,
+      "step": 800
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 4.920021814047156e-05,
+      "loss": 0.018,
+      "step": 900
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 4.901385724729137e-05,
+      "loss": 0.0184,
+      "step": 1000
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 4.880842686718711e-05,
+      "loss": 0.0181,
+      "step": 1100
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 4.858409013313266e-05,
+      "loss": 0.016,
+      "step": 1200
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 4.834354792422293e-05,
+      "loss": 0.0171,
+      "step": 1300
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 4.8082132142108465e-05,
+      "loss": 0.0141,
+      "step": 1400
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 4.780238675919182e-05,
+      "loss": 0.0137,
+      "step": 1500
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 4.75045339222471e-05,
+      "loss": 0.0156,
+      "step": 1600
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 4.718881015724017e-05,
+      "loss": 0.0136,
+      "step": 1700
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 4.6855466181502544e-05,
+      "loss": 0.0134,
+      "step": 1800
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 4.65047667046359e-05,
+      "loss": 0.0101,
+      "step": 1900
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 4.613699021830524e-05,
+      "loss": 0.0126,
+      "step": 2000
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 4.575635648326851e-05,
+      "loss": 0.0138,
+      "step": 2100
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.5355478705672265e-05,
+      "loss": 0.0125,
+      "step": 2200
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.4938436572178774e-05,
+      "loss": 0.0097,
+      "step": 2300
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.450556125738566e-05,
+      "loss": 0.0157,
+      "step": 2400
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.4057196509074484e-05,
+      "loss": 0.0091,
+      "step": 2500
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.359369837523941e-05,
+      "loss": 0.0131,
+      "step": 2600
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.311543492134827e-05,
+      "loss": 0.0094,
+      "step": 2700
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.2622785938060536e-05,
+      "loss": 0.0139,
+      "step": 2800
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.211614263963423e-05,
+      "loss": 0.0089,
+      "step": 2900
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.1595907353261296e-05,
+      "loss": 0.009,
+      "step": 3000
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 4.106249319957826e-05,
+      "loss": 0.0103,
+      "step": 3100
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 4.051632376460562e-05,
+      "loss": 0.0115,
+      "step": 3200
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.9957832763376815e-05,
+      "loss": 0.0106,
+      "step": 3300
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.9387463695523555e-05,
+      "loss": 0.0098,
+      "step": 3400
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.880566949309125e-05,
+      "loss": 0.0087,
+      "step": 3500
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.82129121608641e-05,
+      "loss": 0.0081,
+      "step": 3600
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.7609662409485565e-05,
+      "loss": 0.0082,
+      "step": 3700
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.699639928166532e-05,
+      "loss": 0.0067,
+      "step": 3800
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 3.6373609771769846e-05,
+      "loss": 0.0071,
+      "step": 3900
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 3.574178843909851e-05,
+      "loss": 0.0081,
+      "step": 4000
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 3.5101437015152346e-05,
+      "loss": 0.0075,
+      "step": 4100
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 3.445306400520726e-05,
+      "loss": 0.0088,
+      "step": 4200
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 3.379718428450832e-05,
+      "loss": 0.0066,
+      "step": 4300
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 3.313431868940551e-05,
+      "loss": 0.0057,
+      "step": 4400
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 3.24649936037558e-05,
+      "loss": 0.0072,
+      "step": 4500
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 3.1789740540919856e-05,
+      "loss": 0.0068,
+      "step": 4600
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 3.1109095721685525e-05,
+      "loss": 0.0068,
+      "step": 4700
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 3.0423599648453037e-05,
+      "loss": 0.008,
+      "step": 4800
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 2.9733796676020104e-05,
+      "loss": 0.0076,
+      "step": 4900
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 2.9040234579308025e-05,
+      "loss": 0.0071,
+      "step": 5000
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 11148,
+  "num_train_epochs": 3,
+  "save_steps": 5000,
+  "total_flos": 2.416609239309877e+18,
+  "trial_name": null,
+  "trial_params": null
+}

LLM-Detector-V3-11w/checkpoint-5000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:caa037e3a998ed330c4bc1913526fca9609cd82e17075a31e10e57e09ee90924
+size 4600

LLM-Detector-V3-11w/special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "</s>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

LLM-Detector-V3-11w/tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

LLM-Detector-V3-11w/tokenizer_config.json

@@ -0,0 +1,34 @@
+{
+  "bos_token": {
+    "__type": "AddedToken",
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "clean_up_tokenization_spaces": false,
+  "eos_token": {
+    "__type": "AddedToken",
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": null,
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "split_special_tokens": false,
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": {
+    "__type": "AddedToken",
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "use_default_system_prompt": true
+}

LLM-Detector-V3-11w/train_results.json

@@ -0,0 +1,7 @@
+{
+    "epoch": 3.0,
+    "train_loss": 0.03027582302646779,
+    "train_runtime": 186831.816,
+    "train_samples_per_second": 1.91,
+    "train_steps_per_second": 0.06
+}

LLM-Detector-V3-11w/trainer_log.jsonl

@@ -0,0 +1,112 @@
+{"current_steps": 100, "total_steps": 11148, "loss": 2.3809, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.9990073706856164e-05, "epoch": 0.03, "percentage": 0.9, "elapsed_time": "0:27:52", "remaining_time": "2 days, 3:19:12"}
+{"current_steps": 200, "total_steps": 11148, "loss": 0.1075, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.99603027099283e-05, "epoch": 0.05, "percentage": 1.79, "elapsed_time": "0:56:11", "remaining_time": "2 days, 3:15:43"}
+{"current_steps": 300, "total_steps": 11148, "loss": 0.0487, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.991071065046783e-05, "epoch": 0.08, "percentage": 2.69, "elapsed_time": "1:23:24", "remaining_time": "2 days, 2:16:19"}
+{"current_steps": 400, "total_steps": 11148, "loss": 0.0357, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.984133690970033e-05, "epoch": 0.11, "percentage": 3.59, "elapsed_time": "1:50:49", "remaining_time": "2 days, 1:37:40"}
+{"current_steps": 500, "total_steps": 11148, "loss": 0.0271, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.975223657755279e-05, "epoch": 0.13, "percentage": 4.49, "elapsed_time": "2:18:39", "remaining_time": "2 days, 1:12:50"}
+{"current_steps": 600, "total_steps": 11148, "loss": 0.0257, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.9643480408906496e-05, "epoch": 0.16, "percentage": 5.38, "elapsed_time": "2:46:11", "remaining_time": "2 days, 0:41:43"}
+{"current_steps": 700, "total_steps": 11148, "loss": 0.0231, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.951515476741036e-05, "epoch": 0.19, "percentage": 6.28, "elapsed_time": "3:13:35", "remaining_time": "2 days, 0:09:30"}
+{"current_steps": 800, "total_steps": 11148, "loss": 0.0176, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.936736155689918e-05, "epoch": 0.22, "percentage": 7.18, "elapsed_time": "3:41:12", "remaining_time": "1 day, 23:41:19"}
+{"current_steps": 900, "total_steps": 11148, "loss": 0.018, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.920021814047156e-05, "epoch": 0.24, "percentage": 8.07, "elapsed_time": "4:09:17", "remaining_time": "1 day, 23:18:37"}
+{"current_steps": 1000, "total_steps": 11148, "loss": 0.0184, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.901385724729137e-05, "epoch": 0.27, "percentage": 8.97, "elapsed_time": "4:37:08", "remaining_time": "1 day, 22:52:21"}
+{"current_steps": 1100, "total_steps": 11148, "loss": 0.0181, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.880842686718711e-05, "epoch": 0.3, "percentage": 9.87, "elapsed_time": "5:04:43", "remaining_time": "1 day, 22:23:32"}
+{"current_steps": 1200, "total_steps": 11148, "loss": 0.016, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.858409013313266e-05, "epoch": 0.32, "percentage": 10.76, "elapsed_time": "5:33:21", "remaining_time": "1 day, 22:03:31"}
+{"current_steps": 1300, "total_steps": 11148, "loss": 0.0171, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.834354792422293e-05, "epoch": 0.35, "percentage": 11.66, "elapsed_time": "6:00:55", "remaining_time": "1 day, 21:34:08"}
+{"current_steps": 1400, "total_steps": 11148, "loss": 0.0141, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.8082132142108465e-05, "epoch": 0.38, "percentage": 12.56, "elapsed_time": "6:28:46", "remaining_time": "1 day, 21:06:58"}
+{"current_steps": 1500, "total_steps": 11148, "loss": 0.0137, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.780238675919182e-05, "epoch": 0.4, "percentage": 13.46, "elapsed_time": "6:56:26", "remaining_time": "1 day, 20:38:32"}
+{"current_steps": 1600, "total_steps": 11148, "loss": 0.0156, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.75045339222471e-05, "epoch": 0.43, "percentage": 14.35, "elapsed_time": "7:24:15", "remaining_time": "1 day, 20:11:05"}
+{"current_steps": 1700, "total_steps": 11148, "loss": 0.0136, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.718881015724017e-05, "epoch": 0.46, "percentage": 15.25, "elapsed_time": "7:51:29", "remaining_time": "1 day, 19:40:21"}
+{"current_steps": 1800, "total_steps": 11148, "loss": 0.0134, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.6855466181502544e-05, "epoch": 0.48, "percentage": 16.15, "elapsed_time": "8:19:40", "remaining_time": "1 day, 19:14:56"}
+{"current_steps": 1900, "total_steps": 11148, "loss": 0.0101, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.65047667046359e-05, "epoch": 0.51, "percentage": 17.04, "elapsed_time": "8:47:17", "remaining_time": "1 day, 18:46:31"}
+{"current_steps": 2000, "total_steps": 11148, "loss": 0.0126, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.613699021830524e-05, "epoch": 0.54, "percentage": 17.94, "elapsed_time": "9:15:27", "remaining_time": "1 day, 18:20:38"}
+{"current_steps": 2100, "total_steps": 11148, "loss": 0.0138, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.575635648326851e-05, "epoch": 0.57, "percentage": 18.84, "elapsed_time": "9:42:39", "remaining_time": "1 day, 17:50:24"}
+{"current_steps": 2200, "total_steps": 11148, "loss": 0.0125, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.5355478705672265e-05, "epoch": 0.59, "percentage": 19.73, "elapsed_time": "10:10:30", "remaining_time": "1 day, 17:23:06"}
+{"current_steps": 2300, "total_steps": 11148, "loss": 0.0097, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.4938436572178774e-05, "epoch": 0.62, "percentage": 20.63, "elapsed_time": "10:38:13", "remaining_time": "1 day, 16:55:12"}
+{"current_steps": 2400, "total_steps": 11148, "loss": 0.0157, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.450556125738566e-05, "epoch": 0.65, "percentage": 21.53, "elapsed_time": "11:05:47", "remaining_time": "1 day, 16:26:49"}
+{"current_steps": 2500, "total_steps": 11148, "loss": 0.0091, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.4057196509074484e-05, "epoch": 0.67, "percentage": 22.43, "elapsed_time": "11:33:25", "remaining_time": "1 day, 15:58:40"}
+{"current_steps": 2600, "total_steps": 11148, "loss": 0.0131, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.359369837523941e-05, "epoch": 0.7, "percentage": 23.32, "elapsed_time": "12:01:07", "remaining_time": "1 day, 15:30:49"}
+{"current_steps": 2700, "total_steps": 11148, "loss": 0.0094, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.311543492134827e-05, "epoch": 0.73, "percentage": 24.22, "elapsed_time": "12:29:22", "remaining_time": "1 day, 15:04:43"}
+{"current_steps": 2800, "total_steps": 11148, "loss": 0.0139, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.2622785938060536e-05, "epoch": 0.75, "percentage": 25.12, "elapsed_time": "12:56:38", "remaining_time": "1 day, 14:35:30"}
+{"current_steps": 2900, "total_steps": 11148, "loss": 0.0089, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.211614263963423e-05, "epoch": 0.78, "percentage": 26.01, "elapsed_time": "13:24:07", "remaining_time": "1 day, 14:07:02"}
+{"current_steps": 3000, "total_steps": 11148, "loss": 0.009, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.1595907353261296e-05, "epoch": 0.81, "percentage": 26.91, "elapsed_time": "13:52:04", "remaining_time": "1 day, 13:39:55"}
+{"current_steps": 3100, "total_steps": 11148, "loss": 0.0103, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.106249319957826e-05, "epoch": 0.83, "percentage": 27.81, "elapsed_time": "14:19:30", "remaining_time": "1 day, 13:11:23"}
+{"current_steps": 3200, "total_steps": 11148, "loss": 0.0115, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.051632376460562e-05, "epoch": 0.86, "percentage": 28.7, "elapsed_time": "14:46:48", "remaining_time": "1 day, 12:42:35"}
+{"current_steps": 3300, "total_steps": 11148, "loss": 0.0106, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.9957832763376815e-05, "epoch": 0.89, "percentage": 29.6, "elapsed_time": "15:14:33", "remaining_time": "1 day, 12:14:59"}
+{"current_steps": 3400, "total_steps": 11148, "loss": 0.0098, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.9387463695523555e-05, "epoch": 0.91, "percentage": 30.5, "elapsed_time": "15:42:59", "remaining_time": "1 day, 11:48:55"}
+{"current_steps": 3500, "total_steps": 11148, "loss": 0.0087, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.880566949309125e-05, "epoch": 0.94, "percentage": 31.4, "elapsed_time": "16:10:34", "remaining_time": "1 day, 11:20:50"}
+{"current_steps": 3600, "total_steps": 11148, "loss": 0.0081, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.82129121608641e-05, "epoch": 0.97, "percentage": 32.29, "elapsed_time": "16:38:33", "remaining_time": "1 day, 10:53:37"}
+{"current_steps": 3700, "total_steps": 11148, "loss": 0.0082, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.7609662409485565e-05, "epoch": 1.0, "percentage": 33.19, "elapsed_time": "17:06:45", "remaining_time": "1 day, 10:26:49"}
+{"current_steps": 3800, "total_steps": 11148, "loss": 0.0067, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.699639928166532e-05, "epoch": 1.02, "percentage": 34.09, "elapsed_time": "17:34:11", "remaining_time": "1 day, 9:58:27"}
+{"current_steps": 3900, "total_steps": 11148, "loss": 0.0071, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.6373609771769846e-05, "epoch": 1.05, "percentage": 34.98, "elapsed_time": "18:01:42", "remaining_time": "1 day, 9:30:18"}
+{"current_steps": 4000, "total_steps": 11148, "loss": 0.0081, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.574178843909851e-05, "epoch": 1.08, "percentage": 35.88, "elapsed_time": "18:29:17", "remaining_time": "1 day, 9:02:18"}
+{"current_steps": 4100, "total_steps": 11148, "loss": 0.0075, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.5101437015152346e-05, "epoch": 1.1, "percentage": 36.78, "elapsed_time": "18:57:09", "remaining_time": "1 day, 8:34:48"}
+{"current_steps": 4200, "total_steps": 11148, "loss": 0.0088, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.445306400520726e-05, "epoch": 1.13, "percentage": 37.67, "elapsed_time": "19:24:08", "remaining_time": "1 day, 8:05:48"}
+{"current_steps": 4300, "total_steps": 11148, "loss": 0.0066, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.379718428450832e-05, "epoch": 1.16, "percentage": 38.57, "elapsed_time": "19:52:13", "remaining_time": "1 day, 7:38:41"}
+{"current_steps": 4400, "total_steps": 11148, "loss": 0.0057, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.313431868940551e-05, "epoch": 1.18, "percentage": 39.47, "elapsed_time": "20:19:25", "remaining_time": "1 day, 7:10:09"}
+{"current_steps": 4500, "total_steps": 11148, "loss": 0.0072, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.24649936037558e-05, "epoch": 1.21, "percentage": 40.37, "elapsed_time": "20:47:36", "remaining_time": "1 day, 6:43:08"}
+{"current_steps": 4600, "total_steps": 11148, "loss": 0.0068, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.1789740540919856e-05, "epoch": 1.24, "percentage": 41.26, "elapsed_time": "21:15:20", "remaining_time": "1 day, 6:15:25"}
+{"current_steps": 4700, "total_steps": 11148, "loss": 0.0068, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.1109095721685525e-05, "epoch": 1.26, "percentage": 42.16, "elapsed_time": "21:42:40", "remaining_time": "1 day, 5:47:09"}
+{"current_steps": 4800, "total_steps": 11148, "loss": 0.008, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.0423599648453037e-05, "epoch": 1.29, "percentage": 43.06, "elapsed_time": "22:10:26", "remaining_time": "1 day, 5:19:30"}
+{"current_steps": 4900, "total_steps": 11148, "loss": 0.0076, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9733796676020104e-05, "epoch": 1.32, "percentage": 43.95, "elapsed_time": "22:38:56", "remaining_time": "1 day, 4:52:47"}
+{"current_steps": 5000, "total_steps": 11148, "loss": 0.0071, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9040234579308025e-05, "epoch": 1.35, "percentage": 44.85, "elapsed_time": "23:06:41", "remaining_time": "1 day, 4:25:05"}
+{"current_steps": 5100, "total_steps": 11148, "loss": 0.0071, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8343464118371603e-05, "epoch": 1.37, "percentage": 45.75, "elapsed_time": "23:34:23", "remaining_time": "1 day, 3:57:17"}
+{"current_steps": 5200, "total_steps": 11148, "loss": 0.0082, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.7644038601038813e-05, "epoch": 1.4, "percentage": 46.65, "elapsed_time": "1 day, 0:02:24", "remaining_time": "1 day, 3:29:53"}
+{"current_steps": 5300, "total_steps": 11148, "loss": 0.0047, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.6942513443527008e-05, "epoch": 1.43, "percentage": 47.54, "elapsed_time": "1 day, 0:30:28", "remaining_time": "1 day, 3:02:30"}
+{"current_steps": 5400, "total_steps": 11148, "loss": 0.0065, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.6239445729385104e-05, "epoch": 1.45, "percentage": 48.44, "elapsed_time": "1 day, 0:58:46", "remaining_time": "1 day, 2:35:22"}
+{"current_steps": 5500, "total_steps": 11148, "loss": 0.0066, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.5535393767111533e-05, "epoch": 1.48, "percentage": 49.34, "elapsed_time": "1 day, 1:26:39", "remaining_time": "1 day, 2:07:44"}
+{"current_steps": 5600, "total_steps": 11148, "loss": 0.0035, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.483091664679959e-05, "epoch": 1.51, "percentage": 50.23, "elapsed_time": "1 day, 1:54:33", "remaining_time": "1 day, 1:40:07"}
+{"current_steps": 5700, "total_steps": 11148, "loss": 0.0048, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.4126573796162015e-05, "epoch": 1.53, "percentage": 51.13, "elapsed_time": "1 day, 2:22:15", "remaining_time": "1 day, 1:12:18"}
+{"current_steps": 5800, "total_steps": 11148, "loss": 0.0072, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.3422924536287548e-05, "epoch": 1.56, "percentage": 52.03, "elapsed_time": "1 day, 2:49:05", "remaining_time": "1 day, 0:43:41"}
+{"current_steps": 5900, "total_steps": 11148, "loss": 0.0043, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.272052763748209e-05, "epoch": 1.59, "percentage": 52.92, "elapsed_time": "1 day, 3:16:56", "remaining_time": "1 day, 0:16:03"}
+{"current_steps": 6000, "total_steps": 11148, "loss": 0.008, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.201994087554733e-05, "epoch": 1.61, "percentage": 53.82, "elapsed_time": "1 day, 3:45:09", "remaining_time": "23:48:42"}
+{"current_steps": 6100, "total_steps": 11148, "loss": 0.0057, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.1321720588848995e-05, "epoch": 1.64, "percentage": 54.72, "elapsed_time": "1 day, 4:13:09", "remaining_time": "23:21:09"}
+{"current_steps": 6200, "total_steps": 11148, "loss": 0.0072, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.0626421236526656e-05, "epoch": 1.67, "percentage": 55.62, "elapsed_time": "1 day, 4:40:44", "remaining_time": "22:53:16"}
+{"current_steps": 6300, "total_steps": 11148, "loss": 0.0041, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.9934594958195834e-05, "epoch": 1.7, "percentage": 56.51, "elapsed_time": "1 day, 5:08:21", "remaining_time": "22:25:24"}
+{"current_steps": 6400, "total_steps": 11148, "loss": 0.0065, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.9246791135491982e-05, "epoch": 1.72, "percentage": 57.41, "elapsed_time": "1 day, 5:36:14", "remaining_time": "21:57:45"}
+{"current_steps": 6500, "total_steps": 11148, "loss": 0.0057, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.8563555955804683e-05, "epoch": 1.75, "percentage": 58.31, "elapsed_time": "1 day, 6:04:22", "remaining_time": "21:30:15"}
+{"current_steps": 6600, "total_steps": 11148, "loss": 0.0032, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.7885431978548305e-05, "epoch": 1.78, "percentage": 59.2, "elapsed_time": "1 day, 6:32:14", "remaining_time": "21:02:34"}
+{"current_steps": 6700, "total_steps": 11148, "loss": 0.0076, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.7212957704313752e-05, "epoch": 1.8, "percentage": 60.1, "elapsed_time": "1 day, 7:00:42", "remaining_time": "20:35:17"}
+{"current_steps": 6800, "total_steps": 11148, "loss": 0.0056, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.6546667147243222e-05, "epoch": 1.83, "percentage": 61.0, "elapsed_time": "1 day, 7:28:27", "remaining_time": "20:07:29"}
+{"current_steps": 6900, "total_steps": 11148, "loss": 0.005, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.5887089410967808e-05, "epoch": 1.86, "percentage": 61.89, "elapsed_time": "1 day, 7:56:19", "remaining_time": "19:39:47"}
+{"current_steps": 7000, "total_steps": 11148, "loss": 0.004, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.5234748268444419e-05, "epoch": 1.88, "percentage": 62.79, "elapsed_time": "1 day, 8:24:24", "remaining_time": "19:12:12"}
+{"current_steps": 7100, "total_steps": 11148, "loss": 0.0062, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.4590161746025896e-05, "epoch": 1.91, "percentage": 63.69, "elapsed_time": "1 day, 8:51:47", "remaining_time": "18:44:11"}
+{"current_steps": 7200, "total_steps": 11148, "loss": 0.0056, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.3953841712094482e-05, "epoch": 1.94, "percentage": 64.59, "elapsed_time": "1 day, 9:19:38", "remaining_time": "18:16:28"}
+{"current_steps": 7300, "total_steps": 11148, "loss": 0.0063, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.3326293470585377e-05, "epoch": 1.96, "percentage": 65.48, "elapsed_time": "1 day, 9:47:14", "remaining_time": "17:48:36"}
+{"current_steps": 7400, "total_steps": 11148, "loss": 0.0057, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.2708015359723158e-05, "epoch": 1.99, "percentage": 66.38, "elapsed_time": "1 day, 10:14:36", "remaining_time": "17:20:37"}
+{"current_steps": 7500, "total_steps": 11148, "loss": 0.0047, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.2099498356289662e-05, "epoch": 2.02, "percentage": 67.28, "elapsed_time": "1 day, 10:42:08", "remaining_time": "16:52:45"}
+{"current_steps": 7600, "total_steps": 11148, "loss": 0.0032, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.1501225685737607e-05, "epoch": 2.04, "percentage": 68.17, "elapsed_time": "1 day, 11:09:55", "remaining_time": "16:24:59"}
+{"current_steps": 7700, "total_steps": 11148, "loss": 0.0018, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.0913672438459612e-05, "epoch": 2.07, "percentage": 69.07, "elapsed_time": "1 day, 11:37:27", "remaining_time": "15:57:08"}
+{"current_steps": 7800, "total_steps": 11148, "loss": 0.0029, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.0337305192517294e-05, "epoch": 2.1, "percentage": 69.97, "elapsed_time": "1 day, 12:04:33", "remaining_time": "15:29:05"}
+{"current_steps": 7900, "total_steps": 11148, "loss": 0.0052, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.772581643129997e-06, "epoch": 2.13, "percentage": 70.86, "elapsed_time": "1 day, 12:31:55", "remaining_time": "15:01:11"}
+{"current_steps": 8000, "total_steps": 11148, "loss": 0.0032, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.219950239217432e-06, "epoch": 2.15, "percentage": 71.76, "elapsed_time": "1 day, 12:59:40", "remaining_time": "14:33:26"}
+{"current_steps": 8100, "total_steps": 11148, "loss": 0.0026, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 8.679849827284852e-06, "epoch": 2.18, "percentage": 72.66, "elapsed_time": "1 day, 13:26:59", "remaining_time": "14:05:31"}
+{"current_steps": 8200, "total_steps": 11148, "loss": 0.0051, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 8.152709302933523e-06, "epoch": 2.21, "percentage": 73.56, "elapsed_time": "1 day, 13:54:59", "remaining_time": "13:37:53"}
+{"current_steps": 8300, "total_steps": 11148, "loss": 0.0024, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.638947270273291e-06, "epoch": 2.23, "percentage": 74.45, "elapsed_time": "1 day, 14:22:57", "remaining_time": "13:10:13"}
+{"current_steps": 8400, "total_steps": 11148, "loss": 0.0035, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.138971709507527e-06, "epoch": 2.26, "percentage": 75.35, "elapsed_time": "1 day, 14:50:29", "remaining_time": "12:42:24"}
+{"current_steps": 8500, "total_steps": 11148, "loss": 0.003, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.653179652954706e-06, "epoch": 2.29, "percentage": 76.25, "elapsed_time": "1 day, 15:18:36", "remaining_time": "12:14:46"}
+{"current_steps": 8600, "total_steps": 11148, "loss": 0.002, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.181956869763645e-06, "epoch": 2.31, "percentage": 77.14, "elapsed_time": "1 day, 15:46:33", "remaining_time": "11:47:05"}
+{"current_steps": 8700, "total_steps": 11148, "loss": 0.0036, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.725677559572909e-06, "epoch": 2.34, "percentage": 78.04, "elapsed_time": "1 day, 16:14:24", "remaining_time": "11:19:21"}
+{"current_steps": 8800, "total_steps": 11148, "loss": 0.0013, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.284704055357578e-06, "epoch": 2.37, "percentage": 78.94, "elapsed_time": "1 day, 16:41:58", "remaining_time": "10:51:33"}
+{"current_steps": 8900, "total_steps": 11148, "loss": 0.002, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.859386535699373e-06, "epoch": 2.39, "percentage": 79.83, "elapsed_time": "1 day, 17:09:41", "remaining_time": "10:23:48"}
+{"current_steps": 9000, "total_steps": 11148, "loss": 0.0048, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.4500627467086245e-06, "epoch": 2.42, "percentage": 80.73, "elapsed_time": "1 day, 17:37:59", "remaining_time": "9:56:11"}
+{"current_steps": 9100, "total_steps": 11148, "loss": 0.0026, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.057057733818967e-06, "epoch": 2.45, "percentage": 81.63, "elapsed_time": "1 day, 18:06:06", "remaining_time": "9:28:30"}
+{"current_steps": 9200, "total_steps": 11148, "loss": 0.002, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.680683583667599e-06, "epoch": 2.48, "percentage": 82.53, "elapsed_time": "1 day, 18:34:07", "remaining_time": "9:00:48"}
+{"current_steps": 9300, "total_steps": 11148, "loss": 0.0039, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.321239176266211e-06, "epoch": 2.5, "percentage": 83.42, "elapsed_time": "1 day, 19:01:50", "remaining_time": "8:33:02"}
+{"current_steps": 9400, "total_steps": 11148, "loss": 0.0015, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9790099476593393e-06, "epoch": 2.53, "percentage": 84.32, "elapsed_time": "1 day, 19:29:47", "remaining_time": "8:05:18"}
+{"current_steps": 9500, "total_steps": 11148, "loss": 0.0039, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.654267663258628e-06, "epoch": 2.56, "percentage": 85.22, "elapsed_time": "1 day, 19:58:42", "remaining_time": "7:37:44"}
+{"current_steps": 9600, "total_steps": 11148, "loss": 0.0036, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.3472702020329696e-06, "epoch": 2.58, "percentage": 86.11, "elapsed_time": "1 day, 20:27:33", "remaining_time": "7:10:08"}
+{"current_steps": 9700, "total_steps": 11148, "loss": 0.0039, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.0582613517259377e-06, "epoch": 2.61, "percentage": 87.01, "elapsed_time": "1 day, 20:56:41", "remaining_time": "6:42:33"}
+{"current_steps": 9800, "total_steps": 11148, "loss": 0.0019, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.7874706152630705e-06, "epoch": 2.64, "percentage": 87.91, "elapsed_time": "1 day, 21:25:30", "remaining_time": "6:14:53"}
+{"current_steps": 9900, "total_steps": 11148, "loss": 0.0031, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.5351130285028214e-06, "epoch": 2.66, "percentage": 88.81, "elapsed_time": "1 day, 21:54:34", "remaining_time": "5:47:14"}
+{"current_steps": 10000, "total_steps": 11148, "loss": 0.0034, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.301388989475863e-06, "epoch": 2.69, "percentage": 89.7, "elapsed_time": "1 day, 22:22:20", "remaining_time": "5:19:24"}
+{"current_steps": 10100, "total_steps": 11148, "loss": 0.0024, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.0864840992482778e-06, "epoch": 2.72, "percentage": 90.6, "elapsed_time": "1 day, 22:51:21", "remaining_time": "4:51:42"}
+{"current_steps": 10200, "total_steps": 11148, "loss": 0.0029, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 8.905690145351475e-07, "epoch": 2.74, "percentage": 91.5, "elapsed_time": "1 day, 23:19:55", "remaining_time": "4:23:56"}
+{"current_steps": 10300, "total_steps": 11148, "loss": 0.0033, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.137993121814402e-07, "epoch": 2.77, "percentage": 92.39, "elapsed_time": "1 day, 23:48:59", "remaining_time": "3:56:12"}
+{"current_steps": 10400, "total_steps": 11148, "loss": 0.0025, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.563153656179209e-07, "epoch": 2.8, "percentage": 93.29, "elapsed_time": "2 days, 0:17:46", "remaining_time": "3:28:25"}
+{"current_steps": 10500, "total_steps": 11148, "loss": 0.0022, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.1952650833933515e-07, "epoch": 2.83, "percentage": 94.19, "elapsed_time": "2 days, 0:46:36", "remaining_time": "3:00:36"}
+{"current_steps": 10600, "total_steps": 11148, "loss": 0.0022, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.007781383039976e-07, "epoch": 2.85, "percentage": 95.08, "elapsed_time": "2 days, 1:15:34", "remaining_time": "2:32:47"}
+{"current_steps": 10700, "total_steps": 11148, "loss": 0.0026, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.0164350559856714e-07, "epoch": 2.88, "percentage": 95.98, "elapsed_time": "2 days, 1:44:29", "remaining_time": "2:04:57"}
+{"current_steps": 10800, "total_steps": 11148, "loss": 0.003, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.222013333770422e-07, "epoch": 2.91, "percentage": 96.88, "elapsed_time": "2 days, 2:12:45", "remaining_time": "1:37:04"}
+{"current_steps": 10900, "total_steps": 11148, "loss": 0.0023, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.251470694257356e-08, "epoch": 2.93, "percentage": 97.78, "elapsed_time": "2 days, 2:42:08", "remaining_time": "1:09:12"}
+{"current_steps": 11000, "total_steps": 11148, "loss": 0.0024, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.2631023651226157e-08, "epoch": 2.96, "percentage": 98.67, "elapsed_time": "2 days, 3:11:01", "remaining_time": "0:41:19"}
+{"current_steps": 11100, "total_steps": 11148, "loss": 0.004, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.581955273558978e-09, "epoch": 2.99, "percentage": 99.57, "elapsed_time": "2 days, 3:39:55", "remaining_time": "0:13:24"}
+{"current_steps": 11148, "total_steps": 11148, "loss": null, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": null, "epoch": 3.0, "percentage": 100.0, "elapsed_time": "2 days, 3:53:51", "remaining_time": "0:00:00"}

LLM-Detector-V3-11w/trainer_state.json

@@ -0,0 +1,694 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 2.9995963944571504,
+  "eval_steps": 500,
+  "global_step": 11148,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03,
+      "learning_rate": 4.9990073706856164e-05,
+      "loss": 2.3809,
+      "step": 100
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.99603027099283e-05,
+      "loss": 0.1075,
+      "step": 200
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 4.991071065046783e-05,
+      "loss": 0.0487,
+      "step": 300
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 4.984133690970033e-05,
+      "loss": 0.0357,
+      "step": 400
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 4.975223657755279e-05,
+      "loss": 0.0271,
+      "step": 500
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 4.9643480408906496e-05,
+      "loss": 0.0257,
+      "step": 600
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 4.951515476741036e-05,
+      "loss": 0.0231,
+      "step": 700
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 4.936736155689918e-05,
+      "loss": 0.0176,
+      "step": 800
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 4.920021814047156e-05,
+      "loss": 0.018,
+      "step": 900
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 4.901385724729137e-05,
+      "loss": 0.0184,
+      "step": 1000
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 4.880842686718711e-05,
+      "loss": 0.0181,
+      "step": 1100
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 4.858409013313266e-05,
+      "loss": 0.016,
+      "step": 1200
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 4.834354792422293e-05,
+      "loss": 0.0171,
+      "step": 1300
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 4.8082132142108465e-05,
+      "loss": 0.0141,
+      "step": 1400
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 4.780238675919182e-05,
+      "loss": 0.0137,
+      "step": 1500
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 4.75045339222471e-05,
+      "loss": 0.0156,
+      "step": 1600
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 4.718881015724017e-05,
+      "loss": 0.0136,
+      "step": 1700
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 4.6855466181502544e-05,
+      "loss": 0.0134,
+      "step": 1800
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 4.65047667046359e-05,
+      "loss": 0.0101,
+      "step": 1900
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 4.613699021830524e-05,
+      "loss": 0.0126,
+      "step": 2000
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 4.575635648326851e-05,
+      "loss": 0.0138,
+      "step": 2100
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.5355478705672265e-05,
+      "loss": 0.0125,
+      "step": 2200
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.4938436572178774e-05,
+      "loss": 0.0097,
+      "step": 2300
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.450556125738566e-05,
+      "loss": 0.0157,
+      "step": 2400
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.4057196509074484e-05,
+      "loss": 0.0091,
+      "step": 2500
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.359369837523941e-05,
+      "loss": 0.0131,
+      "step": 2600
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.311543492134827e-05,
+      "loss": 0.0094,
+      "step": 2700
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.2622785938060536e-05,
+      "loss": 0.0139,
+      "step": 2800
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.211614263963423e-05,
+      "loss": 0.0089,
+      "step": 2900
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.1595907353261296e-05,
+      "loss": 0.009,
+      "step": 3000
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 4.106249319957826e-05,
+      "loss": 0.0103,
+      "step": 3100
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 4.051632376460562e-05,
+      "loss": 0.0115,
+      "step": 3200
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.9957832763376815e-05,
+      "loss": 0.0106,
+      "step": 3300
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.9387463695523555e-05,
+      "loss": 0.0098,
+      "step": 3400
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.880566949309125e-05,
+      "loss": 0.0087,
+      "step": 3500
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.82129121608641e-05,
+      "loss": 0.0081,
+      "step": 3600
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.7609662409485565e-05,
+      "loss": 0.0082,
+      "step": 3700
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.699639928166532e-05,
+      "loss": 0.0067,
+      "step": 3800
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 3.6373609771769846e-05,
+      "loss": 0.0071,
+      "step": 3900
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 3.574178843909851e-05,
+      "loss": 0.0081,
+      "step": 4000
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 3.5101437015152346e-05,
+      "loss": 0.0075,
+      "step": 4100
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 3.445306400520726e-05,
+      "loss": 0.0088,
+      "step": 4200
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 3.379718428450832e-05,
+      "loss": 0.0066,
+      "step": 4300
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 3.313431868940551e-05,
+      "loss": 0.0057,
+      "step": 4400
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 3.24649936037558e-05,
+      "loss": 0.0072,
+      "step": 4500
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 3.1789740540919856e-05,
+      "loss": 0.0068,
+      "step": 4600
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 3.1109095721685525e-05,
+      "loss": 0.0068,
+      "step": 4700
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 3.0423599648453037e-05,
+      "loss": 0.008,
+      "step": 4800
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 2.9733796676020104e-05,
+      "loss": 0.0076,
+      "step": 4900
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 2.9040234579308025e-05,
+      "loss": 0.0071,
+      "step": 5000
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 2.8343464118371603e-05,
+      "loss": 0.0071,
+      "step": 5100
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 2.7644038601038813e-05,
+      "loss": 0.0082,
+      "step": 5200
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 2.6942513443527008e-05,
+      "loss": 0.0047,
+      "step": 5300
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 2.6239445729385104e-05,
+      "loss": 0.0065,
+      "step": 5400
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 2.5535393767111533e-05,
+      "loss": 0.0066,
+      "step": 5500
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 2.483091664679959e-05,
+      "loss": 0.0035,
+      "step": 5600
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 2.4126573796162015e-05,
+      "loss": 0.0048,
+      "step": 5700
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 2.3422924536287548e-05,
+      "loss": 0.0072,
+      "step": 5800
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 2.272052763748209e-05,
+      "loss": 0.0043,
+      "step": 5900
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 2.201994087554733e-05,
+      "loss": 0.008,
+      "step": 6000
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 2.1321720588848995e-05,
+      "loss": 0.0057,
+      "step": 6100
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 2.0626421236526656e-05,
+      "loss": 0.0072,
+      "step": 6200
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 1.9934594958195834e-05,
+      "loss": 0.0041,
+      "step": 6300
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 1.9246791135491982e-05,
+      "loss": 0.0065,
+      "step": 6400
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 1.8563555955804683e-05,
+      "loss": 0.0057,
+      "step": 6500
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.7885431978548305e-05,
+      "loss": 0.0032,
+      "step": 6600
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.7212957704313752e-05,
+      "loss": 0.0076,
+      "step": 6700
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.6546667147243222e-05,
+      "loss": 0.0056,
+      "step": 6800
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 1.5887089410967808e-05,
+      "loss": 0.005,
+      "step": 6900
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 1.5234748268444419e-05,
+      "loss": 0.004,
+      "step": 7000
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 1.4590161746025896e-05,
+      "loss": 0.0062,
+      "step": 7100
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.3953841712094482e-05,
+      "loss": 0.0056,
+      "step": 7200
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 1.3326293470585377e-05,
+      "loss": 0.0063,
+      "step": 7300
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 1.2708015359723158e-05,
+      "loss": 0.0057,
+      "step": 7400
+    },
+    {
+      "epoch": 2.02,
+      "learning_rate": 1.2099498356289662e-05,
+      "loss": 0.0047,
+      "step": 7500
+    },
+    {
+      "epoch": 2.04,
+      "learning_rate": 1.1501225685737607e-05,
+      "loss": 0.0032,
+      "step": 7600
+    },
+    {
+      "epoch": 2.07,
+      "learning_rate": 1.0913672438459612e-05,
+      "loss": 0.0018,
+      "step": 7700
+    },
+    {
+      "epoch": 2.1,
+      "learning_rate": 1.0337305192517294e-05,
+      "loss": 0.0029,
+      "step": 7800
+    },
+    {
+      "epoch": 2.13,
+      "learning_rate": 9.772581643129997e-06,
+      "loss": 0.0052,
+      "step": 7900
+    },
+    {
+      "epoch": 2.15,
+      "learning_rate": 9.219950239217432e-06,
+      "loss": 0.0032,
+      "step": 8000
+    },
+    {
+      "epoch": 2.18,
+      "learning_rate": 8.679849827284852e-06,
+      "loss": 0.0026,
+      "step": 8100
+    },
+    {
+      "epoch": 2.21,
+      "learning_rate": 8.152709302933523e-06,
+      "loss": 0.0051,
+      "step": 8200
+    },
+    {
+      "epoch": 2.23,
+      "learning_rate": 7.638947270273291e-06,
+      "loss": 0.0024,
+      "step": 8300
+    },
+    {
+      "epoch": 2.26,
+      "learning_rate": 7.138971709507527e-06,
+      "loss": 0.0035,
+      "step": 8400
+    },
+    {
+      "epoch": 2.29,
+      "learning_rate": 6.653179652954706e-06,
+      "loss": 0.003,
+      "step": 8500
+    },
+    {
+      "epoch": 2.31,
+      "learning_rate": 6.181956869763645e-06,
+      "loss": 0.002,
+      "step": 8600
+    },
+    {
+      "epoch": 2.34,
+      "learning_rate": 5.725677559572909e-06,
+      "loss": 0.0036,
+      "step": 8700
+    },
+    {
+      "epoch": 2.37,
+      "learning_rate": 5.284704055357578e-06,
+      "loss": 0.0013,
+      "step": 8800
+    },
+    {
+      "epoch": 2.39,
+      "learning_rate": 4.859386535699373e-06,
+      "loss": 0.002,
+      "step": 8900
+    },
+    {
+      "epoch": 2.42,
+      "learning_rate": 4.4500627467086245e-06,
+      "loss": 0.0048,
+      "step": 9000
+    },
+    {
+      "epoch": 2.45,
+      "learning_rate": 4.057057733818967e-06,
+      "loss": 0.0026,
+      "step": 9100
+    },
+    {
+      "epoch": 2.48,
+      "learning_rate": 3.680683583667599e-06,
+      "loss": 0.002,
+      "step": 9200
+    },
+    {
+      "epoch": 2.5,
+      "learning_rate": 3.321239176266211e-06,
+      "loss": 0.0039,
+      "step": 9300
+    },
+    {
+      "epoch": 2.53,
+      "learning_rate": 2.9790099476593393e-06,
+      "loss": 0.0015,
+      "step": 9400
+    },
+    {
+      "epoch": 2.56,
+      "learning_rate": 2.654267663258628e-06,
+      "loss": 0.0039,
+      "step": 9500
+    },
+    {
+      "epoch": 2.58,
+      "learning_rate": 2.3472702020329696e-06,
+      "loss": 0.0036,
+      "step": 9600
+    },
+    {
+      "epoch": 2.61,
+      "learning_rate": 2.0582613517259377e-06,
+      "loss": 0.0039,
+      "step": 9700
+    },
+    {
+      "epoch": 2.64,
+      "learning_rate": 1.7874706152630705e-06,
+      "loss": 0.0019,
+      "step": 9800
+    },
+    {
+      "epoch": 2.66,
+      "learning_rate": 1.5351130285028214e-06,
+      "loss": 0.0031,
+      "step": 9900
+    },
+    {
+      "epoch": 2.69,
+      "learning_rate": 1.301388989475863e-06,
+      "loss": 0.0034,
+      "step": 10000
+    },
+    {
+      "epoch": 2.72,
+      "learning_rate": 1.0864840992482778e-06,
+      "loss": 0.0024,
+      "step": 10100
+    },
+    {
+      "epoch": 2.74,
+      "learning_rate": 8.905690145351475e-07,
+      "loss": 0.0029,
+      "step": 10200
+    },
+    {
+      "epoch": 2.77,
+      "learning_rate": 7.137993121814402e-07,
+      "loss": 0.0033,
+      "step": 10300
+    },
+    {
+      "epoch": 2.8,
+      "learning_rate": 5.563153656179209e-07,
+      "loss": 0.0025,
+      "step": 10400
+    },
+    {
+      "epoch": 2.83,
+      "learning_rate": 4.1952650833933515e-07,
+      "loss": 0.0022,
+      "step": 10500
+    },
+    {
+      "epoch": 2.85,
+      "learning_rate": 3.007781383039976e-07,
+      "loss": 0.0022,
+      "step": 10600
+    },
+    {
+      "epoch": 2.88,
+      "learning_rate": 2.0164350559856714e-07,
+      "loss": 0.0026,
+      "step": 10700
+    },
+    {
+      "epoch": 2.91,
+      "learning_rate": 1.222013333770422e-07,
+      "loss": 0.003,
+      "step": 10800
+    },
+    {
+      "epoch": 2.93,
+      "learning_rate": 6.251470694257356e-08,
+      "loss": 0.0023,
+      "step": 10900
+    },
+    {
+      "epoch": 2.96,
+      "learning_rate": 2.2631023651226157e-08,
+      "loss": 0.0024,
+      "step": 11000
+    },
+    {
+      "epoch": 2.99,
+      "learning_rate": 2.581955273558978e-09,
+      "loss": 0.004,
+      "step": 11100
+    },
+    {
+      "epoch": 3.0,
+      "step": 11148,
+      "total_flos": 5.393398537924706e+18,
+      "train_loss": 0.03027582302646779,
+      "train_runtime": 186831.816,
+      "train_samples_per_second": 1.91,
+      "train_steps_per_second": 0.06
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 11148,
+  "num_train_epochs": 3,
+  "save_steps": 5000,
+  "total_flos": 5.393398537924706e+18,
+  "trial_name": null,
+  "trial_params": null
+}

LLM-Detector-V3-11w/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:caa037e3a998ed330c4bc1913526fca9609cd82e17075a31e10e57e09ee90924
+size 4600