--- license: cc-by-nc-4.0 language: - en - ko - ja tags: - inteiror - defective --- Finetuned Hansoldeco Domain dataset (Specialized on interiror Q&A and defective things on it.) load_in_8bit=True batch_size = 1 num_epochs = 3 micro_batch = 1 gradient_accumulation_steps = batch_size // micro_batch lora target 2 X A100 80GB Base Model = CohereForAI/c4ai-command-r-plus license : cc-by-nc-4.0 (non-commercial as cohere mentioned)