Segmentation of drone images
Hi, as you can see in this notebook:Drone images segmentation | Kaggle, mainly obtained by copying and pasting from this tutorial:Fine-Tune a Semantic Segmentation Model with a Custom Datasetafter 100 steps in training, mean Iou begins to drop again, while mean accuracy and overall accuracy are almost constant during training and dont grow . What hyperparameters should I put in for better results? Thank you
2022-07-25T11:57:32Z
Hi,I recommend checking out the hyperparameters of theoriginal paper. From that paper:We trained the models using AdamW optimizer for 160K iterations on ADE20K, Cityscapes, and 80K iterations on COCO-Stuff. (…) We used a batch size of 16 for ADE20K and COCO-Stuff, and a batch size of 8 for Cityscapes. The learning rate was set to an initial value of 0.00006 and then used a “poly” LR schedule with factor 1.0 by default.
2022-07-25T16:02:31Z
Actually with these hyperparameters :epochs=2lr = 0.00006batch_size = 8I got better results:(score: 2.932823657989502).TrainOutput(global_step=80, training_loss=3.012317517399788, metrics={‘train_runtime’: 5060.615, ‘train_samples_per_second’: 0.126, ‘train_steps_per_second’: 0.016, ‘total_flos’: 1.123496604205056e+16, ‘train_loss’: 3.012317517399788, ‘epoch’: 2.0})