Add out-of-sample results and arxiv link
Browse files
README.md
CHANGED
@@ -27,6 +27,7 @@ pipeline_tag: object-detection
|
|
27 |
- [Precision-Recall curve](https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/PR_curve.png) and [per class accuracy]((https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/confusion_matrix.png)) were evaluated at test time.
|
28 |
- [email protected] = 0.33515
|
29 |
- Performance is quite variable depending on the target organism even when testing on in-distribution data.
|
|
|
30 |
|
31 |
## Training and Evaluation Data
|
32 |
- Training data is the [FathomNet2023 competition split](https://www.kaggle.com/competitions/fathomnet-out-of-sample-detection/overview) and internal MBARI data
|
|
|
27 |
- [Precision-Recall curve](https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/PR_curve.png) and [per class accuracy]((https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/confusion_matrix.png)) were evaluated at test time.
|
28 |
- [email protected] = 0.33515
|
29 |
- Performance is quite variable depending on the target organism even when testing on in-distribution data.
|
30 |
+
- Identified out-of-sample images with a binary metric, returning [ROC ~= 0.7](https://arxiv.org/abs/2307.08781).
|
31 |
|
32 |
## Training and Evaluation Data
|
33 |
- Training data is the [FathomNet2023 competition split](https://www.kaggle.com/competitions/fathomnet-out-of-sample-detection/overview) and internal MBARI data
|