pytorch en license:mit region:us
---
language: en
license: mit
library_name: pytorch
---
# Knowledge Continuity Regularized Network
Trainer Hyperparameters:
- `lr` = 5e-05
- `per_device_batch_size` = 16
- `gradient_accumulation_steps` = 1
- `weight_decay` = 1e-09
- `seed` = 42

Regularization Hyperparameters
- `numerical stability denominator constant` = 0.01
- `lambda` = 0.01
- `alpha` = 0.5
- `beta` = 0.5

Extended Logs:

|eval_loss|eval_accuracy|epoch|
|--|--|--|
|12.940|0.911|1.0|
|12.850|0.912|2.0|
|12.739|0.918|3.0|
|12.496|0.925|4.0|
|12.456|0.926|5.0|
|13.547|0.894|6.0|
|13.069|0.907|7.0|
|13.810|0.885|8.0|
|14.430|0.866|9.0|
|14.082|0.877|10.0|
|14.190|0.873|11.0|
|13.848|0.883|12.0|
|14.187|0.873|13.0|
|13.951|0.880|14.0|
|13.648|0.890|15.0|
|14.246|0.871|16.0|
|13.773|0.885|17.0|
|13.856|0.883|18.0|
|14.636|0.859|19.0|
|13.798|0.885|20.0|
|13.919|0.881|21.0|
|13.828|0.884|22.0|
|13.962|0.880|23.0|
|14.114|0.875|24.0|
|13.950|0.880|25.0|
|14.004|0.878|26.0|
|13.944|0.880|27.0|
|14.133|0.874|28.0|
|13.883|0.882|29.0|
|14.084|0.876|30.0|
|14.108|0.875|31.0|
|13.951|0.880|32.0|
|14.021|0.878|33.0|
|14.001|0.878|34.0|
|14.013|0.878|35.0|
|14.312|0.869|36.0|
|14.258|0.870|37.0|
|14.035|0.877|38.0|
|14.125|0.875|39.0|
|14.141|0.874|40.0|
|14.162|0.874|41.0|
|14.232|0.872|42.0|
|14.044|0.877|43.0|
|14.053|0.877|44.0|
