Sentence transformer use of evaluator
I came acrossthis scriptwhich is second link onthis pageandthis explanationI am having hard time understanding use ofevaluator = EmbeddingSimilarityEvaluator.from_input_examples(dev_samples, name='sts-dev'). The documentation says thatevaluator – An evaluator (sentence_transformers.evaluation) evaluates the model performance during training on held-out dev data. It is used to determine the best model that is saved to disc.But in this case,as we are fine tuning on our own examples,train_dataloaderhastrain_sampleswhich has our model sentences and scores. How istrain_samplesdifferent thatdev_samples?Also if the model isgoing to print performance againstdev_samplesthen how is itgoing to helpto determine the best model that is saved to disc.? Are we required to rundev_samplesagainst the model saved on the disc and then compare scores?If my goal is to take a single model and then fine tune it, is it okay to skip parametersevaluatorandevaluation_steps?also how to determine total steps in the model? i need to setevaluation_steps