Huggingface model for inference in aws sagemaker
Hi:)I checked the model’s inference value through ‘predictor’ in ‘sagemaker’ as follows.By the way, what does the ‘score’ in the 13th cell mean?It is confusing because the value of the score is different according to the context and question.Also, is there a way to display the decimal point of the ‘score’ to two digits?I’ve been searching for days but couldn’t find it. Any help would be greatly appreciated!image1398×623 19.8 KB
2022-05-30T06:36:27Z
Hello@Jiiho,Thescoreis the probability of the answer between 0-1. We are using thequestion-answeringpipeline of transformers:transformers/question_answering.py at v4.19.2 · huggingface/transformers · GitHubYou can modify this by creating your owninference.pyand adjust thepost-processingof thepipeline