elineve's picture
Upload 301 files
07423df
raw
history blame contribute delete
410 Bytes
Beta is a temperature parameter utilized in measuring DPO losses, ordinarily within the scope of 0.1 to 0.5.
This parameter regulates the deviation from the reference model, where the reference model becomes disregarded as beta approaches zero.
For more detailed information, please refer to section (3) of the given research paper: [https://arxiv.org/pdf/2305.18290.pdf](https://arxiv.org/pdf/2305.18290.pdf).