𝗝𝘂𝗱𝗴𝗶𝗻𝗴 𝘁𝗵𝗲 𝗝𝘂𝗱𝗴𝗲𝘀: 𝗘𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗻𝗴 𝗔𝗹𝗶𝗴𝗻𝗺𝗲𝗻𝘁 𝗮𝗻𝗱 𝗩𝘂𝗹𝗻𝗲𝗿𝗮𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀 𝗶𝗻 𝗟𝗟𝗠𝘀-𝗮𝘀-𝗝𝘂𝗱𝗴𝗲𝘀

<p>

𝐂𝐚𝐧 𝐋𝐋𝐌𝐬 𝐬𝐞𝐫𝐯𝐞 𝐚𝐬 𝐫𝐞𝐥𝐢𝐚𝐛𝐥𝐞 𝐣𝐮𝐝𝐠𝐞𝐬 ⚖️?</p>
<p>We aim to identify the right metrics for evaluating Judge LLMs and understand their sensitivities to prompt guidelines, engineering, and specificity. With this paper, we want to raise caution ⚠️ to blindly using LLMs as human proxy. </p>
<p>Aman Singh Thakur, Kartik Choudhary, Venkat Srinik Ramayapally, Sankaran Vaidyanathan, Dieuwke Hupkes</p>
<p>Arxiv link - <a href="https://arxiv.org/abs/2406.12624" rel="nofollow">https://arxiv.org/abs/2406.12624</a></p>
<p>Tweet Summary - <a href="https://x.com/iamsingh96aman/status/1804148173008703509" rel="nofollow">https://x.com/iamsingh96aman/status/1804148173008703509</a></p>
<p><a href="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/mB70GEv0weL-hxyRRFprz.png" rel="nofollow"><img alt="image/png" src="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/mB70GEv0weL-hxyRRFprz.png"/></a></p>
<p>Key findings -</p>
<p>🌟 𝗧𝗼𝗽 𝗣𝗲𝗿𝗳𝗼𝗿𝗺𝗲𝗿𝘀: Only 𝗚𝗣𝗧-𝟰 and 𝗟𝗟𝗮𝗺𝗮-𝟯 𝟳𝟬𝗕 shine among 9 judge models. However, they still fall short of inter-human annotator agreement.</p>
<p><a href="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/usY0q6d_iY0NnHIR0dmxd.png" rel="nofollow"><img alt="image/png" src="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/usY0q6d_iY0NnHIR0dmxd.png"/></a></p>
<p>📊 𝗘𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗼𝗻 𝗠𝗲𝘁𝗿𝗶𝗰: Scores assigned by judges with 80%+ percent alignment with humans can be 20 points apart! Cohen's kappa is a superior metric. </p>
<p><a href="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/i7CWzDBKfnwa8i5e09BaN.png" rel="nofollow"><img alt="image/png" src="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/i7CWzDBKfnwa8i5e09BaN.png"/></a></p>
<p>⚖️ 𝗥𝗮𝗻𝗸𝗶𝗻𝗴 𝘃𝘀 𝘀𝗰𝗼𝗿𝗶𝗻𝗴: Most aligned in scores != most discriminative, in some cases, judge models with low alignment such as Contains (lexical match), and JudgeLM-7B outperform better models in terms of 𝑟𝑎𝑛𝑘𝑖𝑛𝑔 models, because their biases are more systematic.</p>
<p><a href="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/dllGt9sZYrFdzRiHz195D.png" rel="nofollow"><img alt="image/png" src="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/dllGt9sZYrFdzRiHz195D.png"/></a></p>
<p>🧩 𝗟𝗲𝗻𝗶𝗲𝗻𝗰𝘆: Judge LLMs tend to be more lenient than strict.</p>
<p><a href="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/LwwQDmo3YEXC_YWkiCTW0.png" rel="nofollow"><img alt="image/png" src="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/LwwQDmo3YEXC_YWkiCTW0.png"/></a></p>
<p>🎭 𝗩𝘂𝗹𝗻𝗲𝗿𝗮𝗯𝗶𝗹𝗶𝘁𝘆: Judge LLMs can be easily tricked by controlled responses like "Yes," "Sure," and "I don't know."</p>
<p><a href="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/OPBJJlEzGMFfYDlFYN7rP.png" rel="nofollow"><img alt="image/png" src="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/OPBJJlEzGMFfYDlFYN7rP.png"/></a></p>
<p>🎯 𝗖𝗼𝗻𝘁𝗿𝗼𝗹𝗹𝗮𝗯𝗶𝗹𝗶𝘁𝘆: It's not easy to steer large models while smaller models get confused by adding too much detail. </p>
<p><a href="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/IDs2wjCsSXQ7dD9VJ_9rn.png" rel="nofollow"><img alt="image/png" src="https://cdn-uploads.huggingface.co/production/uploads/63b491f3103617b0a5af6b4b/IDs2wjCsSXQ7dD9VJ_9rn.png"/></a></p>
