text
WorkerSafetyQAEval: A new benchmark to evaluate worker safety domain question and answering
WorkerSafetyQAEval: A new benchmark to evaluate worker safety domain question and answering
new_line
new_line
text
Happy to share a new benchmark on question and answers for worker safety domain. The benchmark and leaderboard is available at 
Happy to share a new benchmark on question and answers for worker safety domain. The benchmark and leaderboard is available at 
new_line
resource
https://huggingface.co/datasets/codelion/worker-safety-qa-eval
dataset
codelion/worker-safety-qa-eval
https://huggingface.co/datasets/codelion/worker-safety-qa-eval
new_line
new_line
text
We evaluate popular generic chatbots like ChatGPT and HuggingChat on WorkerSafetyQAEval and compare it with a domain specific RAG bot called Securade.ai Safety Copilot - 
We evaluate popular generic chatbots like ChatGPT and HuggingChat on WorkerSafetyQAEval and compare it with a domain specific RAG bot called Securade.ai Safety Copilot - 
resource
https://huggingface.co/spaces/codelion/safety-copilot
space
codelion/safety-copilot
https://huggingface.co/spaces/codelion/safety-copilot
text
  It highlights the importance of having domain specific knowledge for critical domains like worker safety that require high accuracy. Securade.ai Safety Copilot achieves ~97% on the benchmark setting a new SOTA.
  It highlights the importance of having domain specific knowledge for critical domains like worker safety that require high accuracy. Securade.ai Safety Copilot achieves ~97% on the benchmark setting a new SOTA.
new_line
new_line
text
You can read more about the Safety Copilot on 
You can read more about the Safety Copilot on 
link
https://securade.ai/blog/how-securade-ai-safety-copilot-transforms-worker-safety.html
https://securade.ai/blog/how-securade-ai-safety-copilot-transforms-worker-safety.html
text
new_line
WorkerSafetyQAEval: A new benchmark to evaluate worker safety domain question and answering

Happy to share a new benchmark on question and answers for worker safety domain. The benchmark and leaderboard is available at 
https://huggingface.co/datasets/codelion/worker-safety-qa-eval

We evaluate popular generic chatbots like ChatGPT and HuggingChat on WorkerSafetyQAEval and compare it with a domain specific RAG bot called Securade.ai Safety Copilot - https://huggingface.co/spaces/codelion/safety-copilot  It highlights the importance of having domain specific knowledge for critical domains like worker safety that require high accuracy. Securade.ai Safety Copilot achieves ~97% on the benchmark setting a new SOTA.

You can read more about the Safety Copilot on https://securade.ai/blog/how-securade-ai-safety-copilot-transforms-worker-safety.html 

👍
codelion lunarflu Taylor658
➕
codelion
🚀
codelion