NeurIPS.cc/2024/Datasets_and_Benchmarks_Track
NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security
Minghao Shao Sofija Jancheska Meet Udeshi Brendan Dolan-Gavitt Haoran Xi Kimberly Milner Boyuan Chen Max Yin Siddharth Garg Prashanth Krishnamurthy Farshad Khorrami Ramesh Karri Muhammad Shafique