Data Driven Optimization of LLMs