PPM

Programming Problem Merging

A dynamic benchmarking strategy that focuses on merging two different problems to create new problems free of contamination for accurate LLM evaluation.

Coming Soon

We're currently working on expanding the PPM page with detailed information about Programming Problem Merging methodology, results, and implementation details. Stay tuned for updates!

Citation

If you use PPM in your research, please cite our paper:

@article{chen2024ppm,
  title={Programming Problem Merging: A Dynamic Benchmarking Strategy for Code Generation LLMs},
  author={Chen, Simin and Pusarla, Pranav and Ray, Baishakhi},
  journal={arXiv preprint arXiv:2401.15545},
  year={2024}
}
View on arXiv