HackerPapers

arXiv:2402.02961cs.SE

GitBug-Java: A Reproducible Benchmark of Recent Java Bugs

André Silva, Nuno Saavedra, Martin Monperrus

Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.

Abstract

Bug-fix benchmarks are essential for evaluating methodologies in automatic program repair (APR) and fault localization (FL). However, existing benchmarks, exemplified by Defects4J, need to evolve to incorporate recent bug-fixes aligned with contemporary development practices. Moreover, reproducibility, a key scientific principle, has been lacking in bug-fix benchmarks. To address these gaps, we present GitBug-Java, a reproducible benchmark of recent Java bugs. GitBug-Java features 199 bugs extracted from the 2023 commit history of 55 notable open-source repositories. The methodology for building GitBug-Java ensures the preservation of bug-fixes in fully-reproducible environments. We publish GitBug-Java at https://github.com/gitbugactions/gitbug-java.

arXiv comments
Accepted to MSR '24
Journal reference
Proceedings of Mining Software Repositories Conference (MSR), 2024
DOI
doi:10.1145/3643991.3644884
Subjects
cs.SESoftware Engineering

On Hacker News

Linked by 1 identifiable commenter in 1 comment across 1 thread, from Mar 2024 to Mar 2024.

Comments linking this paper, per year.

Discussed in comments1 thread

  1. GitBug-Java: A Reproducible Benchmark of Recent Java Bugs 1 comment

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.