Are These Bugs Really "Normal"?

Ripon K. Saha (1) , Julia Lawall (2) , Sarfraz Khurshid (1) , Dewayne E. Perry (1)

1 University of Texas at Austin [Austin]
2 Whisper - Well Honed Infrastructure Software for Programming Environments and Runtimes

Understanding the severity of reported bugs is important in both research and practice. In particular, a number of recently proposed mining-based software engineering techniques predict bug severity, bug report quality, and bug-fix time, according to this information. Many bug tracking systems provide a field "severity" offering options such as "severe", "normal", and "minor", with "normal" as the default. However, there is a widespread perception that for many bug reports the label "normal" may not reflect the actual severity, because reporters may overlook setting the severity or may not feel confident enough to do so. In many cases, researchers ignore "normal" bug reports, and thus overlook a large percentage of the reports provided. On the other hand, treating them all together risks mixing reports that have very diverse properties. In this study, we investigate the extent to which "normal" bug reports actually have the "normal" severity. We find that many "normal" bug reports in practice are not normal. Furthermore, this misclassification can have a significant impact on the accuracy of mining-based tools and studies that rely on bug report severity information.

Mots clés: Index Terms—Bug Severity; Bug Tracking System; Mining Software Repositories

Domaines: Génie logiciel [cs.SE]

Ripon K. Saha, Julia Lawall, Sarfraz Khurshid, Dewayne E. Perry. Are These Bugs Really "Normal"?. MSR 2015 - The 12th Working Conference on Mining Software Repositories, May 2015, Florence, Italy. ⟨hal-01240036⟩