Automated Program Repair, What Is It Good For? Not Absolutely Nothing!

Automated Program Repair, What Is It Good For? Not Absolutely Nothing!

April 14–20, 2024, Lisbon, Portugal | Hadeel Eladawy, Claire Le Goues, Yuriy Brun
The paper "Automated Program Repair, What Is It Good For? Not Absolutely Nothing!" by Hadeel Eladawy explores the impact of automated program repair (APR) on developers' debugging processes. The study, conducted with 40 experienced developers, examines how access to code suggestions, whether correct or deceptive, affects debugging success and speed. Key findings include: 1. **Debugging Success**: Access to any code suggestion significantly increases the likelihood of submitting a patch. Correct suggestions increase the odds of successful debugging by 14,000%, while deceptive suggestions decrease the odds by 65%. 2. **Debugging Time**: Correct suggestions speed up debugging compared to deceptive suggestions or no suggestions at all. 3. **Deceptive Suggestions**: Despite recognizing that deceptive suggestions are of lower quality, 67.5% of participants still submitted overfitting patches, indicating that recognizing low-quality suggestions may not fully mitigate their impact. 4. **Experience**: Surprisingly, no significant difference was observed in how novice and experienced developers were affected by APR, suggesting that APR may be beneficial for developers across the experience spectrum. 5. **Behavioral Impression**: Developers generally have a positive impression of APR, despite existing challenges in the quality of APR-generated repairs. The study highlights the potential benefits of APR in speeding up the debugging process, but also underscores the need for improvements in the quality and reliability of APR-generated patches.The paper "Automated Program Repair, What Is It Good For? Not Absolutely Nothing!" by Hadeel Eladawy explores the impact of automated program repair (APR) on developers' debugging processes. The study, conducted with 40 experienced developers, examines how access to code suggestions, whether correct or deceptive, affects debugging success and speed. Key findings include: 1. **Debugging Success**: Access to any code suggestion significantly increases the likelihood of submitting a patch. Correct suggestions increase the odds of successful debugging by 14,000%, while deceptive suggestions decrease the odds by 65%. 2. **Debugging Time**: Correct suggestions speed up debugging compared to deceptive suggestions or no suggestions at all. 3. **Deceptive Suggestions**: Despite recognizing that deceptive suggestions are of lower quality, 67.5% of participants still submitted overfitting patches, indicating that recognizing low-quality suggestions may not fully mitigate their impact. 4. **Experience**: Surprisingly, no significant difference was observed in how novice and experienced developers were affected by APR, suggesting that APR may be beneficial for developers across the experience spectrum. 5. **Behavioral Impression**: Developers generally have a positive impression of APR, despite existing challenges in the quality of APR-generated repairs. The study highlights the potential benefits of APR in speeding up the debugging process, but also underscores the need for improvements in the quality and reliability of APR-generated patches.
Reach us at info@study.space
Understanding Automated Program Repair%2C What Is It Good For%3F Not Absolutely Nothing!