Test Code Flakiness in Mobile Apps: The Developer’s Perspective DOI Creative Commons
Valeria Pontillo, Fabio Palomba, Filomena Ferrucci

et al.

Information and Software Technology, Journal Year: 2024, Volume and Issue: 168, P. 107394 - 107394

Published: Jan. 6, 2024

Test flakiness arises when test cases have a non-deterministic, intermittent behavior that leads them to either pass or fail run against the same code. While researchers been contributing detection, classification, and removal of flaky tests with several empirical studies automated techniques, little is known about how problem in mobile applications. We point out lack knowledge on: (1) The prominence harmfulness problem; (2) most frequent root causes inducing flakiness; (3) strategies applied by practitioners deal it practice. An improved understanding these matters may lead software engineering research community assess need for tailoring existing instruments context brand-new approaches focus on peculiarities identified. address this gap means an study into developer's perception flakiness. first perform systematic grey literature review elicit developers discuss wild. Then, we complement through survey involves 130 aims at analyzing their experience matter. results indicate are often concerned connected user interface elements. In addition, our reveals perceived as critical developers, who pointed major production code- source code design-related flakiness, other than long-term effects recurrent tests. Furthermore, lets diagnosing fixing processes currently adopted limitations emerge. conclude distilling lessons learned, implications, future directions.

Language: Английский

Test Code Flakiness in Mobile Apps: The Developer’s Perspective DOI Creative Commons
Valeria Pontillo, Fabio Palomba, Filomena Ferrucci

et al.

Information and Software Technology, Journal Year: 2024, Volume and Issue: 168, P. 107394 - 107394

Published: Jan. 6, 2024

Test flakiness arises when test cases have a non-deterministic, intermittent behavior that leads them to either pass or fail run against the same code. While researchers been contributing detection, classification, and removal of flaky tests with several empirical studies automated techniques, little is known about how problem in mobile applications. We point out lack knowledge on: (1) The prominence harmfulness problem; (2) most frequent root causes inducing flakiness; (3) strategies applied by practitioners deal it practice. An improved understanding these matters may lead software engineering research community assess need for tailoring existing instruments context brand-new approaches focus on peculiarities identified. address this gap means an study into developer's perception flakiness. first perform systematic grey literature review elicit developers discuss wild. Then, we complement through survey involves 130 aims at analyzing their experience matter. results indicate are often concerned connected user interface elements. In addition, our reveals perceived as critical developers, who pointed major production code- source code design-related flakiness, other than long-term effects recurrent tests. Furthermore, lets diagnosing fixing processes currently adopted limitations emerge. conclude distilling lessons learned, implications, future directions.

Language: Английский

Citations

0