Toward practical mutation analysis for evaluating the quality of student-written software testsZalia Shams, Stephen H. Edwards
Publikationsdatum:
Zu finden in: ICER 2013 (Seite 53 bis 58), 2013
|
|
Zusammenfassungen
Software testing is being added to programming courses at many schools, but current assessment techniques for evaluating student-written tests are imperfect. Code coverage measures are typically used in practice, but they have limitations and sometimes overestimate the true quality of tests. Others have proposed using mutation analysis instead, but mutation analysis poses a number of practical obstacles to classroom use. This paper describes a new approach to mutation analysis of student-written tests that is more practical for educational use, especially in an automated grading context. This approach combines several techniques to produce a novel solution that addresses the shortcomings raised by more traditional mutation analysis. An evaluation of this approach in the context of both CS1 and CS2 courses illustrates how it differs from code coverage analysis. At the same time, however, the evaluation results also raise questions of concern for CS educators regarding the relative value of more comprehensive assessment of test quality, the value of more open-ended assignments that offer significant design freedom for students, the cost of providing higher-quality reference solutions in order to support better quality assessment, and the cost of supporting assignments that require more intensive testing, such as GUI assignments.
Dieses Konferenz-Paper erwähnt ...
Anderswo finden
Volltext dieses Dokuments
Toward practical mutation analysis for evaluating the quality of student-written software tests: Fulltext at the ACM Digital Library (: , 1386 kByte; : Link unterbrochen? Letzte Überprüfung: 2020-11-28 Letzte erfolgreiche Überprüfung: 2020-08-11) |
Anderswo suchen
Beat und dieses Konferenz-Paper
Beat hat Dieses Konferenz-Paper während seiner Zeit am Institut für Medien und Schule (IMS) ins Biblionetz aufgenommen. Beat besitzt kein physisches, aber ein digitales Exemplar. Eine digitale Version ist auf dem Internet verfügbar (s.o.). Aufgrund der wenigen Einträge im Biblionetz scheint er es nicht wirklich gelesen zu haben. Es gibt bisher auch nur wenige Objekte im Biblionetz, die dieses Werk zitieren.