Review of recent systems for automatic assessment of programming assignments

Petri Ihantola, Tuukka Ahoniemi, Ville Karavirta, Otto Seppälä

Publikationsdatum: 01.10.2010

Zu finden in: Koli Calling 2010, 2010

Diese Seite wurde seit 2 Jahren inhaltlich nicht mehr aktualisiert. Unter Umständen ist sie nicht mehr aktuell.

Zusammenfassungen

This paper presents a systematic literature review of the recent (2006--2010) development of automatic assessment tools for programming exercises. We discuss the major features that the tools support and the different approaches they are using both from the pedagogical and the technical point of view. Examples of these features are ways for the teacher to define tests, resubmission policies, security issues, and so forth. We have also identified a list of novel features, like assessing web software, that are likely to get more research attention in the future. As a conclusion, we state that too many new systems are developed, but also acknowledge the current reasons for the phenomenon. As one solution we encourage opening up the existing systems and joining efforts on developing those further. Selected systems from our survey are briefly described in Appendix A.

Von Petri Ihantola, Tuukka Ahoniemi, Ville Karavirta, Otto Seppälä im Konferenz-Band Koli Calling 2010 im Text Review of recent systems for automatic assessment of programming assignments (2010)

Dieses Konferenz-Paper erwähnt ...

Personen
KB IB clear

Kirsti Ala-Mutka , Anton Alstes , Anna Christine M. Amarra , Mario Amelung , Ryan Shaun Baker , Kay Barzen , Michael de Raadt , Stijn Dekeyser , Svetlana Drachova-Strang , Thomas Dy , Maria Beatriz V. Espejo-Lahoz , Peter Forbrig , Olly Gotel , Jason O. Hallstrom , Margaret Hamilton , Heather K. Harton , Michael T. Helmick , Robert E. Horn , David Jackson , Matthew C. Jadud , Joan Krone , Dana P. Leonard , Sheryl Ann L. Lim , Janne Lindqvist , Jan Lönnberg , Rainer Oechsle , Rich Pak , Sheila A. M. S. Pascua , Richard E. Pattis , Michael Piotrowski , Atanas Radenski , Ma. Mercedes T. Rodrigo , Dietmar Rösner , Christelle Scharff , Judy Sheard , S. Simon , Murali Sitaraman , Neil Smith , Jessica O. Sugay , Emily S. Tabanao , Pete G. Thomas , Michelle M. Usher , Kevin G. Waugh , Jarred White , Andrew Wildenberg , Tien Yu Lee

Fragen
KB IB clear

Wie lassen sich Computerprogramme bewerten/benoten?

Begriffe
KB IB clear

Programmieren

programming

Bücher

Jahr	Titel	Abrufe	IB	OB	KB	LB
1981	Karel the Robot (Richard E. Pattis)	7, 1, 4, 1, 7, 6, 5, 7, 7, 4, 8, 4	23	3	4	726
1997	SIGCSE 1997 (Curt M. White, Carl Erickson, Bruce J. Klein, James E. Miller)	6, 2, 1, 5, 2, 3, 7, 7, 2, 2, 5, 2	10	219	2	332
1998	Visual language (Robert E. Horn)	10, 2, 2, 6, 3, 4, 6, 8, 3, 1, 9, 2	13	17	2	794
2005	Computer Science Education 2/2005	2, 10, 2, 3, 4, 3, 8, 3, 2, 1, 4, 3	8	5	3	336
2006	Koli Calling 2006 (Anders Berglund, Mattias Wiggberg)	2, 1, 4, 3, 2, 6, 5, 1, 1, 2, 8, 4	8	52	4	351
2007	ITiCSE 2007 (Janet Hughes, D. Ramanee Peiris, Paul T. Tymann)	1, 1, 1, 8, 3, 3, 6, 5, 1, 4, 11, 3	57	264	3	1051
2008	ITiCSE 2008 (June Amillo, Cary Laxer, Ernestina Menasalvas Ruiz, Alison Young)	4, 2, 4, 4, 3, 6, 9, 6, 2, 1, 5, 2	37	274	2	1543
2009	ITiCSE 2009 (Patrick Brézillon, Ingrid Russell, Jean-Marc Labat)	1, 7, 4, 5, 5, 12, 3, 3, 1, 5, 8, 1	40	315	1	1271
2009	ICER 2009 (Michael J. Clancy, Michael E. Caspersen, Raymond Lister)	6, 2, 2, 6, 4, 3, 6, 5, 1, 1, 10, 3	21	33	3	394

Texte

Jahr	Titel	Abrufe	IB	OB	KB	LB
1997	Grading student programs using ASSYST (David Jackson, Michelle M. Usher)		2	4	0	0
2005	A Survey of Automated Assessment Approaches for Programming Assignments (Kirsti Ala-Mutka)		8	1	0	0
2006	Do students SQLify? (Michael de Raadt, Stijn Dekeyser, Tien Yu Lee)		1	3	0	0
2007	Checking automatically the output of concurrent threads (Rainer Oechsle, Kay Barzen)		1	2	0	0
2007	VERKKOKE (Anton Alstes, Janne Lindqvist)		1	2	0	0
2007	eduComponents (Mario Amelung, Michael Piotrowski, Dietmar Rösner)		1	2	0	0
2007	Computer assisted assessment of diagrams (Pete G. Thomas, Neil Smith, Kevin G. Waugh)		1	2	0	0
2007	Interface-based programming assignments and automatic grading of java programs (Michael T. Helmick)		1	4	0	0
2008	Digital CS1 study pack based on Moodle and Python (Atanas Radenski)		1	2	0	0
2008	Towards generic and flexible web services for e-assessment (Mario Amelung, Peter Forbrig, Dietmar Rösner)		1	2	0	0
2008	Teaching software quality assurance by encouraging student contributions to an open source web-based system for the assessment of programming assignments (Olly Gotel, Christelle Scharff, Andrew Wildenberg)		1	5	0	0
2009	Affective and behavioral predictors of novice programmer achievement (Ma. Mercedes T. Rodrigo, Ryan Shaun Baker, Matthew C. Jadud, Anna Christine M. Amarra, Thomas Dy, Maria Beatriz V. Espejo-Lahoz, Sheryl Ann L. Lim, Sheila A. M. S. Pascua, Jessica O. Sugay, Emily S. Tabanao)		1	2	0	0
2009	Engaging students in specification and reasoning (Murali Sitaraman, Jason O. Hallstrom, Jarred White, Svetlana Drachova-Strang, Heather K. Harton, Dana P. Leonard, Joan Krone, Rich Pak)		1	2	0	0
2009	Analysis of research into the teaching and learning of programming (Judy Sheard, S. Simon, Margaret Hamilton, Jan Lönnberg)	10, 1, 1, 2, 3, 1, 9, 7, 1, 1, 2, 3	3	1	3	200

Zitationsgraph

Diese SVG-Grafik fensterfüllend anzeigen

Zeitleiste

4 Erwähnungen

Koli Calling 2012 - 12th Koli Calling International Conference on Computing Education Research, Koli Calling '12, Koli, Finland, November 15-18, 2012 (Mikko-Jussi Laakso, Robert McCartney) (2012)
- A mobile learning application for parsons problems with automatic feedback (Ville Karavirta, Juha Helminen, Petri Ihantola) (2012)
Koli Calling 2015 - Proceedings of the 15th Koli Calling Conference on Computing Education Research, Koli, Finland, November 19-22, 2015 (Päivi Kinnunen, Judy Sheard) (2015)
- A low overhead automated service for teaching programming (Matija Lokar, Matija Pretnar) (2015)
ICER 2017 - Proceedings of the 2017 ACM Conference on International Computing Education Research, ICER 2017, Tacoma, WA, USA, August 18-20, 2017 (Josh Tenenberg, Donald Chinn, Judy Sheard, Lauri Malmi) (2017)
- Folk Pedagogy - Nobody Doesn't Like Active Learning (Kate Sanders, Jonas Boustedt, Anna Eckerdal, Robert McCartney, Carol Zander) (2017)
Informatics in Schools. A Step Beyond Digital Education - 15th International Conference on Informatics in Schools: Situation, Evolution, and Perspectives, ISSEP 2022, Vienna, Austria, September 26–28, 2022 (Andreas Bollin, Gerald Futschek) (2022)
- A Tool to Create and Conduct Custom Assessments in Turtle Graphics (Jeremy Marbach, Alexandra Maximova, Jacqueline Staub)

Anderswo finden

Volltext dieses Dokuments

Review of recent systems for automatic assessment of programming assignments: Fulltext at the ACM Digital Library ( lokal

, 180 kByte; WWW

)

Anderswo suchen

Beat und dieses Konferenz-Paper

Beat hat Dieses Konferenz-Paper während seiner Zeit am Institut für Medien und Schule (IMS) ins Biblionetz aufgenommen. Beat besitzt kein physisches, aber ein digitales Exemplar. Eine digitale Version ist auf dem Internet verfügbar (s.o.). Es gibt bisher nur wenige Objekte im Biblionetz, die dieses Werk zitieren.

Beats Biblionetz - Texte