Amjad Altadmri
Neil C.C. Brown
ABSTRACT
Previous investigations of student errors have typically focused on samples of hundreds of students at individual institutions. This work uses a year's worth of compilation events from over 250,000 students all over the world, taken from the large Blackbox data set. We analyze the frequency, time-to-fix, and spread of errors among users, showing how these factors inter-relate, in addition to their development over the course of the year. These results can inform the design of courses, textbooks and also tools to target the most frequent (or hardest to fix) errors.
- M. Ahmadzadeh, D. Elliman, and C. Higgins. An analysis of patterns of debugging among novice computer science students. In Proceedings of the 10th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education, ITiCSE '05, pages 84--88, New York, NY, USA, 2005. ACM. Google Scholar
Digital Library
- N. C. C. Brown and A. Altadmri. Investigating novice programming mistakes: educator beliefs vs. student data. In Proceedings of the tenth annual conference on International computing education research, pages 43--50. ACM, 2014. Google ScholarDigital Library
- N. C. C. Brown, M. Kölling, D. McCall, and I. Utting. Blackbox: A large scale repository of novice programmers' activity. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education, SIGCSE '14, pages 223--228, New York, NY, USA, 2014. ACM. Google ScholarDigital Library
- P. Denny, A. Luxton-Reilly, and E. Tempero. All syntax errors are not equal. In Proceedings of the 17th ACM Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE '12, pages 75--80, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- T. Dy and M. M. Rodrigo. A detector for non-literal Java errors. In Proceedings of the 10th Koli Calling International Conference on Computing Education Research, Koli Calling '10, pages 118--122, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- M. Hristova, A. Misra, M. Rutter, and R. Mercuri. Identifying and correcting Java programming errors for introductory computer science students. In Proceedings of the 34th SIGCSE Technical Symposium on Computer Science Education, SIGCSE '03, pages 153--156, New York, NY, USA, 2003. ACM. Google ScholarDigital Library
- J. Jackson, M. Cobb, and C. Carver. Identifying top Java errors for novice programmers. In Frontiers in Education, 2005. FIE '05. Proceedings 35th Annual Conference, Oct 2005.Google ScholarCross Ref
- M. C. Jadud. Methods and tools for exploring novice compilation behaviour. In Proceedings of the Second International Workshop on Computing Education Research, ICER '06, pages 73--84, New York, NY, USA, 2006. ACM. Google ScholarDigital Library
- D. McCall and M. Kölling. Meaningful categorisation of novice programmer errors. In Frontiers In Education Conference, pages 2589--2596, 2014.Google ScholarCross Ref
- P. M. Sadler, G. Sonnert, H. P. Coyle, N. Cook-Smith, and J. L. Miller. The influence of teachers' knowledge on student learning in middle school physical science classrooms. American Educational Research Journal, 50(5):1020--1049, 2013.Google ScholarCross Ref
- E. Soloway and S. Iyengar, editors. Empirical Studies of Programmers: Papers Presented at the First Workshop on Empirical Studies of Programmers. Intellect Books, 1986. Google ScholarDigital Library
- A. Stefik and S. Siebert. An empirical investigation into programming language syntax. Trans. Comput. Educ., 13(4):19:1--19:40, Nov. 2013. Google ScholarDigital Library
- E. S. Tabanao, M. M. T. Rodrigo, and M. C. Jadud. Predicting at-risk novice Java programmers through the analysis of online protocols. In Proceedings of the Seventh International Workshop on Computing Education Research, ICER '11, pages 85--92, New York, NY, USA, 2011. ACM. Google ScholarDigital Library
Index Terms
- 37 Million Compilations: Investigating Novice Programming Mistakes in Large-Scale Student Data
Recommendations
Blackbox: a large scale repository of novice programmers' activity
SIGCSE '14: Proceedings of the 45th ACM technical symposium on Computer science educationAutomatically observing and recording the programming behaviour of novices is an established computing education research technique. However, prior studies have been conducted at a single institution on a small or medium scale, without the possibility ...
Novice Java Programming Mistakes: Large-Scale Data vs. Educator Beliefs
Teaching is the process of conveying knowledge and skills to learners. It involves preventing misunderstandings or correcting misconceptions that learners have acquired. Thus, effective teaching relies on solid knowledge of the discipline, but also a ...
Exploring Novice Programming Behavior over Time
ITiCSE '21: Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 2This work focuses on the effect that programming time has on novice programmers' interaction with two versions of the BlueJ programming environment that differ in compilation mechanism and error message presentation. We utilize programming process data ...
Comments