Cutts, Q. , Connor, R., Michaelson, G. and Donaldson, P. (2014) Code or (Not Code): Separating Formal and Natural Language in CS Education. In: 9th Workshop in Primary and Secondary Computing Education, Berlin, Germany, 5-7 Nov 2014, pp. 20-28. ISBN 9781450332507 (doi: 10.1145/2670757.2670780)
|
Text
135483.pdf - Accepted Version 521kB |
Abstract
This paper argues that the "institutionalised understanding" of pseudo-code as a blend of formal and natural languages makes it an unsuitable choice for national assessment where the intention is to test program comprehension skills. It permits question-setters to inadvertently introduce a level of ambiguity and consequent confusion. This is not in keeping with either good assessment practice or an argument developed in the paper that CS education should be clearly fostering the skills needed for understanding formal, as distinct from natural, languages. The argument is backed up by an analysis of 49 questions drawn from the national school CS examinations of a single country, spanning a period of six years and two phases -- the first in which no formal pseudo-code was defined, the second in which a formal reference language, referred to as a "formally-defined pseudo-code", was provided for teachers and exam setters. The analysis demonstrates that in both phases, incorrect, confusing or ambiguous code was presented in questions. The paper concludes by recommending that the term reference language should be used in place of pseudo-code, and an appropriate formally-defined language specified, in national exam settings where a common language of assessment is required. This change of terms emphasises the characteristics required of a language to be used for assessment of program comprehension. The reference language used in the study is outlined. It was designed by the authors for human readability and also to make absolutely explicit the demarcation between formal and informal language, in such a way that automated checking can be carried out on programs written in the language. Formal specifications and a checker for the language are available.
Item Type: | Conference Proceedings |
---|---|
Keywords: | assessment, comprehension, language, program, pseudo-code, reference |
Status: | Published |
Refereed: | Yes |
Glasgow Author(s) Enlighten ID: | Cutts, Professor Quintin and Donaldson, Mr Peter |
Authors: | Cutts, Q., Connor, R., Michaelson, G., and Donaldson, P. |
College/School: | College of Science and Engineering > School of Computing Science College of Social Sciences > School of Education > Pedagogy, Praxis & Faith |
Publisher: | ACM |
ISBN: | 9781450332507 |
Copyright Holders: | Copyright © 2014 ACM |
Publisher Policy: | Reproduced in accordance with the copyright policy of the publisher |
University Staff: Request a correction | Enlighten Editors: Update this record