5. Assessment strategies
In principle any type of assessment could be used on the modules discussed above. Like all forms of assessment, whatever is set should assess:
- the ability to structure an answer,
- writing and other stylistic features,
- ability to gather evidence and
- essay writing skills.
However, some specific elements of the heterodox perspectives discussed above should be assessed:
- the ability to establish a position and offer an opinion supported by some evidence, be it theoretical or empirical;
- evidence of having considered power;
- the ability to compare perspectives;
- evidence of having thought about method.
5.1 Assessment schema
Clearly, the extent to which those elements are assessed depends on the level and type of the module. For example, a first-year student may have less expected of them in terms of reflexivity, writing style and research skills, given that these are transferable skills developed during the higher educative process. Similarly, a student on an orthodox-plus module would have less stressed placed on comparison. The assessment scheme will also affect what is assessed: obviously, a scheme comprising only multiple choice tests will not improve essay writing skills or the ability to develop an argument. However, tests are good ways of quickly testing understanding.
Tests can be very useful in particular on contending perspectives modules. As Earl (2000) notes, students need to be eased into thinking comparatively. One way he suggests is to ask students to write essays and to provide extensive feedback on them. That process is very time consuming. Tests create space in the tutor’s time and can be conducted in-class for ease of organisation. An alternative of course is to use on-line tests, for instance programs which create unique sets of questions, and which are self-marking. Some examples of these are available at the Economics Network website. Both elements of those tests – the setting and marking of questions – remove an administrative burden from academic staff. Self-managed use of computer software can also assist learning. The only limitation in a heterodox or contending perspectives module is that most of the existing tests are geared towards orthodox content.
A final examination can be a way of testing all the skills simultaneously, through a mixed question format, incorporating short answer, data-response, medium-length and essay questions, all of which types the student would be expected to attempt. The short- to medium-length questions may be compulsory with students given a choice of essay question. Short answer questions may require simple factual responses – for instance to identify which of a list of economists could be regarded as either orthodox or heterodox. Other questions require slightly longer, more detailed answers – for instance to explain a particular model.
Perhaps best of all, essays test the ability to develop a position or opinion as well as conceptual understanding. Essays can be used as one element in a multi-method strategy. They can also form the main component of assessment. It may be that more than one essay is assigned. In that case, it may be wise to require shorter essays earlier on and give these less weight. That allows students who are unaccustomed to essays to adjust to them and is particularly important in the case of contrastive or position essays.
In this section, some examples of essay questions are presented. The examples can in principle be used on any of the module types discussed in this chapter, but some of the questions are more applicable to the types than others.
5.2.1 Mixed competence/criticism questions
All essays should demonstrate criticism and understanding, of course. However, some questions can be explicitly aimed at establishing that a student understands some theory before then explicitly asking them to engage in criticism or comparison.
An easy way to construct the separate elements of a question is to write it in multiple parts. For example, students may be asked to deal with a specific problem in consumer theory, before being asked critically to evaluate three of the assumptions underlying it. In the first part of the question they would be rewarded, as they would on any module, for technical correctness and logic of their answer. In the second part, the student is expected to elucidate the assumptions (indicating their understanding) before criticising them. They would be credited for drawing on the critical literature they may have been assigned. Exam questions could be a mixture of a similar type of questions. Clearly such questions target understanding and criticism, but also the ability to structure answers in a well-written way. They are most useful on orthodox-plus modules.
Whilst we expect all essays to display criticality, some questions can explicitly ask for it. Criticality can be of oneself: for example on econometrics modules, it is useful to ask students to complete a project and then ask them to raise objections to their own method.
On modules covering theory it is easier to ask students to directly criticise theoretical claims. For example, one might ask students to: ‘Evaluate the usefulness of game theory in understanding real-world phenomena such as cartels or arms races’; or ‘Evaluate whether neo-classical consumer theory is useful in explaining consumer choices’. Clearly, in both cases, if the question forms part of one of the module types described here, there would be an expectation that heterodox material is drawn upon. Similarly, one might ask students to: ‘Critically evaluate Galbraith’s claim in Affluent Society that advertising creates demands in consumers (Galbraith changed his own position later)’. That question would be suitable at either an introductory or higher level. It would sit well on any of the module types discussed, but obviously would be very much at home in a heterodox module.
Good answers to all of these questions will be able to identify weaknesses but contextualise them in the general nature of models.
5.2.3 Comparative questions
Comparative questions explicitly ask students to compare two (or more) positions. For example, on a heterodox module, one might ask: ‘Is competition good? Contrast competing heterodox positions on this question.’ Principally the students should compare the Marxian, Post-Keynesian and Austrian theories of competition, which all define and evaluate competition differently. This is a higher-level question. On a macroeconomics module, students could be asked to consider rival approaches to economic growth, with a focus on capital accumulation. Clearly, the question could be adapted to any module type, for instance by inviting students to compare orthodox and heterodox views on a specific topic. In this type of question, understanding is expected, as is the ability to organise a response. Crucially, comparative skill is assessed directly. Also, a good answer would identify the crucial criteria by which to compare the positions.
5.2.4 Position papers
The assessment issues are most interesting on the contending perspectives approach. A strategy has already been hinted at of using comparative essays to encourage students to reach a position by a reasoned argument. An extension of that is aimed at assessing – in addition to the other criteria for assessment discussed above – whether students could reach a position based on competing perspectives. In one microeconomics module taught in this way, the author asked students to write three position papers: one on consumers, one on firms and one on markets. As an example, the three papers from one run of the module were:
- How do consumers make choices?
- How do firms increase their profitability? Are these methods good or bad for society?
- Should markets or government be relied upon to organise economic activity? Explain your answer.
Clearly, conceptual understanding was an important criterion, but equally, indeed perhaps more importantly, the ability to construct an argument to reach a position – while doing justice to both sides of the debate – was highly significant. Of course, it was perfectly possible – and indeed often happened – that a student reached the conclusion that the right answer was to be found by synthesising the insights of both perspectives and bridging the gap between them. For example, although students accepted the persuasive effect of advertising, rejected the notion of unexplained preferences, and acknowledged the importance of social factors in individual choice, they would maintain that the choice remained individual, and that some sort of calculation of prospective well-being informed it.