Notes on: Turner,R., Sutton,C., Gray, C., Stevens, S., Swain, J. (2018). Student experiences of research methods education in college – based higher education.  Research in Post-Compulsory Education, 23(3), pp. 348-367. Available at: 10.1080/13596748.2018.1490089

Dave Harris

Research methods is a challenging area to engage with and students regularly demonstrate 'negative dispositions', while tutors see the topic as marginal. However employers apparently demand research method skills, so there's encouragement and investment. They focus on college-based rather than university-based and have done a small-scale national study actually to national surveys. Students can demonstrate positive attitudes and she applicability to real life. However such approaches are limited in terms of developing critical evaluation of research outcome and 'longer term development as researchers'(no page numbers).

The emphasis on research skills is fairly recent but has been extended to any HE provider, apparently because they will provide knowledge and skills such as critical analysis and problem solving which employers allegedly require. They also reflect 'the increasingly contested nature of knowledge', so students need to be prepared to live with change. Research skills have been seen as of high value in the marketplace and as important for future global competitiveness [I bet the reference is crap].

As a results research-based approaches have been developed in undergrad curricula, usually in the form of 'enquiry-based learning and problem-based learning'. Particular initiatives such as the 'Q-step program' have been developed between Nuffield, ESRC and HEFCE ( Nind et al 2015 Research in Post-Compulsory Education, 23(3), pp. 348-367. Available at: 10.1080/13596748.2018.1490089 ). Nevertheless, opportunities are variable. They did some studies.

Students commonly see themselves as consumers rather than producers of research which reflects a 'fixed conception of knowledge' for beginners. It is conventional to integrate opportunities to engage in research increasingly as the undergraduate degree program progresses, although this varies disciplines. Early engagement can have a positive impact, as long as it is 'appropriately framed' within a suitable pedagogy. There are often negative experiences with a significant impact, and negative attitudes have been widely documented [several references].

Turning to college-based HE, we encounter a different environment with less emphasis on research methods teaching and a little knowledge of experiences. They focused on data collected as part of a broader project run by the HEA to map provision and develop generic research methods provision [sounds bollocks]. There's been a report in Gray 2015. They developed their own questionnaires for second year sociology students looking at gender, context including college, programme studied level and mode of study, background qualifications. They then used liquor scales to gather reactions to a number of statements linking to research methods and awareness of methodological concepts. Then they went on to preferred methods of learning and the resources available. Finally they assessed confidence in undertaking qualitative and quantitative research on a 10 point scale. They piloted the questionnaire. They used survey monkey and distributed questionnaire widely, although they focused on England.

They got hundred and 62 responses from lecturers and 98 from students, 'a small response rate' but okay as far as they go. They realise that there could have been self-selection bias reflecting age, gender and social class, and possibly academic attainment. But this was just exploratory. They study students in social sciences and general areas such as 'Islamic studies, law, marketing, accounting and hospitality'.

[The demographics are almost irrelevant].64% were female and so might be expected generally report lower confidence. More had vocational qualifications or access courses than A-levels, and so might be expected to be 'less well prepared for the rigours of HE study ' and privileging practical rather than academic knowledge, skills rather than engaging with debate about methods, more likely to express disinterest, and this was an acute issue on first exposure

Generally, students had useful experience. Half of them had had experience of research methods in the survey [69% had a module name research methods in their courses, which is not all the same thing in my experience]. Their practical experience of 'some essential aspects of research methods training was limited', however [they were asked whether they had heard of or studied core aspects such as key concepts or methods of analysis]. They claim to be familiar with qualitative and quantitative research approaches, but reported less experience and knowledge of more specialist aspects. They were aware of issues such as validity and reliability but had not yet studied them. 'Only 14% of respondents reported studying the epistemological framing of research' [not at all surprising]. Of course the level at which they are studying will have an effect, but the closer they get to honours year, the more impact this is likely to have [only because of the stupid requirements to discuss epistemology in research projects — they can solve this by acquiring one of the speed dating sources that give definitions of hermeneutics in a paragraph].

The same goes with analysis. Lots had experience of producing bar and pie charts, but fewer had examine cross tabs or thematic analysis. This ties up with the finding of '"statistical anxiety"' among undergraduate students observed by Chamberlain et al. 2015  Chamberlain, J. M., Hillier, J., and Signoretta, P. 2015. “Counting better? An examination of the impact of quantitative method teaching on statistical anxiety and confidence.” Active Learning in Higher Education 16 (1): 51-66.

Overall, positive attitudes to research methods and recognition of their value were reported, even enjoyment, although this may 'reflect the limited depth to which they are engaging' — as complexity or challenge increases, these positive dispositions might decline. Qualitative methods are perceived as 'easier than quantitative methods', [despite? Because?] 'The relatively limited experience of qualitative methods of analysis', which must produce a 'limited appreciation of the rigours'. Some reason, the team did not anticipate this favouring of qualitative methods, and seem to have discovered the 'limited depth of methods of quantitative analysis' offered to students.

Those who did not find school maths easy had more chance of a negative perception of quantitative methods, as did those who preferred writing essays. Generally, those who used it tended to find qualitative methods easier to understand felt more confident and enjoyed asking people questions about '"real life situations"'.

Turning to pedagogy. Research methods are often taught in universities as stand-alone modules separate from the disciplinary content of degree programs and this 'can lead to passive engagement', and a perception of irrelevance. This is been noted by others. At the same time, small group teaching, project work and independent study is more common in colleges. Respondents certainly seen to agree with the statement that they enjoy applying research methods to real world problems and this might reflect the emphasis on problem or project-based learning. At the same time, 'respondents demonstrated a strong preference for lectures', even though they get smaller class sizes than university students. They also like practical exercises and tutorials and workshops, more so than more independent working, associated with 'problem or project-based learning'. Again the level of study might be important here.

The problem of project-based learning might be pursued, together with its underlying principles of active learning. There is an appetite to apply research to real world problems, although it is difficult to realise this in practice, and it does not mesh necessarily with problem or project-based learning. The problem is integrating the 'more abstract or sophisticated aspects of research methods (e.g. epistemological framing, concepts such as validity and reliability)' [at last!], And this could limit wider academic development and wider application research methods, to contexts found in employability.

Actual employer input seems to be limited. Instead research proposals reports and essays are widely used, and innovation and development is needed [NB the authors spell the plural of curriculum as curricular throughout].

There also needs to be more integration, that make research-based curricula inclusive of the whole provision. Some universities apparently do this [references], and it seems to have something to to with links with employers and the local community [ Benson, A. and Blackmore, D. 2003. “Can research methods ever be interesteding?” Active Learning in Higher Education 4(1): 39-55.; Edwards & Thatcher, 2004  A student-centred tutor-led approach to teaching research methods. Journal of Further and Higher Education, 28(2): 195- 206.  Winn, S. 1995. “Learning by doing: teaching research methods through student participation in a commissioned research project.” Studies in Higher Education 20 (2): 203-214.] [The same would apply there — are employers interested in epistemology?]

They think this is available study. They have identify the limits of current provision, for example focusing on descriptive statistics rather than the more complex forms of analysis especially in quantitative methods and not developing robust understandings theoretical and critical aspects, including reliability and validity. They are unprepared for universities [I'm not at all sure about this]. They are probably not prepared for dissertations. There are problems on resourcing pressures on space and your exits for students, but these are familiar problems. They still are well placed to meet the demands of employers and the skills agenda, which will include those 'theoretical conceptual and critical skills essential for the contemporary labour market' [bollocks]. Some of the problems like statistical anxiety seem to persist into universities. There is work going on. The limitations of the study are acknowledged.

[Very idealistic overall. Uncritical about students and how they cope with research methods course -- they get stuff from primers and the Web,even at doctoral level. Uncritical about research methods, critical analysis and what employers want, the skills agenda etc.  Is superficial audience research leading to PR research?]