Tag Archives: Research

Should Teachers Be ‘Psychologically Literate’?

A few years ago I reviewed ‘The Psychologically Literate Citizen’ for The Psychologist (the monthly publication of the British Psychological Society). In part I wrote:

“The editors of this interesting work have gathered together a diverse collection of articles by international researchers and writers in to examine the question of what must be taught to our students in order to ensure they are psychologically literate. By bringing a global perspective to the problem, they have produced a rather fascinating picture of where psychology currently stands and how it could move forward under a common vision”.

At the time, the phrase ‘Psychologically Literate’ was one I was only vaguely familiar with, however, about a year later I was involved in a BPS working group into the future of A-level Psychology where the phrase was used again.

This got me thinking about the extent to which teachers need to be psychologically literate and what psychological knowledge (if any) teachers would benefit from. Many teacher-bloggers are fast becoming amateur cognitive psychologists and I’ve read some great blog posts on topics that have been my bread and butter for the best part of two decades, so much so in fact that I refrain from blogging about many of these topics myself.

The majority of people become psychologically literate through academic study. The British Psychological Society retains what is known as a ‘watching brief’ over A-level Psychology (they advise but have no real input) whereas the majority of undergraduate psychology degrees are BPS accredited, meaning that they provide the foundation for graduates to work towards chartered status (the BPS hold the Royal Charter and therefore remain the only organisation that can award ‘Chartered Psychologist’ status – although the title ‘Psychologist’ remains unprotected). Undergraduate degrees in Psychology, therefore, need to include certain components deemed necessary by the BPS for psychological literacy.

Many teachers are psychologically aware, at least in terms of cognitive psychology (if you’ve read Dan Willingham’s ‘Why Don’t Students Like School’ you’ll have a basic grounding in cognitive psychology). However, psychology is much more than cognition and there is always the danger that it will take precedent over other possible fruitful areas such as developmental, behavioural, social and the complex interplay between cognition and emotion.

To be psychologically literate is also to be research literate, and again many teachers are becoming more skilled at spotting the weaknesses in educational and psychological research.

For example, many research studies into memory:

  • Are conducted using undergraduate psychology students (even though many published papers omit this and other details), leading to the possibility that participants will second guess the nature of the study and alter their behaviour accordingly.
  • Are carried out in highly controlled and artificial environments (thus lowering the chance that any results can be applied to real-world situations such as classrooms).
  • Look for general rules, thereby downplaying or ignoring individual differences.

There are ways of mitigating these problems, for example psychologists have used case studies of individuals whose memory has been impaired through disease or brain damage. While case studies provide incredibly detailed and rich data (much more so than laboratory experiments) they concern themselves with a single individual so cannot reach general conclusions.

While many teacher-bloggers are well aware of these and other problems, others lack the psychological literacy (and often the research literacy) to successfully critically evaluate many research studies. There is much more to critical analysis than sample size and at times the study may in fact warrant a smaller number of participants. One example might be a longitudinal study using a method such as experience sampling, which can produce huge data sets with a much lower number of participants. In this case, the researcher might be looking for variations at multiple time points rather than at two time points or between groups.

The possible danger here is that we employ strategies that looked great in the controlled conditions of the laboratory but simply don’t work in the classroom (or don’t work for the majority of students) and we start to kid ourselves that it works because that’s what this study or that study tells us.

I’m still pondering over whether teachers should be psychologically literate at all. If we conclude that they should be, then what do they need to know in order to make them so? If we conclude that there is no need, then should they refrain from employing psychological techniques in the classroom?

Justin Bieber, The Illuminati and Educational Research

Justin making the sign of the Illuminati

Justin making the sign of the Illuminati

I became embroiled in the most bizarre conversation recently. For some reason my lesson took an unexpected turn when a student suggested that Justin Bieber was a member of the shadowy Illuminati, the centuries old secret sect that reportedly rules the world and made famous by author Dan Brown (so not so secret after all). I then made the mistake of suggesting that this couldn’t possibly be true because the Illuminati themselves didn’t exist.

“They must exist,” retorted the student, “because Justin Bieber is a member, and so is Rihanna.”

The evidence base for this assertion was that one erroneous belief (the existence of the Illuminati) was supported by a second erroneous belief (that Bieber was a member of the said shadowy organisation).

Now this might simply seem like one of these daft conversations we often have with teenagers (and there are many) and yet it can be compared with other assertions made by the likes of purveyors of alternative medicine. One such ploy would be to suggest that the research community refuses to conduct trials on this therapy or that homeopathic remedy because it’s so effective that it would render all drugs redundant and destroy the profits of the pharmaceutical companies. In other words, the absence of evidence leads to the assumption that it must work.

Now, I’m not saying that education works in the same way, but I am drawn to the following quote on learning styles (specifically VAK) which appears in a 2001 edition of a book on accelerated learning by a well known educationalist:

The leading practitioners in NLP have spent many years characterising the ‘typical’ attributes of visual, auditory and kinaesthetic learners. The work is not research based. It is pragmatic and based on detailed elicitation and modelling.

Of course, the standout sentence here is ‘The work is not research based’ – why did nobody hear the alarm bells ringing?

In a similar way, many teachers (and once-upon-a-time teachers) use phrases like ‘it’s common sense’ or ‘I’ve always done it that way and it works’. If psychology has taught me anything it’s that so-called common sense assumptions are often wrong (for example, if a large crowd is present during an accident, help is less, not more, likely to be forthcoming). They often use these common sense assumptions to reject evidence outright, while others will cherry-pick the data that supports their common sense assumptions and reject that evidence which does not (so-called conformation bias) – of course, this is not confined to teachers.

Some things, on the other hand, we need to accept (or leave well alone) because we simply can’t test them empirically. It’s difficult for us to claim that play is or is not vital for learning because we can’t ethically conduct a study where one group of children are deprived of play. One way we can is to study the educational attainment of those children who have been brought up in isolation or extreme deprivation (including feral children). The problem here is that many of these children have experienced both physical and psychological abuse, increasing the number of confounding variables and making it nigh on impossible to isolate one specific cause. Another problem would be defining the concept of play – is daydreaming a type of internal play? If so, then how would we prevent a child from daydreaming?

Accepting that some things cannot be tested is one thing; accepting them as fact because they can’t be tested is something else altogether. Then again, accepting that education should be evidence based is perhaps the wrong road to take and accepting that it should be evidence informed is perhaps a better one.

UPDATE: I have recently been made aware that Justin Bieber has, in fact, been assassinated by the Illuminati and replaced with a robot.

Can teachers really be researchers?

As the debate over evidence-based teaching continues there appears to be two separate strands emerging:

Strand 1: Teaching should be evidence-based (or evidence-informed).

I certainly have no issue with this, although the view of ‘what works’ is perhaps a secondary debate.

Strand 2: Teachers should also be researchers.

At a superficial level this appears like a pretty good idea – imagine the amount of evidence teachers could gather if they were all carrying out their own research studies within their own schools?

To be honest, it’s more than likely that strand 2 would lead to complete chaos. Let’s face it; there is enough bad educational research out there already, without research naïve teachers adding to it.

I view educational research through the lens of a psychologist and hold a very similar view to other psychologist-teachers (e.g. @turnfordblog) that (in terms of science) if psychology is in the Dark Ages then Education is in the Stone Age when it comes to research. Thus, I tend to make references to psychology when discussing education and, as a result, I take a positivist view of the research process.

So what’s the problem?

This list is by no means exhaustive, but it does represent at least some of the issues that need to be discussed before strand 2 can be fully recognised.

1. Sample Size:

Small sample sizes are common is school-based educational research. The majority of schools in their entirety don’t have enough participants to ensure an acceptable sample size, so carrying out a study using a few classes can only give us some small indication of the effect of any independent variable. The other issue is that we can’t force our pupils to take part in a study and even when they do volunteer, they must still be given the right to withdraw themselves (or the data) from the study.

2. Replication:

The replication debate is huge in psychological research at the moment. It has been found that many of our long-standing assumptions about human behaviour are based on studies that simply cannot be replicated. Replication studies are rarely published, null hypothesis studies end up in a dusty cupboard somewhere or in a folder marked ‘failed studies’. One study doesn’t make a theory so implementing interventions based on the results of single teacher conducting a study in a single school with a small sample tells us very little about anything.

3. Generalizabilty:

Does a study conducted in a middle-class school with a low number of students receiving free school meals, below average number of ethnic minority pupils and low number of special need pupils tell us anything about those pupils in deprived, inner-city or ethically-mixed schools? If research is to be useful then it needs to inform us about learning, not just about learning is a particular school (although this data can be useful at a more local level).

4. Bias:

Accept it or not, we all want to be ‘right’. Bias is a major problem in psychology and there is no reason to believe it won’t also be an issue with the teacher who is trying to support a hypothesis (or perhaps prove a point). Bias is usually unconscious but can often also be deliberate.

5. Lack of research training:

I’m a teacher and a Chartered Psychologist. I’m also conducting research as part of a part-time PhD at the University of York. Even though I have a psychology degree, a Masters in Education, and have attended more research methods workshops and seminars than I care to recall, the process of research still often baffles me. Those teachers whose degrees have not included a substantial amount of science or social science research training are far from equipped to carry out serious research.

6. Analysing results – the use and abuse of statistics:

How would a teacher know if the results they have obtained are significant? Most undergraduates are baffled by statistics, as are many post-graduates and post-docs. A non-British academic recently told me that us Brits don’t do stats very well, mainly because the support isn’t there at undergraduate and post-graduate level. Statistical analysis is confusing and often very time consuming and even the best statistical software packages can seem like a long-forgotten language. What about p values? Should we trust effect sizes? Is it alright for us to shave off some of our outliers to get an acceptable level of significance (it’s not by the way – it’s called p-hacking and it very much a no no)? What about Type 1 and Type 2 errors?

What can be done?

I can only offer a few suggestions:

1. Don’t go it alone.

Partner up with other schools to get bigger sample sizes. Partner up with universities or research centres that can give advise on how to carry out research or involve you in some of their own research.

2. Replicate replicate, replicate.

Get other teachers in other schools to carry out the same study.

3. Publish/Blog results (even null hypotheses) – and accept advice/criticism.

Make others aware of what you are doing and take on board the advice offered. Let’s face it; sometime it’s hard to get past the egos that dominate the Internet. We all have something to say and we don’t like being criticised for it but if we’re serious about using research to inform our teaching we really need to get over it.

4. Get some training.

CPD is a major issue and most isn’t worth the time and effort (or money) involved. Introductory workshops in research methods are often cheap (and sometimes free) and there are plenty of resources available online (try OpenLearn from the Open University). Linking such CPD to a recognised research qualification would be a great incentive.

It’s perhaps time to move away from the debate about the acceptability of teacher-researchers and try to work out how it can be practically done. Even though there is a great opportunity here for educational research, there is an equally realistic possibility that it could end in disaster and confusion.

In which I ponder my life as part-time researcher.

This year I am celebrating ten years as a teacher. To be honest, I never thought I would make it this far and I have lost count of the amount of times I have considered packing it all in. I recall the exasperated looks on the faces of family andBusinessman juggling friends when I informed them that I was going to do a PGCE, “Really!” they exclaimed, “Are you sure?”

I was met with somewhat the same response when, this time last year, I decided to embark on a part-time, self-funded PhD. Some, I believe, thought me insane or at the very least suffering from some sort of psychotic break – but this was something I felt compelled to do and I’m glad that I took the deep and dangerous plunge.

So, here I am, almost at the end of my first year of what could turn out to be a six year obsession. Juggling teaching with research is a tricky task and I often feel that I would be better off doing one or the other rather than both simultaneously. Nevertheless, exposure to the research side of education is beginning to inform my teaching more and more and I am more than ever aware of the role such research could play in teaching generally. I also know a little bit more about the lives of my students because of my chosen area of research. Through tentative exploratory investigations I have gleaned information about how they see themselves as learners, how they feel about their own resilience and what they believe about intelligence (and the possible relationships between these factors). What I have certainly realised is that I want to understand more about their daily struggles; about why some of my sixth formers engage deeply with their studies while others don’t appear to be bothered about anything related to school. I’m also starting to understand a little bit more about the interaction between school and student, the complex connections between school culture and student attitudes.

I’ve also started to look at research methods in a new light and am currently investigating some exiting methods for studying students’ daily lives such experience sampling and regular ‘snippets’ of study-related conversation. I intend to blog about some of these soon.

On a more practical level, every day is hard. As a part-time student I have to organise my time carefully. I have supervision meetings, research group seminars and other events to carefully slot into my limited time. I have managed to attend only two events this year – the Institute for Effective Education conference at the University of York (for which I was granted time off from school) and the NTEN ResearchED event which was held on a Saturday. Both were excellent events – far better than any CPD course I’ve ever attended (and whole lot cheaper – an added bonus seeing as I have to foot the bill myself). I will, however, miss the British Psychological Society conference this year as well as the ResearchED conference in September but this all part of the process whereby I need to select what is necessary and what is feasible. More stressing, perhaps, is the ever-present possibility that I will run out of money before the completion of my research. There are few funding opportunities available for part-time postgraduate students and those that are available remain highly competitive – this is partly why the drop-out rate for part-timers is so high. There is also a kind of self-imposed pressure to publish during the course of the PhD and many would argue that publication is more important than the final thesis. I’m desperate to publish but there is a need to prioritise and my teaching always takes precedence.

Would I advise other teachers to embark on a PhD?
It’s a difficult question one that depends upon individual circumstances. A good supervisor is perhaps the key and I’m lucky in that respect but there are more pressing concerns related to time and finances. At some point I will need to approach other schools in order to obtain a more representative sample and this will eat further into my limited time. Family life is also an important factor to bear in mind and dividing time between study, work and family can become quite a juggling act. If you think you can do it then it can be very rewarding but remember that you don’t need to do a PhD to do research.

Teachers are ideally placed to engage in all kinds of research and there are plenty of ways to learn the basics of research design and implementation. The rewards are unlikely to be financial – a PhD just makes you an over-qualified teacher so it’s worth thinking about why you want to do it in the first place. You might be looking for a career change but for most, I suspect, it’s more to do with personal development. The financial commitment is perhaps the biggest concern (most PhD’s will set you back around £2000 a year and this could be for up to six years) and there is still that nagging feeling that self-funded PhD’s are somehow less worthy.

A PhD is challenging at the best of times but for teachers (and anyone who has to balance work with study) I suspect it’s more so. The benefits can only outweigh the costs however, both in terms of personal fulfillment and the opportunity to add to the research literature.