Big changes are happening in higher education this year and it's not just fees. Attending 'Thriving in an uncertain world' on 13 September is a must for heads of university language, linguistics and area studies departments or anyone who has any leadership role in these subjects.
The workshop will cover the following
Understanding and interpreting the National Student Survey, League Tables and Key Information Sets
Using the National Student Survey for quality enhancement
Understanding your national funding picture (different in England, Scotland, Northern Ireland and Wales)
Understanding resource allocation in your institution
Managing the budget of your department/section budget
Fees of up to £9000 at English universities may have dominated the news headlines in recent times but it is not the only big change in UK higher education scheduled for autumn 2012.
As part of my Fellowship of the Staff and Educational Development Association I have to write an annual review of what I have been doing and what I’ve learnt and what I plan to do for the future. We are then alloated 'triads' of other fellows and we will comment on each other's reports. I wanted to do something a bit different year as we don't have to submit as a written report. I couldn't think how I might do it differently, so I decided to make my report public, crowdsource my professional development I suppose.
Angst
I didn't think of "The Scream" when I used the word 'angst', but this image appears on the wikipedia 'angst' page.
This year has been the most challenging of my career so far. Last year the Higher Education Academy took the decision to withdraw funding from its 24 subject centres. The decision focused my mind somewhat. What had we achieved as a team in the lifetime of the subject centre? Where were we going to go from here? More crucially what had I achieved in the eight years I had been part of the team? Where was I going?
Subject centres, LLAS at least, was very much a we organisation. This was great on one level, but I had found it increasingly difficult to distinguish myself from subject centre. I have also learnt a lot about how people see subject centre staff, and I don’t always like it. In 2010 I wrote a short piece for the Teaching in Higher Education about the identity of subject centre staff in the educational development community. The anonymous referee was adamant that subject centre academic coordinators are essentially administrators though one or two do some good pedagogic work (we need adminstrators of course, but I sensed very negative undertones in the reviewer's use of the word). I wanted to raise awareness about the job I did and somebody seemed to be suggesting that I had misinterpreted my own job. The reviewer said that he/she was a member of a subject centre advisory board—my first response was that I hoped they weren’t on our advisory board. I have always wanted to be taken seriously as an academic. I'm not sure that I am.
As the 2010-11 academic year drew to a close my angst increased. Our director did some good work in persuading the powers at be in Southampton that it was worth keeping LLAS work going as an independent unit—another opportunity though painful reflection was involved too. Who were we? Could we continue as we were? (How) would we have to change? The team, which had grown through Routes into Languages and Links into Languages would have to be much smaller. We had to reapply for our jobs. I was fortunate in this process, but lost a day of week of hours. We still had some funding from the HEA, but we needed to start charging for the sorts of activity which used to be free or low cost. And we had to start getting the funding in to keep going.
What have I done this year? What have I learnt?
Innsbruck. Location of our second SPEAQ project meeting, May 2012.
The LLAS work
One of the challenges with the subject centre goings on has not been the changes which have taken place, but the continuity. As usual I organised and participated in workshops for Heads of Department, a workshop for new academic staff and a workshop on sustainable development in the humanities. I have received funding from the British Academy to produce an online statistics books for humanities students under the Academy’s Languages and Quantitative Skills Programme. I have long been dissatisfied with statistics textbooks. In my opinion they explain too little and assume that the reader will take concepts such as the normal distribution as an article of faith. The book uses the sorts of examples that humanities students will use such as historical and population data. I hope that by providing a more verbal resonating approach the book will help students (and academics) who find quantitative data difficult to deal with.
I edited two further editions of Debut: the undergraduate journal of languages, linguistics and area studies. In the latest issue my editorial reflects on the concept of publishing undergraduate research, how good it needs to be and how undergraduates journals help students to complete the research cycle. I am also part of LLAS’s EU-funded Sharing Practice in Enhancing and Assuring Quality(SPEAQ) project which, in my view at least, seeks to allow students and academics to reclaim ‘quality’ for themselves. I often feel that the term ‘quality’ has become increasingly associated with ‘tick-box’ approach to teaching which has little, if anything to do with the learning experience. We have developed a workshop to enable students, lecturers and quality managers to come together to reflect on the concept of quality.It has been interesting to learn about the experiences of academics from other countries who are our partners in the project.
I also headed up the organisation of the main LLAS biennial conference, the first of the post-HEA era. This year it was called 'Language Futures' and was held in Edinburgh.
Islamic Studies
One of my first tasks of the 2011-12 academic year was to provide maternity cover for my colleague Lisa who was coordinating the HEA’s Islamic Studies Network. As a non-expert in the field I knew this would be challenging, but with the closure of the subject centres most team members left the project too. Lisa was kind enough to draw up a plan of what had been done and what needed to be done. My main task was to begin the post-Islamic Studies Network (funding is about to end) sustainability plan. I drew up the consultation questionnaire over the Christmas period and we received over 50 responses. Now that Lisa is back this work is her capable hands and it looks likely some sort of scholarly association for Islamic Studies will be formed in the near future. I was fortunate to be able to draw on the wisdom and enthusiasm of the Advisory Board members.
Other University of Southampton work
I have been part of the University of Southampton’s participation in Green Academy, a scheme run by the Higher Education Academy to support institutions in embedding sustainability in the curriculum and overall life of the institution. One of the key achievements of our participation is that we have secured funding for full time programme assistant who is working on embedding sustainability into the CORE (curriculum, operations, research, experience) of the University of Southampton.
I will also be involved in teaching on a new Southampton-wide module: Sustainability in the Local and Global Environment. As in previous years I have also contributed sessions on employability and writing book reviews to the Faculty of Humanities Doctoral Training Programme.
The entrepreneurial John
I have used my 'non-working' time to develop skills in new areas. I have developed a website in Drupal called yazikopen a portal for open access research into learning and teaching modern languages. This has been a steep learning curve on the technical side of things as I do not have a background in web development. I am pleased that the website is functional, but I would like to work out ways to grow the website and see if there is any way enabling the website to generate revenue to cover its costs. I have also been being doing some freelance work and hope to develop further in this area.
Hope (Future plans)
At LLAS I am again organising a workshop for Heads of Department which will focus on the growing sources of public information about teaching in higher education (e.g. National Student Survey, Key Information Set etc.). I will also be putting in bids for various projects. I would like to continue development of the yazikopen website and will look for further freelancing opportunities.
I also hope to have a say in the open access debate. If true open access is to become a reality universities have a greater role to play in academic publishing.
Today marked a new era in UK higher education. Nothing to do with tuition fees, the Research Evaluation Framework (REF), league tables or funding. The University of Birmingham showed what must be an unprecedented step of leadership. They advertised a job as an Honorary (i.e. unpaid) Research Assistant. Working as an unpaid research assistant at the University of Birmingham includes perks such as a desk in the Psychology department, a library card and a refund for the petrol you use driving around in your own car to conduct the research. Although Birmingham eventually withdrew the advertisement, the dam has been breached. Despite the moral and legal issues involved it is only a matter of time before another university advertises similar positions.
The tragedy of the Birmingham advert is that there would have been no shortage of applicants. This time ten years ago I sat my PhD viva. I had spent most of the previous nine months doing a data entry job, despondent that seven years of university had not yielded the rewards I had hoped for. I was tempted to offer my services free to a nearby university to get some more teaching experience or research experience, but I couldn’t bring myself to do it. My guess is that there are early career academics out there that not only thought the same thing, but actually offered their services. I also suspect that some universities that have accepted these offers. As it happens my career has been a really interesting one, albeit very different from the one I expected to have. Things were tough then; now they are even harder. Talented PhD graduates and not so recent PhD graduates, world experts in their field doing any work which will pay, spending their evening writing books and articles, hoping not for the dream academic job, but any academic job. They would happily join a university as an unpaid research assistant just to get a foot in the door.
As an undergraduate I regarded academia as a higher calling. A university was a place where the highest moral and ethical standards were upheld. I saw universities as fair places, where ideas were exchanged freely and frankly and where people progressed in the careers because they were good people doing their teaching and research to the best of their abilities and being rewarded on the merits of their achievements.
I have few complaints in life but enough has happened in the past fifteen years or so to disabuse myself of any such notion. But I have always clung to the view that universities were somehow different to the banks, multinational corporations, the City. Today the University of Birmingham led us into a new era.
I will be faciliating an interactive workshop as part of our EU-funded SPEAQ (Sharing Practice in Enhancing and Assuring Quality) project along with my colleagues Alison Dickens and Laurence Georgin where we will be exploring how good quality teaching is understood by lecturers, students and quality managers.
My colleague Angela Gallagher Brett will be chairing a sessions on the Routes into Languages programme. Kate Borthwick will be presenting about FAVOR (Finding a Voice through Open Resources- a poject aimed mainly at part-time teachers) and about Open lives which is digitising research resources documenting the migration experiences of Spanish emigrés for open access.
I’ve been thinking a lot about student engagement since my trip to Nottingham a couple of weeks ago. The theme of that conference was ‘student engagement’ and my task was to speak about the National Student Survey. During the course of the discussion a student opined that student engagement is often seen as synonymous with doing surveys of students. And as I often hear students are getting all surveyed out.
The news that the Bill and Melinda Gates Foundation has given over $1 million to Clemson University to research “‘Galvanic’ bracelets that measure student engagement” is responded to with incredulity by Valerie Strauss in her blog for the Washington Post. Clemson University’s website describes the project thus:
Purpose: to conduct a pilot study to measure student engagement physiologically with Galvanic Skin Response (GSR) bracelets, which will determine the feasibility and utility of using such devices more broadly to help students and teachers.
According to Wikipedia (a source I only use for find out things I don’t know anything about), Galvanisitc Skin Response (GSR) is also known as skin conductance:
Skin conductance, also known as galvanic skin response (GSR), electrodermal response (EDR), psychogalvanic reflex (PGR), skin conductance response (SCR) or skin conductance level (SCL), is a method of measuring the electrical conductance of the skin, which varies with its moisture level. This is of interest because the sweat glands are controlled by the sympathetic nervous system,so skin conductance is used as an indication of psychological or physiological arousal. There has been a long history of electrodermal activity research, most of it dealing with spontaneous fluctuations or reactions to stimuli.
Whilst I share Strauss’s scepticism (despite my total ignorance of this field of study), this project brings in another dimension to debates about measuring student engagement. Is there a ‘Brave New World’ in which teacher evaluation instruments will be replaced with student sweat analysis? Will the perception of scientific objectivity appeal to policy makers?
Times Higher Education last week reported on a talk at the UCU annual congress stating that the National Student Survey is being used to evaluate the performance of individual teachers in some universities. Needless to say, but I'll say it anyway, it is not the purpose of the NSS to evaluate individual teachers.
This blog post is based on a short talk I did at the NUS-HEA Student Engagement Conference in Nottingham on 12 June 2012. I was one of four panelists talking about feedback from students. I was asked to give a sceptical perspective on the National Student Survey.
Last year I wrote a short article on how lecturers could make use of the NSS as a tool for improving the quality of teaching and learning. I came up with 5 main tips.
These were:
Don’t chase the ratings
Don’t blame other people
Look at the free-text comments (people often forget this section of the NSS exists).
Compare with your institution’s own data
Talk to your students
I put a positive spin on the NSS in that article. However, I may as well have said “Number 6: Ignore the National Student survey”.
I have been asked to provide a sceptical viewpoint on the NSS. Here I will give three reasons to be sceptical.
1. Questions are ambiguous
Consider Question 19: This course has enabled me to present myself with confidence.
What does this question mean? These are some of the ideas staff and students came up with in a project I worked on last year.
What this question might mean
Possible assumptions
Other issues
EmployabilityDoing oral presentations
Feeling confident in person
Interviewing skills
Self-belief
Able to express opinions without fear.
Able to challenge the opinions of others.
Not anxious
Students can stand up for themselves
Students are confident they will get a good job.
Students were unable to present themselves with confidence at the beginning the course.Confidence comes from going the course.
Presenting oneself with confidence is a good thing (some students might benefit from being less confident)
A course which does not help students present themselves with confidence is not a good course.
The student who answers this question in negative might have been better off doing a different course or studying at a different place.
Confidence might come from sources other than the course e.g. student societies, increased age, work experience, time spent abroadDoes a negative answer to this question suggest that the course was in any way inadequate?
Some evidence of students thinking about L2 language confidence, but this question was for students of all disciplines.
Students who answer this in the negative are saying something bad about themselves.
Student anxiety or lack of confidence indicates poor teaching or course design.
2. There is no significant difference between institutions at subject level
Measures of overall satisfaction will be included in the Key Information Set which is about to be launched. The KIS is meant to help students with choosing a university. However the NSS does not really help students in differentiating between institutions. In 2010 41 institutions returned scores for French. In response to question 22: “Overall, I am satisfied with the quality of the course”, the highest score was 100% agreement and the lowest was 70%. Quite a big difference? Yes, but when you look at the confidence limits you see that the 70% institution could have been as high as 89%. The real ‘score’ for the institution with 100% could have been as low as 83%. So statistically speaking the institution which came last might actually have a higher real score than the institution which came first!
French overall satisfaction with confidence intervals (NSS, 2010)
I think that the using the NSS to compare institutions is like to trying to identify the best cyclist in one of those cycling races where the whole peloton crosses the finishing line together. One cyclist will be first across the line, but is he or she the best? In today’s stage of the Tour de France it will be one person. Next time this happens it will be someone else. Oh, and they all get given the same time anyway, so it really doesn’t make any difference.
3. No use for quality enhancement
Those with an eye for NSS history will know that the survey was inspired by the Australian Course Experience Questionnaire (CEQ). The CEQ was designed a performance indicator for assessing the quality of teaching in higher education. It is not very useful in improving the student learning experience and I am not entirely sure whether it was meant to be. It can identify departments or institutions which have performance problems, but it does not contain any clues as how teaching might be improved.
Conclusion : why the NSS's weakness help improve the student learning experience
So in conclusion the NSS is ambiguous, of little help to potential students, and little use in improving the student learning experience. Ironically though the NSS is actually quite useful for quality enhancement—not because it is useful in itself, but because lecturers spend a lot of time thinking and talking about how to respond to the NSS. Most of the time they are saying what a bad survey it is. That’s what makes the NSS successful. It gets people talking and about teaching and learning. And because they talk and think they make improvements. Perhaps the NSS isn’t so bad after all.