Browse all support services
We support businesses, communities and social enterprises through a range of support services, including advice, funding, events and property. Find out how we can help you.
The importance of student feedback in decision-making
The University of the Highlands and Islands is unique in Scotland with its offer of a blend of college and university level study.
Serving more than 40,000 students on campus and online, the university recognises that student feedback is an important indicator of quality in education and is increasingly used in evaluation and decision-making. In addition to small-scale feedback mechanisms at individual module level, and legacy mechanisms from the organisations, which came together to form the institution, the university gathers vital student feedback from three major annual surveys.
Two of these three major surveys are commissioned on behalf of the higher and further education funding bodies: the National Student Survey (NSS), which gathers feedback from final year students; and the Student Satisfaction and Engagement Survey (SSES), which seeks the same information from students at other points in their course of study.
The third major annual survey undertaken among students is the Early Student Experience Survey (ESES), an internal study which examines students’ experience of applications, inductions and their introduction to study.
The challenge: fragmented feedback
With so much student feedback available, the challenge was less in gathering data and more in ensuring it could be used to its full potential, explains Dr Heather Fotheringham, the university’s Evidence Based Enhancement Lead.
“Not only are these surveys important in maintaining our standing as a degree-awarding institution, but we also use this information in our annual quality monitoring at module, programme and faculty level. The responses we receive help us plan for changes to our curriculum and how it’s delivered, to reflect on past academic years and to plan for the future.”
The three annual surveys produced a vast quantity of information – which could be immensely valuable to faculty and staff across the institution – if they could easily access and interpret it. Dr Fotheringham and her team would spend weeks analysing the results of each survey, extracting and manipulating data to provide tailored insights to relevant departments.
The team were keen to investigate a data based solution that would reduce the amount of time they spent manually analysing and processing results, while maintaining ease of access and understanding for colleagues.
Delving into the data
When a university committee highlighted the opportunity to become a host organisation in The Data Lab’s MSc Placement Programme, Dr Fotheringham prepared a brief overview of the desired results of any project. Covering data collation and customisable reporting, the business intelligence elements were familiar to MSc student Karen Jewell, who was returning to study after a decade of workplace experience in business and data analysis roles.
“I knew I’d need more data science elements in order to use this project for my MSc,” explains Karen, “so Heather and I discussed what data was available, what business or operational problems it might be able to help solve, and how we could work to include that in the project.”
Together, they identified the potential to improve the processing of qualitative data through Natural Language Processing (NLP). Each of the three major surveys offered the opportunity for students to enter free text responses. While these responses often contained valuable insights, processing them required significant time from the team. Each comment would be reviewed manually, coded to identify which topic or topics were being referenced, and analysed to reveal the sentiments being conveyed on each topic.
Building a solution using NLP
“This process was quite time consuming,” explains Karen, “as the team had to trawl through each and every response. Using NLP, we were able to build a solution, which automatically coded comments against topics and correctly identified the sentiment of what was being said. This included making allowance for counter-intuitive sentiment tagging, for example when the answer is ‘nothing’, but the questions is ‘what could we improve?’, then that’s a positive sentiment! Filtering out these basic responses also meant that the team could spend more time focusing on analysis of the more substantive comments.”
With the University of the Highlands and Islands being spread over such a large geographical area, the team were well set up for remote collaboration, so when the covid-19 pandemic put paid to plans to have Karen join the team on-site for part of her placement, the project was unaffected.
Harnessing the power of data
The team were able to apply Karen’s model to a fresh dataset for the first time when the annual NSS results were released towards the end of the placement.
“Previously, Heather’s team would release headline data on the day NSS results were published,” Karen explains. “They would then have to spend weeks preparing bespoke analyses for various different departments and individuals. With our new model, full results were available to everyone within hours on the day of publication.”
While Karen used specialist data programmes such as Microsoft Power BI to design her solutions, the model was also made available in Microsoft Excel, ensuring that colleagues across the university could access and customise that data that mattered to them.
Using NLP, we were able to build a solution, which automatically coded comments against topics and correctly identified the sentiment of what was being said.Karen Jewell, MSc student
Uncovering hidden patterns
“Our goal was to have data that was more usable and more used,” explains Dr Fotheringham, “and to reduce the time we spent processing.” With the introduction of NLP and accessible tools, Karen’s project ticked both boxes for us. In future years, the keyword trend analysis incorporated within the NLP element will identify hidden patterns and themes in qualitative answers which may have gone unnoticed in human analysis, making the data ever more valuable as more results from all three major surveys are added to the dataset.
With more powerful data available, Dr Fotheringham is looking forward to expanding the role of student feedback in decision-making and ongoing quality monitoring, as well as the opportunity to undertake deeper analyses having freed up so much time previously spent processing.
Karen, too, has benefitted from the project. “I went back to uni to look at how data can be used to make better decisions and solve practical problems, rather than just providing historical benchmarks, and this project demonstrates that. Moving into a completely new type of organisation meant I also gained confidence in my own ability to adapt in new environments.”
With support from the Data Lab, both student and host had a positive experience with the MSc Placement Programme. “It was surprisingly easy to set up,” says Dr Fotheringham. “I’d expected a lot of bureaucracy but it all went through very quickly. I would recommend to other organisations that they consider hosting an MSc student – there is power in data and this is a chance to harness it.”
2021 programme now open
The Data Lab MSc Placement Programme is now open for summer 2021. Our cohort of 160 students will undertake 8-12 week paid placements to support host companies with defined short term projects which will form the basis of their MSc dissertation.
Learn more about The Data Lab MSc Placement Programme and how your organisation could benefit from having a highly motivated student apply their cutting-edge knowledge and skills to your organisation’s challenges. Our students are studying at universities across Scotland and specialise in topics including AI, data science and data engineering.
Due to the ongoing pandemic, we expect all summer 2021 placements to continue on a virtual basis, with host companies obliged to pay the National Living Wage to students as a minimum standard. We expect a number of additional placements to be available for the period of September – December 2021.
The Data Lab in the Highlands and Islands
The Data Lab aims to foster innovation that will help Scotland maximise value from data and artificial intelligence. The Data Lab’s Highlands and Islands hub opened in April 2019 and is located within An Lòchran on Inverness Campus. With support from Highlands and Islands Enterprise, in collaboration with The Scottish Government, Scottish Funding Council, Scottish Enterprise and Scottish Development International, it aims to provide the region with a dedicated centre to help build momentum and create further growth, skills and opportunities in the tech sector. It is at the centre of a support programme for businesses in the Highlands and Islands looking to innovate through the application of data science and AI to solving real world business problems.
Can we help you solve your problem?
Have a look at our support and get in touch to find out how we can help you.
Innovation
Get support, funding and expert advice through HIE’s innovation business support programmes.
Knowledge Library
Browse our knowledge library to see our latest case studies and playback training webinars and podcasts.