AI4VET4AI is a project focused on improving Vocational Education within Europe through understanding AI literacy gaps and implementing supportive actions, such as developing Innovation hubs and Educational content.
One of the supporting safety nets for deploying AI in the Educational context is Learning Analytics (LA). Learners leave behind digital traces that you can analyse to improve learning interventions, such as how chatbots talk to the Learner and which activities the Learner should take to reach their intended use. The use of digital traces in a cycle to improve Educational interventions is LA. LA is an established field of practice that has difficulties deploying at scale due to the Data maturity of educational organisations. This will also be true for large-scale deployment of tools such as ChatGPT. Suppose you want to understand the issues and solutions related to deployment. In that case, reading the LA literature is a good starting point.
There is a large-scale digital transformation program for Dutch tertiary Education known as Npuls. Within Npuls, there is a hub for AI and student data. Within that hub lies a team for LA’s best and worst practices. I (Alan Berg) have had the privilege to work with this team as well as within the AI4VET4AI project.
If you are interested in deploying generative AI in Education, these resources are helpful. Next, Manuel Valle Torre writes about what we have done over the last 18 months and points you to actionable resources.
The Journey
It’s been an exciting journey over the past year and a half for the Npuls Best and Worst Practices Learning Analytics project team, exploring the dynamic and ever-evolving landscape of Learning Analytics (LA). As we launch our third magazine, we’re thrilled to offer a quick recap of the valuable insights and practical guidance we’ve shared across our three publications so far. Our goal throughout has been to make LA concepts easily accessible and translatable into real-world educational practice.
Magazine 1: Laying the Foundation – Onwards to Success with Learning Analytics
Our inaugural magazine, “Onwards to Success with Learning Analytics,” served as a foundational guide for organizations embarking on their LA journey. We provided a comprehensive overview of the key facilitators and barriers that institutions encounter when implementing LA. This included a detailed literature review categorizing these factors into six crucial themes: cultural, frameworks, literacy and training, learning theory, ethical and legal considerations, and technical factors. We also highlighted the collaborative efforts of the Data Platform Onderwijs (DPO) coalition, showcasing how multiple MBO institutions are working together to make study data accessible and usable. Finally, we featured interviews with experts and practitioners, who shared their experiences and advice on navigating the challenges associated with the implementation of LA, emphasizing the importance of strategic buy-in, clear goals, and a collaborative approach.
Magazine 2: Empowering Students – Supporting Students with Learning Analytics
Building on the groundwork laid in our first issue, Magazine 2, “Supporting Students with Learning Analytics,” examined the specific realm of Student-Facing Learning Analytics (SFLA). We explored how SFLA empowers students by providing them direct access to their learning data, fostering autonomy and informed decision-making. The magazine outlined various forms of SFLA, such as descriptive feedback, personalized learning paths, and dashboards, highlighting their benefits and challenges. We also presented “success stories” from international and Dutch institutions, showcasing practical implementations and the lessons learned along the way. At the end, we initiated the discussion of integrating Generative AI into SFLA and the implications for student agency and reflection.
Magazine 3: Supporting Teachers – Supporting Teachers with Learning Analytics
And now, we are excited to release our latest publication, “Supporting Teachers with Learning Analytics“. This magazine brings the spotlight to Teacher-Facing Learning Analytics (TFLA), exploring how data and analytics tools can empower educators to understand and improve learning processes and outcomes. TFLA enables teachers to make data-informed decisions, adapt their instructional practices, and optimize teaching strategies for better student outcomes. The magazine covers the “what, why, and how” of TFLA, including benefits, the process for teachers to prepare for and use LA, and external factors like policy, privacy, and technical infrastructure that affect its success. We’ve gathered compelling practitioner stories through interviews with developers and leaders of TFLA pilots in the MBO, HBO, and WO sectors, offering real-world perspectives on implementation challenges and successes.
From setting the stage for LA adoption to empowering students and providing essential tools for teachers, our three-magazine series offers a complete picture of Learning Analytics in action.
Meetings and Workshops
Beyond our magazines, we’ve actively engaged with the community through various events. Last summer, we hosted a national meeting on LA adoption across Dutch higher-education sectors, and in late May, we held another successful national meeting focusing on LA and AI in education. We also had the privilege of leading a workshop at the 15th International Learning Analytics & Knowledge Conference (LAK25) on “Exploring Best Practices for Integrating Gen AI into Learning Analytics Dashboards,” sharing our insights and fostering discussion. For even more insights and updates, including details on these events and additional blogs and resources, be sure to visit our project page.
We encourage you to join our community and contribute to the ongoing conversation around LA innovation!
Final Thoughts
Within Education LA and AI are joined at the hip. Problems for LA deployment in Education are roughly the same as for AI. The output from the Npuls LA team is helpful for those starting in this complex and dynamically changing field. We hope you enjoy the linked content. Thank you, Manuel, for writing the team’s journey up.
