SlideShare a Scribd company logo
Visions of the Future
of learning analytics
Dr Doug Clow
Institute of Educational Technology, The Open University, UK
@dougclow
dougclow.org
doug.clow@open.ac.uk
#laepanalytics
visions of the future
3
LAEP Visions of the Future of Learning Analytics
5
Photo CC BY-NC-ND J Sibiga Photography https://flic.kr/p/8jkiNi
6
Photo CC BY-NC-ND J Sibiga Photography https://flic.kr/p/8jkiNi
Policy Delphi
Process
• Iterative development of
Visions
• Online survey (N=133)
– individually-invited experts
– open call
• Live events feedback
– SoLAR Flare, Milton Keynes, UK
– Institutional Readiness Day,
Amsterdam, NL
– Dé Onderwijsdagen,
Rotterdam, NL
– Bett, London, UK
• Analysis
7
Photo CC BY Wietse van Bruggen for LACE
the visions
1: Monitored by the physical environment
9
Photo CC BY-ND SMI Eye Tracking https://flic.kr/p/droxkC
• Tools fitted with sensors
• Cameras (face, movement)
• Alerts for boredom,
confusion, off-task
• Social monitoring
2: Personal data tracking supports learning
• Sensors for posture,
attention, rest, stress,
blood sugar, metabolic
rate, …
• Swimming, driving, and
passing examinations
• Optimise for ages and
courses
• Self-monitoring
3: Analytics are rarely used
11
Photo CC BY-SA Andrew3000 https://flic.kr/p/Sc5VK
• Automated = inferior
• Gaming the system
• Leaks and misuse of data
• Permission from learner
and inspectorates
• Move away from analytics
4. Learners control their own data
Photo CC BY-ND Stuart Conner https://flic.kr/p/7jR8xf
• Learners control
data sharing
• Can limit access
• No permission =
no data
• Awareness
campaigns about
risks and benefits
5. Open systems widely adopted
Photo CC BY connectors distribution box https://flic.kr/p/ddkbR3
• Open Learning
Analytics
• Joined-up approach
• Agreed set of
standards
• Interoperability
• Work with many
providers
6: Analytics are essential tools
14
• Lots of data about learner behaviour
• Good predictions of study success
• Recommendations
• Live, reliable, personalised
• Rapid funding changes
Photo CC BY-SA Beau Considine https://flic.kr/p/m6Vqih
Photo (CC)-BY-SA Lauren Macdonald https://www.flickr.com/photos/42386632@N00/8528725328
7: Analytics help learners make the right choice
• Enormous datasets
• Reliable evidence-based
recommendations about
most successful routes
• Better than the best humans
8: Teaching delegated to computers
16
Photo CC BY-SA Iriss Photo Collection https://flic.kr/p/a4Qv3e
• No curricula
• Learners decide learning goals
• Group collaboration, mentors
• Individualised formative assessment
• Engaged, autonomous
themes in responses
Some themes in responses
• Pedagogy – appropriate analytics, how teaching & learning needs
to change
• Power – who needs to change, who has control
• Privacy and Ethics
• Complexity – and subtlety
• Validity – generalisability, meaningful, worthwhile
• Alienation – need to keep humans involved
• Regulations – guidelines, policy, laws
• Standards – interoperability
18
headline findings
20
Photo CC BY-NC Martin LaBar https://flic.kr/p/tPmZo
Great potential
Will it be reached?
Policies and infrastructure
21Oosterscheldekering surge barrier CC BY Vladimír Šiman
https://en.wikipedia.org/wiki/File:Oosterscheldekering-pohled.jpg
• Data use
• Privacy and ethics
• Standards
22
Photo CC BY Michael 1952 https://flic.kr/p/88bgji
PEDAGOGY
23
Prinses Amaliawindpark, photo by Ad Meskens, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=15727511
• Ownership
• Power
• Ethics
24
Photo CC BY-NC-ND Antonio Bustamente https://flic.kr/p/6FDa3Q
Sector differences exist ...
... but are small.
25
Photo (C) Lee Jin-man/AP
Technological capability: large & growing
Thanks to:
People:
• All the experts who’ve engaged with this work
• LACE collaborators on this work: Dai Griffiths, Andrew
Brasher, Rebecca Ferguson, Li Yuan
• LACE at the OU: Bart Rientes, Simon Cross, Linda
Norwood, Michelle Bailey, Rebecca Wilson, Evaghn De
Souza, Natalie Eggleston, Oliver Millard, Gary Elliot-
Citigottis.
• LACE project partners: CETIS (Bolton), OUNL,
Skolverket, HIOA, Kennisnet, ITS, ATiT
Funders:
• LACE: European Commission 619424-FP7-ICT-2013-11
“Visions of the Future of Learning Analyics” by Doug Clow,
Institute of Educational Technology, The Open University,
was presented at “Implications and opportunities for
learning analytics for European educational policy
(LAEP/LACE)”, Amsterdam, on 15 March 2016.
@dougclow
dougclow.org
doug.clow@open.ac.uk
This work was undertaken as part of the LACE Project, supported by the European Commission Seventh
Framework Programme, grant 619424.
These slides are provided under the Creative Commons Attribution Licence:
http://creativecommons.org/licenses/by/4.0/. Some images used may have different licence terms.
www.laceproject.eu
@laceproject
27
cc licensed ( BY ) flickr photo by David Goehring: http://flickr.com/photos/carbonnyc/33413040/

More Related Content

LAEP Visions of the Future of Learning Analytics

  • 1. Visions of the Future of learning analytics Dr Doug Clow Institute of Educational Technology, The Open University, UK @dougclow dougclow.org doug.clow@open.ac.uk #laepanalytics
  • 2. visions of the future
  • 3. 3
  • 5. 5 Photo CC BY-NC-ND J Sibiga Photography https://flic.kr/p/8jkiNi
  • 6. 6 Photo CC BY-NC-ND J Sibiga Photography https://flic.kr/p/8jkiNi Policy Delphi
  • 7. Process • Iterative development of Visions • Online survey (N=133) – individually-invited experts – open call • Live events feedback – SoLAR Flare, Milton Keynes, UK – Institutional Readiness Day, Amsterdam, NL – Dé Onderwijsdagen, Rotterdam, NL – Bett, London, UK • Analysis 7 Photo CC BY Wietse van Bruggen for LACE
  • 9. 1: Monitored by the physical environment 9 Photo CC BY-ND SMI Eye Tracking https://flic.kr/p/droxkC • Tools fitted with sensors • Cameras (face, movement) • Alerts for boredom, confusion, off-task • Social monitoring
  • 10. 2: Personal data tracking supports learning • Sensors for posture, attention, rest, stress, blood sugar, metabolic rate, … • Swimming, driving, and passing examinations • Optimise for ages and courses • Self-monitoring
  • 11. 3: Analytics are rarely used 11 Photo CC BY-SA Andrew3000 https://flic.kr/p/Sc5VK • Automated = inferior • Gaming the system • Leaks and misuse of data • Permission from learner and inspectorates • Move away from analytics
  • 12. 4. Learners control their own data Photo CC BY-ND Stuart Conner https://flic.kr/p/7jR8xf • Learners control data sharing • Can limit access • No permission = no data • Awareness campaigns about risks and benefits
  • 13. 5. Open systems widely adopted Photo CC BY connectors distribution box https://flic.kr/p/ddkbR3 • Open Learning Analytics • Joined-up approach • Agreed set of standards • Interoperability • Work with many providers
  • 14. 6: Analytics are essential tools 14 • Lots of data about learner behaviour • Good predictions of study success • Recommendations • Live, reliable, personalised • Rapid funding changes Photo CC BY-SA Beau Considine https://flic.kr/p/m6Vqih
  • 15. Photo (CC)-BY-SA Lauren Macdonald https://www.flickr.com/photos/42386632@N00/8528725328 7: Analytics help learners make the right choice • Enormous datasets • Reliable evidence-based recommendations about most successful routes • Better than the best humans
  • 16. 8: Teaching delegated to computers 16 Photo CC BY-SA Iriss Photo Collection https://flic.kr/p/a4Qv3e • No curricula • Learners decide learning goals • Group collaboration, mentors • Individualised formative assessment • Engaged, autonomous
  • 18. Some themes in responses • Pedagogy – appropriate analytics, how teaching & learning needs to change • Power – who needs to change, who has control • Privacy and Ethics • Complexity – and subtlety • Validity – generalisability, meaningful, worthwhile • Alienation – need to keep humans involved • Regulations – guidelines, policy, laws • Standards – interoperability 18
  • 20. 20 Photo CC BY-NC Martin LaBar https://flic.kr/p/tPmZo Great potential Will it be reached?
  • 21. Policies and infrastructure 21Oosterscheldekering surge barrier CC BY Vladimír Šiman https://en.wikipedia.org/wiki/File:Oosterscheldekering-pohled.jpg • Data use • Privacy and ethics • Standards
  • 22. 22 Photo CC BY Michael 1952 https://flic.kr/p/88bgji PEDAGOGY
  • 23. 23 Prinses Amaliawindpark, photo by Ad Meskens, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=15727511 • Ownership • Power • Ethics
  • 24. 24 Photo CC BY-NC-ND Antonio Bustamente https://flic.kr/p/6FDa3Q Sector differences exist ... ... but are small.
  • 25. 25 Photo (C) Lee Jin-man/AP Technological capability: large & growing
  • 26. Thanks to: People: • All the experts who’ve engaged with this work • LACE collaborators on this work: Dai Griffiths, Andrew Brasher, Rebecca Ferguson, Li Yuan • LACE at the OU: Bart Rientes, Simon Cross, Linda Norwood, Michelle Bailey, Rebecca Wilson, Evaghn De Souza, Natalie Eggleston, Oliver Millard, Gary Elliot- Citigottis. • LACE project partners: CETIS (Bolton), OUNL, Skolverket, HIOA, Kennisnet, ITS, ATiT Funders: • LACE: European Commission 619424-FP7-ICT-2013-11
  • 27. “Visions of the Future of Learning Analyics” by Doug Clow, Institute of Educational Technology, The Open University, was presented at “Implications and opportunities for learning analytics for European educational policy (LAEP/LACE)”, Amsterdam, on 15 March 2016. @dougclow dougclow.org doug.clow@open.ac.uk This work was undertaken as part of the LACE Project, supported by the European Commission Seventh Framework Programme, grant 619424. These slides are provided under the Creative Commons Attribution Licence: http://creativecommons.org/licenses/by/4.0/. Some images used may have different licence terms. www.laceproject.eu @laceproject 27
  • 28. cc licensed ( BY ) flickr photo by David Goehring: http://flickr.com/photos/carbonnyc/33413040/

Editor's Notes

  1. Educause
  2. Better than Horizon Report or your money back. Educause are smart and launch theirs in Feb, vs Dec.
  3. Policy Delphi – not consensus, but options
  4. Policy Delphi – not consensus, but options
  5. Developed iteratively We are not saying this will happen We are not saying these are good
  6. In 2015, learning analytics were mainly used to support online learning. By 2025, they can be used to support most teaching and learning activities, wherever these take place. Furniture, pens, writing pads – almost any tool used during learning – can be fitted with sensors. These can record many sorts of information, including tilt, force and position. Video cameras using facial recognition are able to track individuals as they learn. These cameras monitor movements, and record exactly how learners work with and manipulate objects. All this information is used to monitor learners’ progress. Individuals are supported in learning a wide range of physical skills. Teachers are alerted to signs of individual learner’s boredom, confusion, and deviation from task. Teachers and managers are able to monitor social interactions, and to identify where they should nurture socialisation and cooperative behaviour.
  7. In 2015, people were beginning to wear devices such as heart-rate monitors and run-trackers as they went about their daily lives. By 2025, sophisticated sensors can gather personal information about factors such as posture, attention, rest, stress, blood sugar, and metabolic rate. People collect this information about their activities, and feed it into programmes of their choice which provide recommendations on how to act in ways that improve their learning.  Learners can download the statistics and data that are associated with successful learning in a certain area. Aligning personal data with these ‘ideal’ sets is claimed to help people to master skills as diverse as swimming, driving, carrying out surgery and passing examinations. Academic stars sell programmes using this data to optimise learning for different ages and courses. Business gurus market similar programmes for topics such as presentation skills and workload management. Some learners create and share their own data analysis programmes, which provide recommendations that often include the consumption of high energy foods and stimulants. The majority of high school and university students follow self-monitoring programmes, and avidly discuss the merits of these on social media.
  8. In 2015, many people hoped that analytics would be able to improve teaching and learning and the environments where these take place. However, in 2025, it is clear that there are many problems. Courses that are automated by analytics are seen as inferior, and learners have realised that they can game the system. There have been major leaks of sensitive personal data, and it is clear that, even where this has not happened, many companies have misused the data generated by their analytics. Many governments have ruled that individuals are the sole owners of the data they generate. All use of data for educational purposes now has to be approved not only by the learner but also by new inspectorates. In practice this has meant that use of analytics is restricted to summative assessment carried out by government agencies. A consensus has emerged in educational policy that the move away from learning analytics is not only ethically desirable, it is also educationally effective.
  9. In 2015, it was not clear who owned educational data, and it was often used without learners' knowledge. By 2025, most people are aware of the importance and value of their data. Learners control the type and quantity of personal data that they share, and with whom they share it. This includes information about progress, attendance and exam results, as well as data collected by cameras and sensors. Learners can choose to limit the time for which access is allowed, or they can restrict access to specific organisations and individuals. The tools for making these choices are clearly laid out and easy to use. In the case of children, data decisions are made in consultation with parents or carers. If they do not engage with these tools, then no data is shared and no benefits gained. Most educational institutions recognise this as a potential problem, and run campaigns to raise awareness of the both the risks of thoughtless exposure of data, and the benefits to learners of informed sharing of selected educational data.
  10. In 2015, companies produced a range of learning analytics tools, using different approaches and standards. The algorithms and models which companies use are often protected as intellectual property. By 2025, the ‘open learning analytics’ established by the Open Learning Analytics Foundation has made a more joined-up approach possible. Educational organisations see learning analytics as a central element of their IT provision. They demand control over these tools, how they run and what they are used for. The tools they select, although they come from different providers, use open algorithms and share data according to an agreed set of standards which facilitate transparency and independent validation. A set of well-tested, accessible and standardised visualisation methods is commonly used, so that learners and teachers can confidently use a range of tools. Institutions can easily work with a range of providers to design learning analytics systems which support their strategic vision.
  11. In 2015, companies were beginning to develop systems to recommend resources and to predict outcomes. By 2025, these systems are highly developed. A wide range of data about learner behaviour is used to generate good quality, real-time predictions about likely success. Learners, teachers, managers and policymakers all have access to live and accurate information about how well a learner is likely to do. Learners and teachers plan their work on the basis of reliable tools that can produce detailed and personalised recommendations about what should be done to achieve the best learning outcomes. A growing industry offers services to institutions and individuals, advising on how to respond to predictions generated by analytics, and how to take appropriate action in the light of recommendations. Accurate predictive information enables managers and policymakers to expand or contract learning provision before success or failure is evident: you don’t have to wait to see if a course is booming or failing, with funding changes happening quickly.
  12. In 2015, people were beginning to assemble datasets that could represent learner’s activities. By 2025, these are used on a large scale in teaching, and this has led to the development of enormous datasets containing information about hundreds of thousands of learners. Analysing in detail the progress of such a wide variety of learners has made it possible to provide reliable evidence-based recommendations about the most successful routes to learning, as well as identifying the learning materials and approaches that are most suitable for each individual at each point in their progress. These recommendations are better informed and more reliable than those that can be produced by even the best-trained humans. Learners now spend most of their time working with analytics-driven systems, and the role of teachers has been reduced. Education policy is driven by the evidence generated by the use of these systems.
  13. In 2015, learners in educational institutions and in businesses had to follow a curriculum developed by others. In 2025, they create groups that work together to decide their learning goals and how to achieve these. A ‘Learning Trajectory System’ uses analytics to support information exchange and group collaborations, and learners receive support from mentors, rather than teachers. Activity towards a learning goal is monitored, and analytics provide individuals with feedback on their learning process. This includes suggestions, including peer learners to contact, experts to approach, relevant content, and ways of developing and demonstrating new skills. Formative assessment is used to guide future progress, taking into account individuals’ characteristics, experience and context, replacing exams that show only what students have achieved. Texts and other learning materials are adapted to suit the cultural characteristics of learners, revealed by analysis of their interactions
As a result, learners are personally engaged with their topics, and are motivated by their highly autonomous learning. The competences that they develop are valuable in a society in which collection and analysis of data are the norm. There is also convergence between the learning activities of the education system and the methods used by employees to develop their knowledge and skills.
  14. Big thanks in small fonts
  15. )