IN OPEN EN ONLINE ONDERWIJS EN LEARNING ANALYTICS

Grand Challenges

Alan Berg & Robert Schuwer

SURF Onderwijsdagen 11-11-2014

Introductie

• Aanleiding: stimuleringsregeling OCW• 10 Kennisthema’s

- Relatie van open en online onderwijs met Learning Analytics- Twee SIG’s: SIG Open Education en SIG Learning Analytics

Doelstelling

• Wat kan Learning Analytics betekenen voor open en online onderwijs?- Meerwaarde- Uitdagingen

• Nationale agenda voor uitwerking synergie van open en online onderwijs en LA

Aanpak

• Verzamelen van challenges- Via survey

• Ordenen en prioriteren van de verzamelde challenges- In projectgroep

• Opleveren adviesdocument voor hogeronderwijsinstellingen

• Lange-termijn-doelen definiëren, opstellen nationale agenda- Planning: april 2015

• Projectleiding: Jocelyn Manderveld, SURF

Challenges

● Ethics and Privacy and legal [NOW]o EU reporto 9 Privacy themeso Privacy by designo National body

Decision tree Suggestion by Stefan Mol

http://ec.europa.eu/education/library/reports/modernisation-universities_en.pdf

Plug for panel

Ethics & Privacy issues in the context of Learning Analytics

Alan Berg (Universiteit van Amsterdam), Maren Scheffel (Open Universiteit)

15:30P.M @ Penn 1

Challenges

● Benchmarking & Cross validation [EMERGING]o Fragmentation in the marketplaceo Need a standard Dataseto Benchmarko Cross validate new processes

Teaching practices Demographics Student cohorts Borders Life long learning paths

EU Report Recommendations

Member States should ensure thatlegal frameworks allow highereducation institutions to collect andanalyse learning data. The full andinformed consent of students must bea requirement and the data should onlybe used for educational purposes.

http://ec.europa.eu/education/library/reports/modernisation-universities_en.pdf

EU Report Recommendations

Online platforms should inform users about their privacy and data protectionpolicy in a clear and understandableway. Individuals should always havethe choice to anonymise their data.

http://ec.europa.eu/education/library/reports/modernisation-universities_en.pdf

Challenges

● Standardization [NOW]o Caliper vs Xapi

● Entangled communities of interest [NOW]o LACE ,SURF,JISC, EU projectso Apereo LAIo Advertise SIG LA, Apereo LAI, LACEo Ariadne, GLOBEo Edustandaard

QUESTION TO THE AUDIENCE.

Which relevant communities are missing? EDM, Teaching, OOR, commercial, certification

Challenges

● Learning from success and failures → [NOW]o InBloom, Signals, OAAI (success)

● Organizational impact → [NOW]o Privacy by designo Data silo’so interoperability o politicso data cleaningo Diffusion of knowledge in the organizationo Fragmentation due to multiple commercial products

Challenges

● Need for an Overarching end to end framework [NEAR FUTURE]o OLA framework - SoLARo Avoid duplicationo Plugable

EVENTS

http://www.laceproject.eu/open-learning-analytics-network-summit-europe-2014/

On December 1st the European Summit of the Open Learning Analytics Network will be organised in Amsterdam, at the Allard Pierson Museum. The summit agenda will include lightening talks, breakout group discussions, and plenary discussion of next actions developing a shared European perspective on the concept of an Open Learning Analytics framework, including its relationship to Horizon 2020.

Challenges

●Defending the learning in Learning analyticso Emphasis on the importance of the feedback processes?o Emphasizing the right stakeholders

Teachers Students Study advisors Managers. But this is not Learning Analytics! Curriculum designers IT department Government policy

Challenges

● Avoiding Data voyeurismo Strong Stakeholder governance bodieso Privacy by designo End to end securityo Avoid the perception of data voyeurismo Destroyer of a cultures creativity.

ACTIONS

● Ethics, privacy and legal → Guidelines● Security by design → Start a discussion● Standards → POC’s in this direction for the stimulation

funds. Work with other communities● Communities → Seek clearly defined relationships● Duplication → Apereo LAI, LACE, interlock workshops.

Seek wider collaboration between Universities.

Challenges ontvangen via survey (1)

• Educational Quality Assurance with LA- project “Studiesucces voorspellen met Blackboard Learn”- Welke rol kan LA spelen bij het verbeteren van de kwaliteit van het onderwijs?- Kan LA voor een professional bruikbare informatie leveren over de kwaliteit van zijn/haar

onderwijs?- Zijn professionals genegen om LA informatie te gebruiken om de kwaliteit van hun

onderwijs te verbeteren?• Are MOOCs old-fashioned?

- How can learning analytics support innovative instructional designs in MOOCs?

Challenges ontvangen via survey (2)

• Storing and finding Open Educational Resources- How can we make OERs findable for students and teachers?

• Diversity of student population - How can learning analytics be used to tackle the problems encountered to educate a more

and more diverse population without increasing the costs.• Het ontwerp van systemen die gegevens genereren die gebruikt kunnen worden voor

levensechte formatieve feedback- Hoe ontwerpen we een systeem dat leraren aanknopingspunten geeft voor formatieve

feedback aan subgroepen binnen de klas?

Over to you

● What are your grand challenges?● How would you answer these challenges?

Call for Participation

● FILL IN THE SURVEY: http://bit.ly/challengesOOO-LA

● Join SURF SIG’s● Work with SURF’s stimulation funding● Look at the work at …

o Apereo LAIo LACEo Ariadneo Globeo Edustandaard

● Advertise the EU OLA Summit Dec 1st● LAK15● Ethics and privacy workshops

Dank voor uw aandacht!

• Alan Berg - A.M.Berg@uva.nl – UvA - SIG Learning Analytics

• Robert Schuwer – robert.schuwer@ou.nl – Fontys Hogescholen/OUNL – SIG Open Education

• Survey: http://bit.ly/challengesOOO-LA