scholarly journals Measuring User Experience on Massive Open Online Course with User-Centered Metrics: A Case Study

10.47028/096 ◽  
2019 ◽  
Author(s):  
Royanul Fitron ◽  
Sri Suning Kusumawardani ◽  
Ridi Ferdiana
Keyword(s):  
Student Satisfaction ◽  
User Experience ◽  
Massive Open Online Course ◽  
Research User ◽  
Task Success ◽  
E Learning ◽  
Enhanced Learning ◽  
And Task ◽  
User Centered

Evaluation of user experience (UX) in learning applications is now very important. Agood UX on MOOC will have an impact on increased completion rates and student satisfaction,student engagement, enhanced learning, and minimizing course implementation rework. In thisstudy, the authors use MOOC called E-learning: Open of Knowledge Sharing (eLOK) as theobject of research. User-centered metrics or known as HEART framework consisting of fivemetrics, including Happiness, Engagement, Adoption, Retention and Task Success. Theframework that the authors used to measure the UX of eLOK is HEART metrics. The instrumentthat used in this study is a questionnaire consists of 33 statements which delivered to 94 studentsas the sample of the research, with the the number of population 1500. The questionnaire hasbeen validated using SPSS 23 as the tools. The result of the validation is all the items of thequestionnaire are valid and reliable with the percentage of reliability is 96%. The result of thisstudy showed that the metrics obtained by Happiness was 76.5%, Engagement was 72.1%,Adoption was 73.6%, Retention was 72.6%, and Task Success was 78.6%. To achieve the GoalSignal-Metrics set on the HEART framework, it is necessary to re-design the eLOK display bypaying attention to UX and UI aspects, changing the greeting with user-guidance, improving pushnotification features and navigation.

Usability and User Experience Evaluation Methods

2010 ◽  
pp. 232-243 ◽  
Author(s):  
Regina Bernhaupt
Keyword(s):  
User Experience ◽  
Development Process ◽  
Evaluation Methods ◽  
Interactive Tv ◽  
Interaction Technique ◽  
Set Up ◽  
User Centered Development ◽  
User Centered

Usability and user experience are two important factors in the development of mass-customizable personalized products. A broad range of evaluation methods is available to improve products during an user-centered development process. This chapter gives an overview on these methods and how to apply them to achieve easy-to-use, efficient and effective personalized products that are additionally fun to use. A case study on the development of a new interaction technique for interactive TV helps to understand how to set up a mix of evaluation methods to cope with some of the limitations of current usability and user experience evaluation methods. The chapter concludes with some guidelines of how to change organizations to focus on usability and user experience.

Balanced Assessment of Flexible E-Learning vs. Face-to-Face Campus Delivery Courses at an Australian University

2012 ◽  
pp. 304-339
Author(s):  
Kenneth David Strang
Keyword(s):  
Higher Education ◽  
Student Satisfaction ◽  
Student Performance ◽  
International Student ◽  
Teaching Quality ◽  
Balanced Assessment ◽  
The World ◽  
E Learning ◽  
Will Force

This case study reminded researchers of the value in using formal methodologies to gain an objective balanced perspective of actual practice. By using models and survey instruments that gathered objective input from key stakeholders in the higher education market, several of the true underlying factors were revealed. The key instrument used in the case study allowed us to objectively measure if flexible e-learning was at least as effective as campus delivery mode. More so, the assessment was not just performance and not just student satisfaction – instead the outcomes assessed included six factors that were linked to Australian university accreditation: Industry focus, resources/content materials, critical thinking activities, teaching quality, student satisfaction, and student performance (including completion). One of the most interesting aspects of the case study was that we are seeing history in the making to some degree in that as a result of the 2008 global economic crises, the international student market is changing which will force universities to change what and how they offer higher education in the future. More countries (and their populations) in the world are seeking a credible university higher education and they do not always want to travel to holiday destinations to obtain that… the world economic model is changing, continuing to increase the demand for education, yet changing how that product/service must be delivered. Successful higher education institutions around the world are already showing the followers how to do that. This case study provides some ideas and benchmarks for becoming more competitive in higher education, and while the model was developed and used in Australia, likely it can be applied elsewhere since the majority of students feeding into this model and research were international.

scholarly journals Modeling User Psychological Experience and Case Study in Online E-learning

2015 ◽  
Vol 10 (6) ◽  
pp. 53 ◽  
Author(s):  
Xiyuan Wu ◽  
Min Liu ◽  
Qinghua Zheng ◽  
Yunqiang Zhang ◽  
Haifei Li
Keyword(s):  
User Experience ◽  
Subjective Experience ◽  
Analytic Hierarchy ◽  
Psychological Experience ◽  
E Learning ◽  
User Psychological ◽  
Hierarchy Process ◽  
Interview Questionnaire

In the post WWW era, the research of e-learning focuses on facilitating intelligent and proactive services for learners. The quality of user experience determines whether e-learning services would be accepted by learners. However, many researchers traditionally focus on the effectiveness of computer systems or the accuracy of algorithms themselves rather than on user-centric psychological experience. How to model and evaluate user experience taking into account user psychological and cognitive properties are challenging research topics. There are some traditional methods typically proposed to evaluate users’ psychological experience, such as interview, questionnaire etc. They are qualitative and easy to conduct but need more time and resource. And they are liable to subjective views. Based on user web log data, the current paper presents a quantitative approach of modeling user psychological experience in the context of intelligent e-learning. The properties and elements, which affect user experience, are analyzed and quantified. The holistic user experience is quantified through the fusion of analytic hierarchy process (AHP) and Delphi methods. A case study, at a university in China, is conducted for diagnosing whether the result of the proposed approach can be uniform with user subjective experience, and indicates that the proposed approach is effective and complements existing user experience research in intelligent e-learning.

scholarly journals Students as partners in e-contents creation: A case study exploring student-staff partnership for learning and student engagement using digital applications for co-creation of e-learning materials

2020 ◽  
Vol 4 (1) ◽  
pp. 109-119
Author(s):  
Nurun Nahar ◽  
Duncan Cross
Keyword(s):  
Student Engagement ◽  
Undergraduate Students ◽  
Digital Literacy ◽  
First Year ◽  
Learning Needs ◽  
Learning Materials ◽  
Content Creation ◽  
E Learning ◽  
Enhanced Learning

In order to enable learners to take control of their learning needs and actively contribute in their learning processes, educators can partner with students in various reciprocal student-staff partnership (SSP) settings where students can be co-creators, co-producers, curators, or co-deliverers of the curriculum. Our project, undertaken to enhance the curriculum as part of a teaching qualification, places emphasis on educators partnering with first-year undergraduate students over e-content creation within an existing module, using readily accessible digital applications in order to promote active learning in students and improve student engagement. In this case study, we evaluate the extent to which SSP, as an approach to the creation of e-learning materials using digital applications, enhanced learning and student engagement in an existing module. Our student partners perceived SSP to be an excellent platform for learning, actively engaging in the classroom, and developing skills such as communication and digital literacy. However, they expressed some concerns about overcoming the traditional hierarchies within our SSP initiative

Balanced Assessment of Flexible e-Learning versus Face-to-Face Campus Delivery Courses at an Australian University

2010 ◽  
pp. 42-68 ◽  
Author(s):  
Kenneth David Strang
Keyword(s):  
Higher Education ◽  
Student Satisfaction ◽  
Student Performance ◽  
International Student ◽  
Teaching Quality ◽  
Balanced Assessment ◽  
The World ◽  
E Learning ◽  
Will Force

This case study reminded researchers of the value in using formal methodologies to gain an objective balanced perspective of actual practice. By using models and survey instruments that gathered objective input from key stakeholders in the higher education market, several of the true underlying factors were revealed. The key instrument used in the case study allowed us to objectively measure if flexible e-learning was at least as effective as campus delivery mode. More so, the assessment was not just performance and not just student satisfaction – instead the outcomes assessed included six factors that were linked to Australian university accreditation: Industry focus, resources/content materials, critical thinking activities, teaching quality, student satisfaction, and student performance (including completion). One of the most interesting aspects of the case study was that we are seeing history in the making to some degree in that as a result of the 2008 global economic crises, the international student market is changing which will force universities to change what and how they offer higher education in the future. More countries (and their populations) in the world are seeking a credible university higher education and they do not always want to travel to holiday destinations to obtain that… the world economic model is changing, continuing to increase the demand for education, yet changing how that product/service must be delivered. Successful higher education institutions around the world are already showing the followers how to do that. This case study provides some ideas and benchmarks for becoming more competitive in higher education, and while the model was developed and used in Australia, likely it can be applied elsewhere since the majority of students feeding into this model and research were international.

scholarly journals Perancangan User Experience Menggunakan Metode Five Planes Pada Aplikasi Mobile Kode Funding Di PT Kodetag Global Teknotama

2019 ◽  
Vol 9 (1) ◽  
pp. 55-69
Author(s):  
Paramita Retno Utami ◽  
Firman Ardiansyah ◽  
Muhammad Zubair
Keyword(s):  
User Interface ◽  
Success Rate ◽  
User Experience ◽  
User Satisfaction ◽  
Usability Testing ◽  
Task Completion ◽  
Think Aloud ◽  
Task Success ◽  
Funding Application ◽  
And Task

ABSTRACT Kode Funding Application is a cooperative mobile-based application which is a service product of PT Kodetag Global Teknotama. This application is designed to have features of cooperatives transactions, but it has not been designed with user experience (UX) and user interface optimization (UI) to meet the needs and achieve user satisfaction. As the consequence, when the user used the application, they faced difficulties in making transactions on the application such as data input errors. These following things will affect the performance of the user while making the transactions.The design of user experience and user interface optimization are designed to build an Android mobile application prototype for Koperasi Simpan Pinjam dan Pembiayaan Syariah (KSPPS) Kode Funding that is using the Five Planes Element of User Experience by Garrett (2011) and considering the aspects of usability and aesthetics. The evaluation was carried out using techniques such as think aloud and learnability assessment by testing 5 participants for a medium fidelity prototype. The final evaluation results on usability testing using task success get a 90% success rate for time and task completion. All participants can complete the proposed task. Meanwhile, the results of the time completion evaluation were calculated to be 5 out of 50 participants that exceeded the time limit. Participants assumed that the prototype with UX design giving a more attractive appearance and the better experience when using the application, as well as the availability of detailed transaction information.   ABSTRAK Aplikasi Kode Funding adalah aplikasi koperasi berbasis mobile yang merupakan produk layanan dari PT Kodetag Global Teknotama. Aplikasi ini telah dirancang memiliki fungsi atau fitur transaksi pada koperasi, namun belum dilakukan perancangan user experience (UX) dan optimasi user interface (UI) untuk memenuhi kebutuhan dan mencapai kepuasan pengguna. Sehingga, ketika user menggunakan aplikasi tersebut, terdapat kesulitan dalam melakukan transaksi pada aplikasi seperti adanya kesalahan input data setoran. Hal berikut tentunya mempengaruhi performa dan kinerja dari pengguna aplikasi dalam bertransaksi.Perancangan user experience dan optimasi user interface dimaksudkan agar terbentuknya prototipe aplikasi mobile Android Koperasi Simpan Pinjam dan Pembiayaan Syariah (KSPPS) Kode Funding yang menggunakan metode Five Planes User Experience Elements oleh Garrett (2011) dengan mempertimbangkan aspek usability dan estetika. Evaluasi dilakukan menggunakan teknik think aloud dan penilaian learnability dengan pengujian pada 5 partisipan untuk medium fidelity prototype. Hasil akhir evaluasi pada usability testing menggunakan task success mendapatkan success rate sebesar 90% untuk time and task completion. Seluruh partisipan dapat menyelesaikan task yang diajukan. Sedangkan, hasil evaluasi dari pemenuhan waktu terdapat 5 dari 50 partisipan melebihi batas waktu. Partisipan menganggap pengembangan prototipe dengan perancangan UX memberikan dampak tampilan yang lebih menarik dan pengalaman menggunakan aplikasi yang lebih baik, serta adanya informasi transaksi yang lebih rinci.

scholarly journals Students on Tech – an innovative partnership

2018 ◽  
Vol 4 (1) ◽  
Author(s):  
Mary Jacob
Keyword(s):  
Learning Experience ◽  
Change Agents ◽  
Technology Enhanced Learning ◽  
Student Needs ◽  
Learning Group ◽  
Effective Change ◽  
E Learning ◽  
Experience Survey ◽  
Enhanced Learning

'Students on Tech' is an innovative partnership between students and the E-learning Group at Aberystwyth University. A talk on the project was jointly presented by one of the students and the staff member who led the project at the Jisc Change Agents Network conference, University of Exeter, 20-21 April 2017. The case study offers a model for partnership with students for effective change. Our aims were to listen to the student voice to improve technology-enhanced learning (TEL) provision and raise the profile of good teaching.The E-learning Group had carried out a TEL Learning Experience Survey in 2010 and again in 2013 (Gwella Team, 2011). For this project, we hoped to gain an even deeper understanding of student needs and behaviour. We wanted to make our Blackboard site easier to use and to help staff understand better: students’ needs; how students are using technology; what technology helps them.

Kulturelle Adaption eines multilingualen MOOC

2021 ◽  
Vol 72 (2-3) ◽  
pp. 101-112
Author(s):  
Celia Büchner ◽  
Laura Fleischer ◽  
Christa Womser-Hacker ◽  
Stefan Dreisiebner
Keyword(s):  
User Experience ◽  
Information Literacy ◽  
Online Course ◽  
Massive Open Online ◽  
Massive Open Online Course ◽  
Sind Eine ◽  
E Learning

Zusammenfassung Multikulturelle Zielgruppen sind eine Herausforderung bei der Gestaltung eines Massive Open Online Course (MOOC). Bei dem Untersuchungsgegenstand handelt es sich um ein mehrsprachiges Lernsystem zur Vermittlung von Informationskompetenz, dem Information Literacy Online (ILO) MOOC, das im Rahmen eines Erasmus+-Projekts entwickelt wurde. Durch das Verständnis des Zusammenhangs von Kultur und Lernen (genauer E-Learning) und der Anwendung einer mehrstufigen Methode werden kulturelle Besonderheiten aufgedeckt, bewertet und evaluiert, um Adaptionsmaßnahmen festlegen zu können. Die Evaluation zeigt, dass die Ergebnisse kulturanalytischer Verfahren zur Festlegung einer zielgruppengerechten Gestaltung von der subjektiven Wahrnehmung der Kulturangehörigen abweichen können, woraus ein spezieller Handlungsbedarf resultiert. Die Untersuchung fokussiert die kroatische, spanische und deutsche Kultur und deckt Divergenzen im Verständnis von User Experience auf.

Faculty Development: A Stage Model Matched to Blended Learning Maturation

2011 ◽  
Vol 15 (1) ◽  
Author(s):  
Michael L. Fetters ◽  
Tova Garcia Duby
Keyword(s):  
Faculty Development ◽  
Blended Learning ◽  
Lessons Learned ◽  
Technology Enhanced Learning ◽  
Stage Model ◽  
Years Of Experience ◽  
Development Programs ◽  
Curriculum Innovation ◽  
Enhanced Learning

Faculty development programs are critical to the implementation and support of curriculum innovation. In this case study, the authors present lessons learned from ten years of experience in faculty development programs created to support innovation in technology enhanced learning. Stages of curriculum innovation are matched to stages of faculty development, and important lessons for success as well as current challenges are delineated and discussed.

Sign in / Sign up

Export Citation Format

Share Document