scholarly journals A Project-based Online Experimentation Course

2020 ◽  
Author(s):  
Ahmet Sabuncu ◽  
John Sullivan
Keyword(s):  
Online Experimentation

scholarly journals Learning As It Happens: A Decade of Analyzing and Shaping a Large-Scale Online Learning System

2018 ◽  
Vol 5 (2) ◽  
Author(s):  
Matthieu J. S. Brinkhuis ◽  
Alexander O. Savi ◽  
Abe D. Hofman ◽  
Frederik Coomans ◽  
Han L. J. Van der Maas ◽  
...  
Keyword(s):  
Online Learning ◽  
Large Scale ◽  
Response Times ◽  
Learning System ◽  
Learning Gains ◽  
Online Experimentation ◽  
Quality Of Fit ◽  
Item Reliability ◽  
Made In

With the advent of computers in education, and the ample availability of online learning and practice environments, enormous amounts of data on learning become available. The purpose of this paper is to present a decade of experience with analyzing and improving an online practice environment for math, which has thus far recorded over a billion responses. We present the methods we use to both steer and analyze this system in real-time, using scoring rules on accuracy and response times, a tailored rating system to provide both learners and items with current ability and difficulty ratings, and an adaptive engine that matches learners to items. Moreover, we explore the quality of fit by means of prediction accuracy and parallel item reliability. Limitations and pitfalls are discussed by diagnosing sources of misfit, like violations of unidimensionality and unforeseen dynamics. Finally, directions for development are discussed, including embedded learning analytics and a focus on online experimentation to evaluate both the system itself and the users’ learning gains. Though many challenges remain open, we believe that large steps have been made in providing methods to efficiently manage and research educational big data from a massive online learning system.

No lab, no problem

2019 ◽  
Vol 14 (1) ◽  
pp. 152-168
Author(s):  
Jordan Gallant ◽  
Gary Libben
Keyword(s):  
Ecological Validity ◽  
Psycholinguistic Research ◽  
Online Experiments ◽  
The Future ◽  
Overall Evaluation ◽  
Technical Details ◽  
Online Experimentation ◽  
Behavioural Experiments ◽  
Millisecond Timing ◽  
The Web

Abstract We present new opportunities for psycholinguistic research that are made available by presenting experiments online over the web. We focus on PsychoPy3, which is a new version of a system for the development and delivery of behavioural experiments. Crucially, it allows for both these functions to be performed online. We note that experiments delivered over the web have significant efficiency advantages. They also open up new opportunities to increase the ecological validity of experiments and to facilitate the participation of members of populations that have thus far been less studied in the psycholinguistic literature. We discuss the crucial matter of millisecond timing in online experiments. The technical details of implementation of a behavioural psycholinguistic experiment are presented, along with listings of additional technical resources and support. Our overall evaluation is that although online experimentation still has technical challenges and improvements are ongoing, it may well represent the future of behavioural psycholinguistic research.

scholarly journals Building, Hosting and Recruiting: A Brief Introduction to Running Behavioral Experiments Online

2020 ◽  
Vol 10 (4) ◽  
pp. 251 ◽  
Author(s):  
Marian Sauter ◽  
Dejan Draschkow ◽  
Wolfgang Mack
Keyword(s):  
Data Acquisition ◽  
Experimental Studies ◽  
Behavioral Experiments ◽  
Online Data ◽  
Online Experimentation ◽  
Critical Components

Researchers have ample reasons to take their experimental studies out of the lab and into the online wilderness. For some, it is out of necessity, due to an unforeseen laboratory closure or difficulties in recruiting on-site participants. Others want to benefit from the large and diverse online population. However, the transition from in-lab to online data acquisition is not trivial and might seem overwhelming at first. To facilitate this transition, we present an overview of actively maintained solutions for the critical components of successful online data acquisition: creating, hosting and recruiting. Our aim is to provide a brief introductory resource and discuss important considerations for researchers who are taking their first steps towards online experimentation.

Online Experimentation @FEUP: five years of evaluations

2020 ◽  
Author(s):  
Diana Urbano ◽  
Maria De Fátima Chouzal ◽  
Maria Teresa Restivo
Keyword(s):  
Virtual Reality ◽  
Knowledge Gain ◽  
Individual Response ◽  
Design Development ◽  
Group Activities ◽  
The Past ◽  
Student Reaction ◽  
Hands On ◽  
Online Experimentation ◽  
Experimental Group

The Online Experimentation @FEUP lab gathers a set of experimental resources based on Augmented Reality, Virtual Reality and Haptic Systems. The design, development and implementation of those resources are guided by the following main goals: familiarizing students with the referred technologies, complement hands-on experimentation, motivate students and promote knowledge gain. A brief presentation of the online experimental activities most utilized and evaluated in the past five years in context of different undergraduate courses and at the K12 level is presented. In all the studies conducted, the strategies adopted involve pre- and post-testing to assess knowledge gain, experimental group activities, and individual response to surveys to assess student reaction. The results published in journals, conferences proceedings and book chapters are discussed.

Earthquake Early Warning Technology Progress in Taiwan

2009 ◽  
Vol 4 (4) ◽  
pp. 530-538 ◽  
Author(s):  
Kuo-Liang Wen ◽  
◽  
Tzay-Chyn Shin ◽  
Yih-Min Wu ◽  
Nai-Chi Hsiao ◽  
...  
Keyword(s):  
Real Time ◽  
Early Warning ◽  
Monitoring Network ◽  
Earthquake Early Warning ◽  
P Waves ◽  
Strong Base ◽  
Warning Messages ◽  
Online Experimentation ◽  
Near Future ◽  
Remarkable Progress

The dense real-time earthquake monitoring network established in Taiwan is a strong base for the development of the earthquake early warning (EEW) system. In remarkable progress over the last decades, real-time earthquake warning messages are sent within 20 sec after an event using the regional EEW system with a virtual subnetwork approach. An onsite EEW approach using the first 3 sec of P waves has been developed and under online experimentation. Integrating regional and onsite systems may enable EEW messages to be issued within 10 sec after an event occurred in the near future. This study mainly discusses the methodology for determining the magnitude and ground motion of an event.

ARE PUBLISHERS READY FOR TOMORROW? PUBLISHERS' CAPABILITIES AND ONLINE INNOVATIONS

2012 ◽  
Vol 16 (01) ◽  
pp. 1250001
Author(s):  
VERA VALANTO ◽  
MIIA KOSONEN ◽  
HANNA-KAISA ELLONEN
Keyword(s):  
Technological Change ◽  
Internal Market ◽  
Comparative Case Study ◽  
Technological Capabilities ◽  
Media Management ◽  
Development Patterns ◽  
Related Development ◽  
Online Experimentation ◽  
The Relationship

In order to cope with technological change, publishing companies need to effectively combine their capabilities and use them to support the development of new and existing products. In this paper, we explore the relationship between the market and technology capabilities of publishing companies and their online innovations. Our comparative case study focuses on four cases representing newspaper and magazine publishers. The case companies seem stronger in market than in technology capabilities. We also note an apparent tendency to build on the strongest capability area and to focus on leveraging those capabilities rather than taking a risk and experimenting in an area in which they are relatively weaker. Further, it seems that publishers have been able to leverage their market capabilities through online experimentation, but have not been able to develop their technological capabilities in the same manner. From the scientific perspective, this study makes two main contributions. Firstly, the empirical in-depth investigation of the capability portfolios of the case firms complements the emerging work on innovation-related capabilities. Secondly, the study adds to the literature on media management in enhancing understanding of the online-related capabilities that are required in publishing companies, and the related development patterns. Our study suggests that experimenting online and producing innovations requiring new types of internal market-related processes and practices is an efficient strategy to develop one's current market capabilities online.

Studying Electoral Persuasion Using Online Experiments

2019 ◽  
pp. 1015-1036
Author(s):  
Thomas J. Leeper
Keyword(s):  
Online Survey ◽  
Social Science Research ◽  
Internal Validity ◽  
Science Research ◽  
Future Research ◽  
Online Experiments ◽  
Advantages And Disadvantages ◽  
Trade Offs ◽  
Online Experimentation ◽  
Experimental Realism

Online experimental methods have become a major part of contemporary social science research. Yet the method is also controversial and experiments are frequently misunderstood. This chapter introduces online experimentation as a method, by explaining the logic of experimental design for causal inference. While experiments can be deployed in almost any setting, online experiments tend to take two forms: online survey experiments and experiments in naturalistic online environments. Discussing the advantages and disadvantages of these types relative to each other and relative to their offline analogues, the chapter demonstrates ways that experimentation has been used to learn about political behavior, media and campaign dynamics, and public opinion. Emphasizing trade-offs between internal validity, experimental realism, and external validity, the chapter demonstrates how researchers have used online platforms in tandem with randomization to gain insights into both online and offline phenomena. Though experiments are sometimes seen as trading off external for internal validity, this is not an accurate depiction of all experimental work. Rather, online experiments exist on spectrums that trade-off these features to varying degrees. And with those trade-offs come key challenges related to experimental control, the generalizability of experimental results across settings, units, treatments, and outcomes, and the ethics of online experimentation. The chapter concludes by suggesting how future research might innovatively push beyond existing work.

Sign in / Sign up

Export Citation Format

Share Document