Measuring Verbal Working Memory Online in Research: Feasibility, Reliability, and Validity of two Implementations

Abstract

Working memory (WM) tasks have been extensively studied with laboratory paper and pencil or computerized tasks; few studies have assessed the feasibility and psychometric properties of WM online tests for low-stakes research purposes. This study analyzed the online implementation of two verbal WM tasks, Letter-Number Sequencing and Running Span. Letter-Number Sequencing was tested in a supervised, online video conference setting in small groups. Running Span was assessed asynchronously and unsupervised. Both had adequate reliability. For Letter-Number Sequencing, approximately 25% of the sample had to be excluded following criteria for minimum performance and strategic behavior. In addition, performance did not follow the set size effect, a benchmark for WM tasks, and was systematically different from an in-person sample. In contrast, the remote online Running Span task displayed systematic lower performance with more to-be-remembered items (set size effect), with overall performance aligning closely with a similar in-person evaluation.