Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research

Steve Ritter; Neil Heffernan; Joseph Jay Williams; Derek Lomas; Klinton Bicknell; Jeremy Roschelle; Ben Motz; Danielle McNamara; Richard Baraniuk; Debshila Basu Mallick; Rene Kizilcec; Ryan Baker; Stephen Fancsali; April Murphy

doi:10.1145/3573051.3593397

Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research

Steve Ritter, Neil Heffernan, Joseph Jay Williams, Derek Lomas, Klinton Bicknell, Jeremy Roschelle, Ben Motz, Danielle McNamara, Richard Baraniuk, Debshila Basu Mallick, Rene Kizilcec, Ryan Baker, Stephen Fancsali, April Murphy

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Learning engineering adds tools and processes to learning platforms to support improvement research. One kind of tool is A/B testing-common in large software companies and also represented academically at conferences like the Annual Conference on Digital Experimentation (CODE). A number of A/B testing systems focused on educational apps have arisen recently, including UpGrade and E-TRIALS. A/B testing can help improve educational platforms, yet challenging issues in education go beyond the generic paradigm. In response, a number of of digital learning platforms is opening their systems to learning-improvement research by instructors and/or third-party researchers, with specific supports necessary for education-specific research designs. This workshop will explore how A/B testing in educational contexts is different, how learning platforms are opening up new possibilities, and how these empirical approaches can be used to drive powerful gains in student learning. It will also discuss forthcoming opportunities for funding to conduct platform-enabled learning research.

Original language	English (US)
Title of host publication	L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale
Publisher	Association for Computing Machinery, Inc
Pages	254-256
Number of pages	3
ISBN (Electronic)	9798400700255
DOIs	https://doi.org/10.1145/3573051.3593397
State	Published - Jul 20 2023
Event	10th ACM Conference on Learning @ Scale, L@S 2023 - Copenhagen, Denmark Duration: Jul 20 2023 → Jul 22 2023

Publication series

Name	L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale

Conference

Conference	10th ACM Conference on Learning @ Scale, L@S 2023
Country/Territory	Denmark
City	Copenhagen
Period	7/20/23 → 7/22/23

Keywords

A/B Testing
Digital Experimentation
Educational Technology
Learning Engineering

ASJC Scopus subject areas

Computer Networks and Communications
Software

Access to Document

10.1145/3573051.3593397

Cite this

Ritter, S., Heffernan, N., Williams, J. J., Lomas, D., Bicknell, K., Roschelle, J., Motz, B., McNamara, D., Baraniuk, R., Basu Mallick, D., Kizilcec, R., Baker, R., Fancsali, S., & Murphy, A. (2023). Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research. In L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale (pp. 254-256). (L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale). Association for Computing Machinery, Inc. https://doi.org/10.1145/3573051.3593397

Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research. / Ritter, Steve; Heffernan, Neil; Williams, Joseph Jay et al.
L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale. Association for Computing Machinery, Inc, 2023. p. 254-256 (L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Ritter, S, Heffernan, N, Williams, JJ, Lomas, D, Bicknell, K, Roschelle, J, Motz, B, McNamara, D, Baraniuk, R, Basu Mallick, D, Kizilcec, R, Baker, R, Fancsali, S & Murphy, A 2023, Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research. in L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale. L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale, Association for Computing Machinery, Inc, pp. 254-256, 10th ACM Conference on Learning @ Scale, L@S 2023, Copenhagen, Denmark, 7/20/23. https://doi.org/10.1145/3573051.3593397

Ritter S, Heffernan N, Williams JJ, Lomas D, Bicknell K, Roschelle J et al. Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research. In L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale. Association for Computing Machinery, Inc. 2023. p. 254-256. (L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale). doi: 10.1145/3573051.3593397

@inproceedings{380c9fce10f247b8be8b93853ee2b19a,

title = "Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research",

abstract = "Learning engineering adds tools and processes to learning platforms to support improvement research. One kind of tool is A/B testing-common in large software companies and also represented academically at conferences like the Annual Conference on Digital Experimentation (CODE). A number of A/B testing systems focused on educational apps have arisen recently, including UpGrade and E-TRIALS. A/B testing can help improve educational platforms, yet challenging issues in education go beyond the generic paradigm. In response, a number of of digital learning platforms is opening their systems to learning-improvement research by instructors and/or third-party researchers, with specific supports necessary for education-specific research designs. This workshop will explore how A/B testing in educational contexts is different, how learning platforms are opening up new possibilities, and how these empirical approaches can be used to drive powerful gains in student learning. It will also discuss forthcoming opportunities for funding to conduct platform-enabled learning research.",

keywords = "A/B Testing, Digital Experimentation, Educational Technology, Learning Engineering",

author = "Steve Ritter and Neil Heffernan and Williams, {Joseph Jay} and Derek Lomas and Klinton Bicknell and Jeremy Roschelle and Ben Motz and Danielle McNamara and Richard Baraniuk and {Basu Mallick}, Debshila and Rene Kizilcec and Ryan Baker and Stephen Fancsali and April Murphy",

note = "Publisher Copyright: {\textcopyright} 2023 Owner/Author.; 10th ACM Conference on Learning @ Scale, L@S 2023 ; Conference date: 20-07-2023 Through 22-07-2023",

year = "2023",

month = jul,

day = "20",

doi = "10.1145/3573051.3593397",

language = "English (US)",

series = "L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale",

publisher = "Association for Computing Machinery, Inc",

pages = "254--256",

booktitle = "L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale",

}

TY - GEN

T1 - Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research

AU - Ritter, Steve

AU - Heffernan, Neil

AU - Williams, Joseph Jay

AU - Lomas, Derek

AU - Bicknell, Klinton

AU - Roschelle, Jeremy

AU - Motz, Ben

AU - McNamara, Danielle

AU - Baraniuk, Richard

AU - Basu Mallick, Debshila

AU - Kizilcec, Rene

AU - Baker, Ryan

AU - Fancsali, Stephen

AU - Murphy, April

PY - 2023/7/20

Y1 - 2023/7/20

N2 - Learning engineering adds tools and processes to learning platforms to support improvement research. One kind of tool is A/B testing-common in large software companies and also represented academically at conferences like the Annual Conference on Digital Experimentation (CODE). A number of A/B testing systems focused on educational apps have arisen recently, including UpGrade and E-TRIALS. A/B testing can help improve educational platforms, yet challenging issues in education go beyond the generic paradigm. In response, a number of of digital learning platforms is opening their systems to learning-improvement research by instructors and/or third-party researchers, with specific supports necessary for education-specific research designs. This workshop will explore how A/B testing in educational contexts is different, how learning platforms are opening up new possibilities, and how these empirical approaches can be used to drive powerful gains in student learning. It will also discuss forthcoming opportunities for funding to conduct platform-enabled learning research.

AB - Learning engineering adds tools and processes to learning platforms to support improvement research. One kind of tool is A/B testing-common in large software companies and also represented academically at conferences like the Annual Conference on Digital Experimentation (CODE). A number of A/B testing systems focused on educational apps have arisen recently, including UpGrade and E-TRIALS. A/B testing can help improve educational platforms, yet challenging issues in education go beyond the generic paradigm. In response, a number of of digital learning platforms is opening their systems to learning-improvement research by instructors and/or third-party researchers, with specific supports necessary for education-specific research designs. This workshop will explore how A/B testing in educational contexts is different, how learning platforms are opening up new possibilities, and how these empirical approaches can be used to drive powerful gains in student learning. It will also discuss forthcoming opportunities for funding to conduct platform-enabled learning research.

KW - A/B Testing

KW - Digital Experimentation

KW - Educational Technology

KW - Learning Engineering

UR - http://www.scopus.com/inward/record.url?scp=85167871230&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85167871230&partnerID=8YFLogxK

U2 - 10.1145/3573051.3593397

DO - 10.1145/3573051.3593397

M3 - Conference contribution

AN - SCOPUS:85167871230

T3 - L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale

SP - 254

EP - 256

BT - L@S 2023 - Proceedings of the 10th ACM Conference on Learning @ Scale

PB - Association for Computing Machinery, Inc

T2 - 10th ACM Conference on Learning @ Scale, L@S 2023

Y2 - 20 July 2023 through 22 July 2023

ER -

Fourth Annual Workshop on A/B Testing and Platform-Enabled Learning Research

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this