Katelyn M. Grasse
ABSTRACT
Responsible conduct of research (RCR) is an essential skill for all researchers to develop, but training scientists to behave ethically is complex because it requires addressing both cognitive (i.e., conceptual knowledge and moral reasoning skills) and socio-affective (i.e., attitudes) learning outcomes. Currently, both classroom- and web-based forms of RCR training struggle to address these distinct types of learning outcomes simultaneously. In this paper, we present a study providing initial evidence that playing a single brief session of Academical, a choice-based interactive narrative game, can significantly improve players’ attitudes about RCR. We further demonstrate the relationship between engagement with the game and resulting attitudes. Combined with our previous work showing Academical’s advantages over traditional RCR training for teaching cognitive learning outcomes, this study’s results highlight that utilizing a choice-based interactive story game is a uniquely effective way to holistically address RCR learning outcomes that drive ethical research behavior.
- Saleem Elias Alhabash and Kevin Wise. 2012. PeaceMaker: Changing students’ attitudes toward Palestinians and Israelis through video game play. International Journal of Communication 6 (2012), 25.Google Scholar
- Melissa S Anderson, Aaron S Horn, Kelly R Risbey, Emily A Ronning, Raymond De Vries, and Brian C Martinson. 2007. What do mentoring and training in the responsible conduct of research have to do with scientists’ misbehavior? Findings from a national survey of NIH-funded scientists. Academic Medicine 82, 9 (2007), 853–860.Google ScholarCross Ref
- Alison L Antes and James M DuBois. 2014. Aligning objectives and assessment in responsible conduct of research instruction. Journal of Microbiology & Biology Education 15, 2 (2014), 108.Google ScholarCross Ref
- Alison L Antes, Stephen T Murphy, Ethan P Waples, Michael D Mumford, Ryan P Brown, Shane Connelly, and Lynn D Devenport. 2009. A meta-analysis of ethics instruction effectiveness in the sciences. Ethics & Behavior 19, 5 (2009), 379–402.Google ScholarCross Ref
- Alison L Antes, Xiaoqian Wang, Michael D Mumford, Ryan P Brown, Shane Connelly, and Lynn D Devenport. 2010. Evaluating the effects that existing instruction on responsible conduct of research has on ethical decision making. Academic medicine: journal of the Association of American Medical Colleges 85, 3(2010), 519.Google Scholar
- Sarah A Aynsely, Kusum Nathawat, and Ruseell M Crawford. 2018. Evaluating student perceptions of using a game-based approach to aid learning: Braincept. Higher Education Pedagogies 3 (2018), 478–489. Issue 1.Google ScholarCross Ref
- Haiyan Bai, Wei Pan, Astusi Hirumi, and Mansureh Kebritchi. 2012. Assessing the effectiveness of a 3-D instructional game on improving mathematics achievement and motivation of middle school students. British Journal of Educational Technology 43, 6 (2012), 993–1003. https://doi.org/10.1111/j.1467-8535.2011.01269.xGoogle ScholarCross Ref
- Muriel J Bebeau. 1993. Designing an Outcome-based Ethics Curriculum for Professional Education: strategies and evidence of effectiveness. Journal of moral education 22, 3 (1993), 313–326.Google ScholarCross Ref
- Max V Birk, Cheralyn Atkins, Jason T Bowey, and Regan L Mandryk. 2016. Fostering intrinsic motivation through avatar identification in digital games. In Proceedings of the 2016 CHI conference on human factors in computing systems. 2982–2995.Google ScholarDigital Library
- Kurt Braddock and James Price Dillard. 2016. Meta-analytic evidence for the persuasive effect of narratives on beliefs, attitudes, intentions, and behaviors. Communication Monographs 83, 4 (2016), 446–467.Google ScholarCross Ref
- Bradley J Brummel, CK Gunsalus, Kerri L Anderson, and Michael C Loui. 2010. Development of role-play scenarios for teaching responsible conduct of research. Science and Engineering Ethics 16, 3 (2010), 573–589.Google ScholarCross Ref
- Douglas B Clark, Emily E Tanner-Smith, and Stephen S Killingsworth. 2016. Digital games, design, and learning: A systematic review and meta-analysis. Review of educational research 86, 1 (2016), 79–122.Google ScholarCross Ref
- Jacob Cohen. 2013. Statistical power analysis for the behavioral sciences. Academic press.Google Scholar
- Christine P Dancey and John Reidy. 2007. Statistics without maths for psychology. Pearson education.Google Scholar
- Sara De Freitas. 2006. Learning in immersive worlds: A review of game-based learning. (2006).Google Scholar
- Jennifer Edson Escalas. 2004. Imagine yourself in the product: Mental simulation, narrative transportation, and persuasion. Journal of advertising 33, 2 (2004), 37–48.Google ScholarCross Ref
- Deniz Eseryel, Victor Law, Dirk Ifenthaler, Xun Gel, and Raymond Miller. 2014. An Investigation of the Interrelationships between Motivation, Engagement, and Complex Problem Solving in Game-based Learning. Journal of Educational Technology & Society 17 (2014), 42–53. Issue 1.Google Scholar
- Celia B Fisher, Adam L Fried, and Lindsay G Feldman. 2009. Graduate socialization in the responsible conduct of research: A national survey on the research ethics training experiences of psychology doctoral students. Ethics & Behavior 19, 6 (2009), 496–518.Google ScholarCross Ref
- Varvara Garneli, Michail Giannakos, and Konstantinos Chorianopoulos. 2017. Serious games as a malleable learning medium: The effects of narrative, gameplay, and making on students’ performance and attitudes. British Journal of Educational Technology 48, 3 (2017), 842–859. https://doi.org/10.1111/bjet.12455Google ScholarCross Ref
- Andreas Gegenfurtner, Koen Veermans, Dagmar Festner, and Hans Gruber. 2009. Integrative literature review: Motivation to transfer training: An integrative literature review. Human resource development review 8, 3 (2009), 403–423.Google Scholar
- Melanie C Green and Keenan M Jenkins. 2014. Interactive narratives: Processes and outcomes in user-directed stories. Journal of Communication 64, 3 (2014), 479–500.Google ScholarCross Ref
- Melanie C Green and Keenan M Jenkins. 2020. Need for Cognition, Transportability, and Engagement with Interactive Narratives. Games for health journal 9, 3 (2020), 182–186.Google Scholar
- Matthew Grizzard, Ron Tamborini, Robert J Lewis, Lu Wang, and Sujay Prabhu. 2014. Being bad in a video game can make us morally sensitive. Cyberpsychology, Behavior, and Social Networking 17, 8(2014), 499–504.Google ScholarCross Ref
- Hussein Haruna, Xiao Hu, Samuel Kai Wah Chu, Robin R Mellecker, Goodluck Gabriel, and Patrick Siril Ndekao. 2018. Improving Sexual Health Education Programs for Adolescent Students through Game-Based Learning and Gamification. International Journal of Environmental Research and Public Health 15 (2018). https://doi.org/10.3390/ijerph15092027Google ScholarCross Ref
- Gwo-Jen Hwang, Po-Han Wu, and Chi-Chang Chen. 2012. An online game approach for improving students’learning performance in web-based problem-solving activities. Journal of Educational Computing Research 59 (2012), 1246–1256.Google ScholarDigital Library
- Michael Kalichman. 2013. A Brief History of RCR Education. Account Res 20, 5-6 (Jan. 2013), 380–394. https://doi.org/10.1080/08989621.2013.822260Google ScholarCross Ref
- Michael Kalichman. 2014. Rescuing responsible conduct of research (RCR) education. Accountability in research 21, 1 (2014), 68–83.Google Scholar
- Michael W Kalichman and Dena K Plemmons. 2007. Reported goals for responsible conduct of research courses. Academic Medicine 82, 9 (2007), 846–852.Google ScholarCross Ref
- Michael W Kalichman and Dena K Plemmons. 2015. Research agenda: The effects of responsible-conduct-of-research training on attitudes. Journal of Empirical Research on Human Research Ethics 10, 5(2015), 457–459.Google ScholarCross Ref
- Fengfeng Ke. 2008. Computer games application within alternative classroom goal structures: cognitive, metacognitive,and affective evaluation. Educational Technology Research and Development 56 (2008), 539–556. https://doi.org/10.1007/s11423-008-9086-5Google ScholarCross Ref
- Greg Kearsley and Ben Shneiderman. 1998. Engagement theory: A framework for technology-based teaching and learning. Educational technology 38, 5 (1998), 20–23.Google Scholar
- Matthew Lombard, Theresa B Ditton, and Lisa Weinstein. 2009. Measuring presence: the temple presence inventory. In Proceedings of the 12th annual international workshop on presence. 1–15.Google Scholar
- Matthew Lombard, Lisa Weinstein, and Theresa Ditton. 2011. Measuring telepresence: The validity of the Temple Presence Inventory (TPI) in a gaming context. In ISPR 2011: The International Society for Presence Research Annual Conference. Edinburgh.Google Scholar
- Rocio Lorenzo-Alvarez, Teodoro Rudolphi-Solero, Miguel J Ruiz-Gomez, and Francisco Sendra-Portero. 2020. Game-based Learning in Virtual Worlds: A Multiuser Online Game for Medical Undergraduate Radiology Education within Second Life. Anatomical Sciences Education 13 (2020), 602–617.Google ScholarCross Ref
- Mia Liza A Lustria. 2007. Can interactivity make a difference? Effects of interactivity on the comprehension of and attitudes toward online health content. Journal of the American Society for Information Science and Technology 58, 6 (2007), 766–776.Google ScholarDigital Library
- Rosa Mikeal Martey, Kate Kenski, James Folkestad, Laurie Feldman, Elana Gordis, Adrienne Shaw, Jennifer Stromer-Galley, Ben Clegg, Hui Zhang, Nissim Kaufman, 2014. Measuring game engagement: multiple methods and construct complexity. Simulation & Gaming 45, 4-5 (2014), 528–547.Google ScholarDigital Library
- Jennifer McCafferty, Reid Cushman, Kenneth W Goodman, Paul Braunschweiger, and Robin N Fiore. 2012. New NSF And NIH Responsible Conduct of Research (RCR) Guidelines: A Three-Phase Plan. Teaching Ethics 12, 2 (2012), 23–30.Google ScholarCross Ref
- Edward F Melcer, Katelyn M Grasse, James Ryan, Nick Junius, Max Kreminski, Dietrich Squinkifer, Brent Hill, and Noah Wardrip-Fruin. 2020. Getting Academical: A Choice-Based Interactive Storytelling Game for Teaching Responsible Conduct of Research. In Proceedings of the 15th International Conference on the Foundations of Digital Games-FDG.Google ScholarDigital Library
- Edward F Melcer, James Ryan, Nick Junius, Max Kreminski, Dietrich Squinkifer, Brent Hill, and Noah Wardrip-Fruin. 2020. Teaching Responsible Conduct of Research Through an Interactive Storytelling Game. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–10.Google ScholarDigital Library
- Engineering National Academies of Sciences, Medicine, 2017. Fostering integrity in research. National Academies Press.Google Scholar
- Raymond A Noe. 1986. Trainees’ attributes and attitudes: Neglected influences on training effectiveness. Academy of management review 11, 4 (1986), 736–749.Google Scholar
- Heather L O’Brien and Elaine G Toms. 2008. What is user engagement? A conceptual framework for defining user engagement with technology. Journal of the American society for Information Science and Technology 59, 6 (2008), 938–955.Google ScholarCross Ref
- Scott Parrott, Francesca R Dillman Carpentier, and C Temple Northup. 2017. A test of interactive narrative as a tool against prejudice. Howard Journal of Communications 28, 4 (2017), 374–389.Google ScholarCross Ref
- Dena K Plemmons, Suzanne A Brody, and Michael W Kalichman. 2006. Student perceptions of the effectiveness of education in the responsible conduct of research. Science and engineering ethics 12, 3 (2006), 571–582.Google Scholar
- Sean T Powell, Matthew A Allison, and Michael W Kalichman. 2007. Effectiveness of a responsible conduct of research course: A preliminary study. Science and engineering ethics 13, 2 (2007), 249–264.Google Scholar
- Deepa Rao and Ieva Stupans. 2012. Exploring the potential of role play in higher education: development of a typology and teacher guidelines. Innovations in Education and Teaching International 49, 4(2012), 427–436.Google ScholarCross Ref
- Lesley M Roberts, Connie Wiskin, and Andrea Roalfe. 2008. Effects of exposure to mental illness in role-play on undergraduate student attitudes. Family medicine 40, 7 (2008), 477.Google Scholar
- Jonathan P Rowe, Lucy R Shores, Bradford W Mott, and James C Lester. 2010. Integrating learning and engagement in narrative-centered learning environments. In International Conference on Intelligent Tutoring Systems. Springer, 166–177.Google ScholarDigital Library
- Jennifer L Sabourin and James C Lester. 2013. Affect and engagement in Game-Based Learning environments. IEEE transactions on affective computing 5, 1 (2013), 45–56.Google Scholar
- Karen B Schmaling and Arthur W Blume. 2009. Ethics instruction increases graduate students’ responsible conduct of research knowledge but not moral reasoning. Accountability in Research 16, 5 (2009), 268–283.Google ScholarCross Ref
- Karen Schrier. 2015. EPIC: A framework for using video games in ethics education. Journal of Moral Education 44, 4 (2015), 393–424.Google ScholarCross Ref
- Karen Schrier. 2015. Ethical thinking and sustainability in role-play participants: A preliminary study. Simulation & Gaming 46, 6 (2015), 673–696.Google ScholarDigital Library
- Stephanie N Seiler, Bradley J Brummel, Kerri L Anderson, Kyoung Jin Kim, Serena Wee, CK Gunsalus, and Michael C Loui. 2011. Outcomes assessment of role-play scenarios for teaching responsible conduct of research. Accountability in Research 18, 4 (2011), 217–246.Google ScholarCross Ref
- Eric P Skye, Heather Wagenschutz, Jeffrey A Steiger, and Arno K Kumagai. 2014. Use of interactive theater and role play to develop medical students’ skills in breaking bad news. Journal of Cancer Education 29, 4 (2014), 704–708.Google ScholarCross Ref
- Hiller A Spires, Jonathan P Rowe, Bradford W Mott, and James C Lester. 2011. Problem Solving and Game-based Learning: Effects of Middle Grade Students’ Hypothesis Testing Strategies on Learning Outcomes. Journal of Educational Computing Research 44 (2011), 453–472. Issue 4.Google ScholarCross Ref
- Sharon T Steinemann, Glena H Iten, Klaus Opwis, Seamus F Forde, Lars Frasseck, and Elisa D Mekler. 2017. Interactive narratives affecting social change. Journal of Media Psychology(2017).Google Scholar
- Sujit Subhash and Elizabeth A Cudney. 2018. Gamified learning in higher education: A systematic review of the literature. Computers in Human Behavior 87 (2018), 192–206.Google ScholarDigital Library
- Ross Taplin, Abhijeet Singh, Rosemary Kerr, and Alina Lee. 2018. The use of short role-plays for an ethics intervention in university auditing courses. Accounting Education 27, 4 (2018), 383–402.Google ScholarCross Ref
- L Vuckovic-Dekic, D Gavrilovic, I Kezic, G Bogdanovic, and S Brkic. 2012. Science ethics education part II: changes in attitude toward scientific fraud among medical researchers after a short course in science ethics. J BUON 17, 2 (2012), 391–5.Google Scholar
- Connie Wiskin, Lesley Roberts, and Andrea Roalfe. 2011. The impact of discussing a sexual history in role-play simulation teaching on pre-clinical student attitudes towards people who submit for STI testing. Medical Teacher 33, 6 (2011), e324–e332.Google ScholarCross Ref
- Jui-Mei Yien, Chun-Ming Hung, Gwo-Jen Hwang, and Yueh-Chiao Lin. 2011. A Game-based Learning Approach to Improving Students’ Learning Achievements in A Nutrition Course. The Turkish Online Journal of Educational Technology 10 (2011). Issue 2.Google Scholar
- Amitai Ziv, Paul Root Wolpe, Stephen D Small, and Shimon Glick. 2003. Simulation-based medical education: an ethical imperative. Academic medicine 78, 8 (2003), 783–788.Google ScholarCross Ref
Index Terms
- Improving Undergraduate Attitudes Towards Responsible Conduct of Research Through an Interactive Storytelling Game
Index terms have been assigned to the content through auto-classification.
Recommendations
Teaching Responsible Conduct of Research Through an Interactive Storytelling Game
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsConcepts utilizing applied ethics, such as responsible conduct of research (RCR), can prove difficult to teach due to the complexity of problems faced by researchers and the many underlying perspectives involved in such dilemmas. To address this issue, ...
Getting Academical: A Choice-Based Interactive Storytelling Game for Teaching Responsible Conduct of Research
FDG '20: Proceedings of the 15th International Conference on the Foundations of Digital GamesConcepts utilizing applied ethics, such as responsible conduct of research (RCR), can prove difficult to teach due to the complexity of problems faced by researchers and the many underlying perspectives involved in such dilemmas. To address this issue, ...
The experience of interactive storytelling: comparing “fahrenheit” with “façade”
ICEC'11: Proceedings of the 10th international conference on Entertainment ComputingAt the intersection of multimedia, artificial intelligence, and gaming technology, new visions of future entertainment media arise that approximate the “Holodeck” ® idea of interactive storytelling. We report exploratory experiments on the user ...
Comments