What does the perfect Companion in Games look like? Development and Validation of the Companion Design Scale

Main Article Content

André Markus
Astrid Carolus
Carolin Wienrich

Abstract

Artificial intelligence gives companions in games (a special form of non-player characters) social, adaptive, and interactive characteristics that can influence the gaming experience. Initial design frameworks for these characteristics have been developed in research, but empirical validation and methods for quantifying their impact on game experience are still lacking. To close this gap, the study developed the Companion Design Scale, which operationalizes the design of companion characteristics and measures their impact on the game experience. Structural equation modeling shows that the scale measures companion characteristics reliably and validly. In addition, the study emphasizes the relevance of companion design in general, but also regarding specific design factors for the game experience. First practical analyses provide design recommendations for game design. This study thus offers insights into the design principles of humanoid AI companions and provides a basis for systematic studies on the psychological effects of artificial companions on users.

Dimensions

Plum Analytics

Article Details

Section
Articles

References

G. Díaz and A. Iglesias, "Swarm intelligence scheme for pathfinding and action planning of non-player characters on a last-generation video game," in Harmony Search Algorithm: Proceedings of the 3rd International Conference on Harmony Search Algorithm, Singapore, 2017: Springer, pp. 343-353, doi: https://doi.org/10.1007/978-981-10-3728-3_34.

H. Warpefelt, "Cues and insinuations: Indicating affordances of non-player character using visual indicators," in DiGRA Conference, Lüneburg, Germany, 2015.

J. Bates, "The role of emotion in believable agents," Communications of the ACM, vol. 37, no. 7, pp. 122-125, 1994, doi: https://doi.org/10.1145/176789.176803.

The Last of Us [Video Game], Naughty Dog, Carlifornia, 2013.

God of War [Video Game], SIE Santa Monica Studio, Los Angeles, 2018.

The Elder Scrolls V: Skyrim [Video Game], Bethesda Game Studios, Rockville, 2011.

K. Emmerich, P. Ring, and M. Masuch, "I'm Glad You Are on My Side: How to Design Compelling Game Companions," in Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play, Melbourne, VIC, Australia, 2018, pp. 141-152, doi: https://doi.org/10.1145/3242671.3242709.

J. Tremblay and C. Verbrugge, "Adaptive companions in FPS games," FDG, vol. 13, pp. 229-236, 2013.

N. Afonso and R. Prada, "Agents that relate: Improving the social believability of non-player characters in role-playing games," in Entertainment Computing-ICEC 2008: 7th International Conference, Pittsburgh, US, 2009: Springer, pp. 34-45, doi: https://doi.org/10.1007/978-3-540-89222-9_5.

A. Chowanda, M. Flintham, P. Blanchfield, and M. Valstar, "Playing with social and emotional game companions," presented at the Int. Conf. Intell. Virtual Agents 2016, Los Angeles, CA, USA, 2016.

C. J. Headleand, J. Jackson, L. Priday, W. Teahan, and L. Ap Cenydd, "Does the perceived identity of non-player characters change how we interact with them?," in 2015 International Conference on Cyberworlds, Visby, Sweden, 2015: IEEE, pp. 145-152.

C. J. Headleand, J. Jackson, B. Williams, L. Priday, W. J. Teahan, and L. Ap Cenydd, "How the perceived identity of a npc companion influences player behavior," Transactions on Computational Science XXVIII: Special Issue on Cyberworlds and Cybersecurity, pp. 88-107, 2016, doi: https://doi.org/10.1007/978-3-662-53090-0_5.

R. B. Cialdini and N. J. Goldstein, "Social influence: Compliance and conformity," Annu. Rev. Psychol., vol. 55, pp. 591-621, 2004, doi: https://doi.org/10.1146/annurev.psych.55.090902.142015.

K. Tanaka, S. Onoue, H. Nakanishi, and H. Ishiguro, "Motion is enough: How real-time avatars improve distant communication," in 2013 International Conference on Collaboration Technologies and Systems (CTS), San Diego, CA, USA, 2013: IEEE, pp. 465-472, doi: https://doi.org/10.1109/CTS.2013.6567270.

T. Merritt, C. Ong, T. L. Chuah, and K. McGee, "Did you notice? artificial team-mates take risks for players," in Intelligent Virtual Agents: 10th International Conference, Reykjavik, Iceland, 2011: Springer, pp. 338-349.

Y. Moon and C. Nass, "Are computers scapegoats? Attributions of responsibility in human–computer interaction," International Journal of Human-Computer Studies, vol. 49, no. 1, pp. 79-94, 1998, doi: https://doi.org/10.1006/ijhc.1998.0199.

J. Frommel, C. Phillips, and R. L. Mandryk, "Gathering Self-Report Data in Games through NPC Dialogues: Effects on Data Quality, Data Quantity, Player Experience, and Information Intimacy," in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 2021, pp. 1-12, doi: http://dx.doi.org/10.1145/3411764.3445411.

J. Harth, "Empathy with non-player characters? An empirical approach to the foundations of human/non-human relationships," Journal For Virtual Worlds Research, vol. 10, no. 2, 2017, doi: http://dx.doi.org/10.4101/jvwr.v10i2.7272.

M. Johansson, B. Strååt, H. Warpefelt, and H. Verhagen, "Analyzing the social dynamics of non-player characters," in Frontiers in Gaming Simulation, S. Meijer and R. Smeds Eds. Cham: Springer, 2013, pp. 173-187.

M. S. Lee and C. Heeter, "Cognitive Intervention and Reconciliation-NPC Believability in Single-Player RPGs," International Journal of Role-Playing, no. 5, pp. 47-65, 2015, doi: https://doi.org/10.33063/ijrp.vi5.236.

N. Barreto, R. Craveirinha, and L. Roque, "Validating the Creature Believability Scale for Videogames," in International Conference on Entertainment Computing, Poznan, Poland, 2018: Springer, pp. 198-204, doi: https://doi.org/10.1007/978-3-319-99426-0_17.

A. B. Loyall, "Believable Agents: Building Interactive Personalities," Carnegie Mellon University Pittsburgh, 1997.

M. S. Lee and C. Heeter, "What do you mean by believable characters?: The effect of character rating and hostility on the perception of character believability," Journal of Gaming & Virtual Worlds, vol. 4, no. 1, pp. 81-97, 2012, doi: http://dx.doi.org/10.1386/jgvw.4.1.81_1.

C. Bailey, J. You, G. Acton, A. Rankin, and M. Katchabaw, "Believability through psychosocial behaviour: Creating bots that are more engaging and entertaining," in Believable Bots: Springer, 2013, pp. 29-68.

M. Ochs, N. Sabouret, and V. Corruble, "Simulation of the dynamics of nonplayer characters' emotions and social relations in games," IEEE Transactions on Computational Intelligence and AI in Games, vol. 1, no. 4, pp. 281-297, 2009, doi: http://dx.doi.org/10.1109/TCIAIG.2009.2036247.

E. Bouquet, V. Mäkelä, and A. Schmidt, "Exploring the design of companions in video games," in Proceedings of the 24th International Academic Mindtrek Conference, Tampere/Virtual, Finland, 2021, pp. 145-153, doi: https://doi.org/10.1145/3464327.3464371.

W. IJsselsteijn, Y. de Kort, and K. Poels, "The game experience questionnaire," Eindhoven University of Technology, vol. 46, no. 1, pp. 1-8, 2013.

R. M. Ryan, C. S. Rigby, and A. Przybylski, "The motivational pull of video games: A self-determination theory approach," Motivation and emotion, vol. 30, pp. 344-360, 2006.

R. P. Bagozzi and Y. Yi, "On the evaluation of structural equation models," Journal of the academy of marketing science, vol. 16, no. 1, pp. 74-94, 1988, doi: https://doi.org/10.1007/BF02723327.

C. Fornell and D. F. Larcker, "Evaluating structural equation models with unobservable variables and measurement error," Journal of marketing research, vol. 18, no. 1, pp. 39-50, 1981, doi: https://doi.org/10.1177/002224378101800104.

J. Hair, W. Black, B. Babin, and R. Anderson, Multivariate data analysis: A Global Perspective, 7 ed. New Jersey: Pearson Education, 2010.

J. C. Nunnally and I. H. Bernstein, Psychometric Theory New York, 3 ed. New York: McGraw-Hill, 1994.

D. J. Leiner, "SoSci Survey (Version 3.5.02) [Computer software]," ed, 2024.

J. C. Flanagan, "The critical incident technique," Psychological bulletin, vol. 51, no. 4, p. 327, 1954, doi: https://doi.org/10.1037/h0061470.

Y. Rosseel, "lavaan: An R Package for Structural Equation Modeling.," Journal of Statistical Software, vol. 48, no. 2, pp. 1–36, 2012, doi: https://doi.org/10.18637/jss.v048.i02.

K. G. Jöreskog and D. Sörbom, LISREL 8: User's reference guide. Scientific Software International, 1996.

K. Schermelleh-Engel, H. Moosbrugger, and H. Müller, "Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures," Methods of psychological research online, vol. 8, no. 2, pp. 23-74, 2003, doi: https://doi.org/10.23668/psycharchives.12784.

R. C. MacCallum, M. Roznowski, and L. B. Necowitz, "Model modifications in covariance structure analysis: the problem of capitalization on chance," Psychological bulletin, vol. 111, no. 3, pp. 490-504, 1992, doi: https://doi.org/10.1037/0033-2909.111.3.490.

T. A. Brown, Confirmatory factor analysis for applied research. Guilford publications, 2015.

P. Kline, Handbook of psychological testing. Routledge, 2013.

W. W. Chin, "Commentary: Issues and opinion on structural equation modeling," MIS Quarterly, vol. 22, no. 1, pp. 7-16, 1998.

J. Henseler, C. M. Ringle, and R. R. Sinkovics, "The use of partial least squares path modeling in international marketing," in New challenges to international marketing, vol. 20: Emerald Group Publishing Limited, 2009, pp. 277-319.

H. Schecker, "Überprüfung der Konsistenz von Itemgruppen mit Cronbachs α," in Methoden in der naturwissenschaftsdidaktischen Forschung, vol. 1, D. Krüger, I. Parchmann, and H. Schecker Eds.: Springer Spektrum, 2014.

N. Schmitt, "Uses and abuses of coefficient alpha," Psychological assessment, vol. 8, no. 4, p. 350, 1996, doi: http://dx.doi.org/10.1037/1040-3590.8.4.350.

Resident Evil 4 [Video Game], Capcom, Osaka, Japan, 2005.

S. Summer. "Auf das Resident Evil 4 Remake freue ich mich riesig, mit Ausnahme von Ashley." Game Pro. https://www.gamepro.de/artikel/re4-remake-freue-mich-nicht-auf-ashley,3381266.html (accessed March, 21, 2024).

A. Bandura, "Human agency in social cognitive theory," American psychologist, vol. 44, no. 9, pp. 1175-1184, 1989, doi: https://doi.org/10.1037/0003-066X.44.9.1175.

S. Trepte and L. Reinecke, "The pleasures of success: Game-related efficacy experiences as a mediator between player performance and game enjoyment," Cyberpsychology, Behavior, and Social Networking, vol. 14, no. 9, pp. 555-557, 2011, doi: https://doi.org/10.1089/cyber.2010.0358.

P. Brandstätter, S. Hagmann, D. Krückl, M. Maurer, and M. Lankes, "I will stand by you: Measuring the perceived Social Presence towards Semi-Autonomous Companions in a 2D game," in Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play, 2021, pp. 5-9, doi: https://doi.org/10.1145/3450337.3483488.

W. D. Care, "Identifying the learning needs of nurse managers. application of the critical incident technique," Journal of Nursing Staff Development: JNSD, vol. 12, no. 1, pp. 27-30, 1996.

E. Kirchler, Arbeits-und Organisationspsychologie. 2009.

E. L.-C. Law, F. Brühlmann, and E. D. Mekler, "Systematic review and validation of the game experience questionnaire (geq)-implications for citation and reporting practice," in Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play, 2018, pp. 257-270, doi: https://doi.org/10.1145/3242671.3242683.

C. Chou and M.-J. Tsai, "Gender differences in Taiwan high school students’ computer game playing," Computers in human behavior, vol. 23, no. 1, pp. 812-824, 2007, doi: https://doi.org/10.1016/j.chb.2004.11.011.

B. Cowley, D. Charles, M. Black, and R. Hickey, "Toward an understanding of flow in video games," Computers in Entertainment (CIE), vol. 6, no. 2, pp. 1-27, 2008, doi: http://dx.doi.org/10.1145/1371216.1371223.

B. Ip and G. Jacobs, "Quantifying game design," Design Studies, vol. 25, no. 6, pp. 607-624, 2004, doi: https://doi.org/10.1016/j.destud.2004.02.001.

N. Yee, "The gamer motivation profile: What we learned from 250,000 gamers," in Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play, New York, US, 2016.

N. Gueguen and M. A. De Gail, "The effect of smiling on helping behavior: Smiling and good Samaritan behavior," Communication reports, vol. 16, no. 2, pp. 133-140, 2003, doi: http://dx.doi.org/10.1080/08934210309384496.

C. Wienrich and A. Carolus, "A More Holistic View of Literacy Specifications in the Context of Speech-based Systems," in Proc. 2021 ISCA Symposium on Security and Privacy in Speech Communication, 2021, pp. 73-75.

C. Wienrich, A. Carolus, A. Markus, Y. Augustin, J. Pfister, and A. Hotho, "Long-Term Effects of Perceived Friendship with Intelligent Voice Assistants on Usage Behavior, User Experience, and Social Perceptions," Computers, vol. 12, no. 4, p. 77, 2023, doi: https://doi.org/10.3390/computers12040077.

C. Wienrich and M. E. Latoschik, "eXtended artificial intelligence: New prospects of human-ai interaction research," Frontiers in Virtual Reality, vol. 2, p. 686783, 2021, doi: https://doi.org/10.3389/frvir.2021.686783.

K. Darling, "Extending legal protection to social robots: The effects of anthropomorphism, empathy, and violent behavior towards robotic objects," Robot Law, Calo, Froomkin, Kerr eds., Edward Elgar, 2016, doi: http://dx.doi.org/10.2139/ssrn.2044797.

E. Cho, "Hey Google, can I ask you something in private?," in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, Scotland, UK, 2019, pp. 1-9, doi: https://doi.org/10.1145/3290605.3300488.

C. Ischen, T. Araujo, H. Voorveld, G. van Noort, and E. Smit, "Privacy concerns in chatbot interactions," in Chatbot Research and Design, A. Følstad et al. Eds. Advance online publication: Springer, 2020, pp. 34-48.