We curated a list of this year’s publications — including links to social media, lab websites, and supplemental material. We have six journal articles, 67 full papers, 30 LBWs, eleven interactivities, one alt.chi paper, one DC paper, lead three workshops and give two courses. Four papers were awarded a best paper award, and seven papers received an honourable mention.
The papers for the contributing labs were also curated in a PDF booklet by Michael Chamunorwa, and it can be downloaded here: Booklet 2023
Your publication is missing? Send us an email: contact@germanhci.de
About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services
Thomas Mildner (University of Bremen), Gian-Luca Savino (University of St.Gallen), Philip R. Doyle (University College Dublin), Benjamin R. Cowen (University College Dublin), Rainer Malaka (University of Bremen)
Abstract | Tags: Full Paper, Honorable Mention | Links:
@inproceedings{Mildner2023Dark,
title = {About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services },
author = {Thomas Mildner (University of Bremen), Gian-Luca Savino (University of St.Gallen), Philip R. Doyle (University College Dublin), Benjamin R. Cowen (University College Dublin), Rainer Malaka (University of Bremen)},
url = {http://dm.tzi.de/, Website
https://twitter.com/dmlabbremen, twitter
},
doi = {10.1145/3544548.3580695},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Research in HCI has shown a growing interest in unethical design practices across numerous domains, often described as "dark patterns". There is, however, a literature gap regarding social networking services (SNSs). Meanwhile, related studies emphasise a need for more control over personal data and agency on SNSs. To understand how dark patterns manifest in SNSs, we recorded over 16 hours of usage from four mobile SNS applications: Facebook, Instagram, TikTok, and Twitter. To mitigate possible difficulties of non-experts studied before, we turned towards six HCI experts as reviewers. Two researchers then conducted a thematic analysis based on existing taxonomies. Our results deliver two key findings: We observed which instances occur in SNSs and identified two strategies - engaging and governing - with five dark patterns undescribed before. This work expands prior research by demonstrating how existing taxonomies can be applied in alternative contexts, enabling the discovery of undefined ones.},
keywords = {Full Paper, Honorable Mention},
pubstate = {published},
tppubtype = {inproceedings}
}
Research in HCI has shown a growing interest in unethical design practices across numerous domains, often described as "dark patterns". There is, however, a literature gap regarding social networking services (SNSs). Meanwhile, related studies emphasise a need for more control over personal data and agency on SNSs. To understand how dark patterns manifest in SNSs, we recorded over 16 hours of usage from four mobile SNS applications: Facebook, Instagram, TikTok, and Twitter. To mitigate possible difficulties of non-experts studied before, we turned towards six HCI experts as reviewers. Two researchers then conducted a thematic analysis based on existing taxonomies. Our results deliver two key findings: We observed which instances occur in SNSs and identified two strategies - engaging and governing - with five dark patterns undescribed before. This work expands prior research by demonstrating how existing taxonomies can be applied in alternative contexts, enabling the discovery of undefined ones.
An Examination of Motivation in Physical Therapy Through the Lens of Self-Determination Theory: Implications for Game Design
Maria Aufheimer (KIT), Kathrin Gerling (KIT), Nicholas Graham (Queen's University), Mari Naaris (KU Leuven), Marco Konings (KU Leuven), Elegast Monbaliu (KU Leuven), Hans Hallez (KU Leuven), Els Ortibus (UZ Leuven)
Abstract | Tags: Full Paper, Honorable Mention | Links:
@inproceedings{Aufheimer2023Therapy,
title = {An Examination of Motivation in Physical Therapy Through the Lens of Self-Determination Theory: Implications for Game Design},
author = {Maria Aufheimer (KIT), Kathrin Gerling (KIT), Nicholas Graham (Queen's University), Mari Naaris (KU Leuven), Marco Konings (KU Leuven), Elegast Monbaliu (KU Leuven), Hans Hallez (KU Leuven), Els Ortibus (UZ Leuven)},
url = {https://hci.anthropomatik.kit.edu/, Website},
doi = {10.1145/3544548.3581171},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {While it is widely assumed that games can engage patients in therapy through their inherent 'motivational pull', relatively little attention has been paid to what HCI games research can learn from strategies employed by therapists. We address this gap by leveraging Self-Determination Theory (SDT) and its mini-theories Basic Psychological Needs Theory and Organismic Integration Theory as a theoretical lens on physical therapy for children and adolescents. Results from in-depth interviews with twelve therapists show that they carefully adjust sessions to allow patients to experience competence, making more comprehensive adjustments than currently offered by games. Additionally, we highlight how therapists leverage their relationship with patients to support motivation, but struggle to reconcile meaningful experiences of autonomy with therapeutic goals. On this basis, we reflect on implications for researchers and designers who create games for physical therapy, and the potential of SDT to provide a foundation for game design and therapeutic practice.},
keywords = {Full Paper, Honorable Mention},
pubstate = {published},
tppubtype = {inproceedings}
}
While it is widely assumed that games can engage patients in therapy through their inherent 'motivational pull', relatively little attention has been paid to what HCI games research can learn from strategies employed by therapists. We address this gap by leveraging Self-Determination Theory (SDT) and its mini-theories Basic Psychological Needs Theory and Organismic Integration Theory as a theoretical lens on physical therapy for children and adolescents. Results from in-depth interviews with twelve therapists show that they carefully adjust sessions to allow patients to experience competence, making more comprehensive adjustments than currently offered by games. Additionally, we highlight how therapists leverage their relationship with patients to support motivation, but struggle to reconcile meaningful experiences of autonomy with therapeutic goals. On this basis, we reflect on implications for researchers and designers who create games for physical therapy, and the potential of SDT to provide a foundation for game design and therapeutic practice.
Co-Writing with Opinionated Language Models Affects Users' Views
Maurice Jakesch (Cornell University), Advait Bhat (Microsoft Research), Daniel Buschek (University of Bayreuth), Lior Zalmanson (Tel Aviv University), Mor Naaman (Cornell Tech)
Abstract | Tags: Full Paper, Honorable Mention | Links:
@inproceedings{Jakesch2023models,
title = {Co-Writing with Opinionated Language Models Affects Users' Views},
author = {Maurice Jakesch (Cornell University), Advait Bhat (Microsoft Research), Daniel Buschek (University of Bayreuth), Lior Zalmanson (Tel Aviv University), Mor Naaman (Cornell Tech)},
url = {https://www.hciai.uni-bayreuth.de/, Webseite},
doi = {10.1145/3544548.3581196},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {If large language models like GPT-3 preferably produce a particular point of view, they may influence people's opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write -- and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants' writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.},
keywords = {Full Paper, Honorable Mention},
pubstate = {published},
tppubtype = {inproceedings}
}
If large language models like GPT-3 preferably produce a particular point of view, they may influence people's opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write -- and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants' writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.
Haptic Servos: Self-Contained Vibrotactile Rendering System for Creating or Augmenting Material Experiences
Nihar Sabnis (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany), Dennis Wittchen (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany), Courtney N. Reed (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany), Narjes Pourjafarian (Saarland University, Saarland Informatics Campus, Saarbrücken, Saarland, Germany), Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Paul Strohmeier (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany)
Abstract | Tags: Full Paper, Honorable Mention | Links:
@inproceedings{Sabnis2024sensorimotor,
title = {Haptic Servos: Self-Contained Vibrotactile Rendering System for Creating or Augmenting Material Experiences},
author = {Nihar Sabnis (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany) and Dennis Wittchen (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany) and Courtney N. Reed (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany) and Narjes Pourjafarian (Saarland University, Saarland Informatics Campus, Saarbrücken, Saarland, Germany) and Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany) and Paul Strohmeier (Sensorimotor Interaction, Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany)},
url = {https://www.youtube.com/watch?v=g50hMcphB5Q, Teaser Video
https://www.youtube.com/watch?v=Zih_MBZ_DSY, Video Figure
https://sensint.mpi-inf.mpg.de/, Website},
doi = {10.1145/3544548.3580716},
year = {2023},
date = {2023-04-20},
urldate = {2023-04-20},
publisher = {ACM},
abstract = {When vibrations are synchronized with our actions, we experience them as material properties. This has been used to create virtual experiences like friction, counter-force, compliance, or torsion. Implementing such experiences is non-trivial, requiring high temporal resolution in sensing, high fidelity tactile output, and low latency. To make this style of haptic feedback more accessible to non-domain experts, we present Haptic Servos: self-contained haptic rendering devices which encapsulate all timing-critical elements. We characterize Haptic Servos’ real-time performance, showing the system latency is < 5 ms. We explore the subjective experiences they can evoke, highlighting that qualitatively distinct experiences can be created based on input mapping, even if stimulation parameters and algorithm remain unchanged. A workshop demonstrated that users new to Haptic Servos require approximately ten minutes to set up a basic haptic rendering system. Haptic Servos are open source, we invite others to copy and modify our design.},
keywords = {Full Paper, Honorable Mention},
pubstate = {published},
tppubtype = {inproceedings}
}
When vibrations are synchronized with our actions, we experience them as material properties. This has been used to create virtual experiences like friction, counter-force, compliance, or torsion. Implementing such experiences is non-trivial, requiring high temporal resolution in sensing, high fidelity tactile output, and low latency. To make this style of haptic feedback more accessible to non-domain experts, we present Haptic Servos: self-contained haptic rendering devices which encapsulate all timing-critical elements. We characterize Haptic Servos’ real-time performance, showing the system latency is < 5 ms. We explore the subjective experiences they can evoke, highlighting that qualitatively distinct experiences can be created based on input mapping, even if stimulation parameters and algorithm remain unchanged. A workshop demonstrated that users new to Haptic Servos require approximately ten minutes to set up a basic haptic rendering system. Haptic Servos are open source, we invite others to copy and modify our design.
Keep it Real: Investigating Driver-Cyclist Interaction in Real-World Traffic
Ammar Al-Taie (University of Glasgow), Yasmeen Abdrabou (University of the BundeswehrMunich, University of Glasgow), Shaun Macdonald (University of Glasgow), Frank Pollick (University of Glasgow), Stephen Brewster (University of Glasgow)
Abstract | Tags: Full Paper, Honorable Mention | Links:
@inproceedings{AlTaie2023Keep,
title = {Keep it Real: Investigating Driver-Cyclist Interaction in Real-World Traffic},
author = {Ammar Al-Taie (University of Glasgow), Yasmeen Abdrabou (University of the BundeswehrMunich and University of Glasgow), Shaun Macdonald (University of Glasgow), Frank Pollick (University of Glasgow), Stephen Brewster (University of Glasgow)},
url = {https://www.unibw.de/usable-security-and-privacy-en, Website
},
doi = {10.1145/3544548.3581049},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Cyclists encounter drivers in many traffic scenarios; good communication is key to avoiding collisions. Little is known about everyday driver-cyclist interaction and communication. This is important in designing Automated Vehicles (AVs) that must drive safely around cyclists. We explored driver-cyclist interaction across diverse scenarios through in-the-wild observations (N=414) and a naturalistic study involving cyclists wearing eye-trackers (N=12). Results showed cyclists attended to road markings and traffic signs in controlled traffic scenarios but to vehicle sides and windows in uncontrolled encounters. Interactions were unlikely at controlled intersections, but various techniques were used to negotiate right-of-way in uncontrolled scenarios, e.g. cyclists used arm gestures and shoulder checks to communicate their intent and awareness when lane merging. Drivers communicated these through on-vehicle signals and head movements at roundabouts. We discuss the implications of driver-cyclist interaction behaviour on AV interaction design and offer insights into system requirements to support cyclists riding in traffic.},
keywords = {Full Paper, Honorable Mention},
pubstate = {published},
tppubtype = {inproceedings}
}
Cyclists encounter drivers in many traffic scenarios; good communication is key to avoiding collisions. Little is known about everyday driver-cyclist interaction and communication. This is important in designing Automated Vehicles (AVs) that must drive safely around cyclists. We explored driver-cyclist interaction across diverse scenarios through in-the-wild observations (N=414) and a naturalistic study involving cyclists wearing eye-trackers (N=12). Results showed cyclists attended to road markings and traffic signs in controlled traffic scenarios but to vehicle sides and windows in uncontrolled encounters. Interactions were unlikely at controlled intersections, but various techniques were used to negotiate right-of-way in uncontrolled scenarios, e.g. cyclists used arm gestures and shoulder checks to communicate their intent and awareness when lane merging. Drivers communicated these through on-vehicle signals and head movements at roundabouts. We discuss the implications of driver-cyclist interaction behaviour on AV interaction design and offer insights into system requirements to support cyclists riding in traffic.
Memory Manipulations in Extended Reality
Elise Bonnail (Telecom Paris, IP Paris), Wen-Jie Tseng (Telecom Paris, IP Paris), Mark McGill (University of Glasgow, Glasgow), Eric Lecolinet (Telecom Paris, IP Paris), Samuel Huron (Telecom Paris, IP Paris), Jan Gugenheimer (TU Darmstadt)
Abstract | Tags: Full Paper, Honorable Mention | Links:
@inproceedings{Bonnail2023Memory,
title = {Memory Manipulations in Extended Reality },
author = {Elise Bonnail (Telecom Paris, IP Paris), Wen-Jie Tseng (Telecom Paris, IP Paris), Mark McGill (University of Glasgow, Glasgow), Eric Lecolinet (Telecom Paris, IP Paris), Samuel Huron (Telecom Paris, IP Paris), Jan Gugenheimer (TU Darmstadt)},
url = {https://youtu.be/asSejQTZILI, Teaser Video},
doi = {10.1145/3544548.3580988},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Human memory has notable limitations (e.g., forgetting) which have necessitated a variety of memory aids (e.g., calendars). As we grow closer to mass adoption of everyday Extended Reality (XR), which is frequently leveraging perceptual limitations (e.g., redirected walking), it becomes pertinent to consider how XR could leverage memory limitations (forgetting, distorting, persistence) to induce memory manipulations. As memories highly impact our self-perception, social interactions, and behaviors, there is a pressing need to understand XR Memory Manipulations (XRMMs). We ran three speculative design workshops (n=12), with XR and memory researchers creating 48 XRMM scenarios. Through thematic analysis, we define XRMMs, present a framework of their core components and reveal three classes (at encoding, pre-retrieval, at retrieval). Each class differs in terms of technology (AR/VR) and impact on memory (influencing quality of memories, inducing forgetting, distorting memories). We raise ethical concerns and discuss opportunities of perceptual and memory manipulations in XR.},
keywords = {Full Paper, Honorable Mention},
pubstate = {published},
tppubtype = {inproceedings}
}
Human memory has notable limitations (e.g., forgetting) which have necessitated a variety of memory aids (e.g., calendars). As we grow closer to mass adoption of everyday Extended Reality (XR), which is frequently leveraging perceptual limitations (e.g., redirected walking), it becomes pertinent to consider how XR could leverage memory limitations (forgetting, distorting, persistence) to induce memory manipulations. As memories highly impact our self-perception, social interactions, and behaviors, there is a pressing need to understand XR Memory Manipulations (XRMMs). We ran three speculative design workshops (n=12), with XR and memory researchers creating 48 XRMM scenarios. Through thematic analysis, we define XRMMs, present a framework of their core components and reveal three classes (at encoding, pre-retrieval, at retrieval). Each class differs in terms of technology (AR/VR) and impact on memory (influencing quality of memories, inducing forgetting, distorting memories). We raise ethical concerns and discuss opportunities of perceptual and memory manipulations in XR.
Never Skip Leg Day Again: Training the Lower Body with Vertical Jumps in a Virtual Reality Exergame
Sebastian Cmentowski (High-Performance Computing, University of Duisburg-Essen, Germany), Sukran Karaosmanoglu (Human-Computer Interaction, Universität Hamburg, Germany), Lennart E. Nacke (HCI Games Group, University of Waterloo, Canada), Frank Steinicke (Human-Computer Interaction, Universität Hamburg, Germany), Jens Krüger (High-Performance Computing, University of Duisburg-Essen, Germany)
Abstract | Tags: Full Paper, Honorable Mention | Links:
@inproceedings{Cmentowski2023Leg,
title = {Never Skip Leg Day Again: Training the Lower Body with Vertical Jumps in a Virtual Reality Exergame},
author = {Sebastian Cmentowski (High-Performance Computing, University of Duisburg-Essen, Germany), Sukran Karaosmanoglu (Human-Computer Interaction, Universität Hamburg, Germany), Lennart E. Nacke (HCI Games Group, University of Waterloo, Canada), Frank Steinicke (Human-Computer Interaction, Universität Hamburg, Germany), Jens Krüger (High-Performance Computing, University of Duisburg-Essen, Germany)},
url = {https://uni-duisburg-essen.sciebo.de/s/E6E04mwb5Ywi3xy/download, Teaser Video
https://www.twitter.com/uhhhci, Twitter
https://www.inf.uni-hamburg.de/en/inst/ab/hci.html, Lab Website
https://www.jens-krueger.com, Personal Website
},
doi = {10.1145/3544548.3580973},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Virtual Reality (VR) exergames can increase engagement in and motivation for physical activities. Most VR exergames focus on the upper body because many VR setups only track the users' heads and hands. To become a serious alternative to existing exercise programs, VR exergames must provide a balanced workout and train the lower limbs, too. To address this issue, we built a VR exergame focused on vertical jump training to explore full-body exercise applications. To create a safe and effective training, nine domain experts participated in our prototype design. Our mixed-methods study confirms that the jump-centered exercises provided a worthy challenge and positive player experience, indicating long-term retention. Based on our findings, we present five design implications to guide future work: avoid an unintended forward drift, consider technical constraints, address safety concerns in full-body VR exergames, incorporate rhythmic elements with fluent movement patterns, adapt difficulty to players' fitness progression status.},
keywords = {Full Paper, Honorable Mention},
pubstate = {published},
tppubtype = {inproceedings}
}
Virtual Reality (VR) exergames can increase engagement in and motivation for physical activities. Most VR exergames focus on the upper body because many VR setups only track the users' heads and hands. To become a serious alternative to existing exercise programs, VR exergames must provide a balanced workout and train the lower limbs, too. To address this issue, we built a VR exergame focused on vertical jump training to explore full-body exercise applications. To create a safe and effective training, nine domain experts participated in our prototype design. Our mixed-methods study confirms that the jump-centered exercises provided a worthy challenge and positive player experience, indicating long-term retention. Based on our findings, we present five design implications to guide future work: avoid an unintended forward drift, consider technical constraints, address safety concerns in full-body VR exergames, incorporate rhythmic elements with fluent movement patterns, adapt difficulty to players' fitness progression status.
