Responsible HRI

Resources for Ethical, Transparent, and Accessible HRI Research

Micol Spitale1,2,*, Rebecca Stower3,*, Elmira Yadollahi3,*, Maria Teresa Parreira4,*, Nida Itrat Abbasi2, Iolanda Leite3, Hatice Gunes2
1 Politecnico di Milano, 2 University of Cambridge, 3 KTH Royal Institute of Technology, 4 Cornell University
2023
*Indicates Equal Contribution
Checklist Paper Code
Banner image

Resources for Reproducibility

LIST RESOURCES HERE!!!!

A systematic review on reproducibility in child-robot interaction

Research reproducibility – i.e., rerunning analyses on original data to replicate the results – is paramount for guaranteeing scientific validity. However, reproducibility is often very challenging, especially in research fields where multi-disciplinary teams are involved, such as child-robot interaction (CRI). This paper presents a systematic review of the last three years (2020-2022) of research in CRI under the lens of reproducibility, by analysing the field for transparency in reporting. Across a total of 325 studies, we found deficiencies in reporting demographics (e.g. age of participants), study design and implementation (e.g. length of interactions), and open data (e.g. maintaining an active code repository). From this analysis, we distil a set of guidelines and provide a checklist to systematically report CRI studies to help and guide research to improve reproducibility in CRI and beyond.

HRI Wasn’t Built In a Day: A Call To Action For Responsible HRI Research

In recent years, the awareness of the academy around responsible research has notably increased. For instance, with advances in machine learning and artificial intelligence, recent efforts have been made to promote ethical, fair, and inclusive AI and robotics. However, the field of human-robot-interaction (HRI) is seemingly lagging behind these practices.To better understand if and to what extent HRI is incentivizing researchers to engage in responsible research, we conducted an exploratory review of the publishing guidelines for the most popular HRI conference venues. We identified 18 conferences which published at least 7 HRI papers in 2022. From these, we discuss four themes relevant to conducting responsible HRI research in line with the Responsible Research and Innovation framework: ethical and human participant considerations, transparency and reproducibility, accessibility and inclusion, and plagiarism and LLM use. We identify several gaps and room for improvement within HRI regarding responsible research. Finally, we establish a call to action to provoke novel conversations among HRI researchers about the importance of conducting responsible research within emerging fields like HRI.

List of conferences selected from the review of the 2022 venues, the corresponding HRI paper counts, and the responsible categories they fulfill according to their most current website (2023/2024). Legend: E&HP - Ethical and Human Participants Considerations; A&I - Accessibility and Inclusion Guidelines; T&R: Transparency and Reproducibility Requirements; PL: Plagiarism, and LLMs.
Source title Count papers Acronym E&HP A&I T&R PL
ACM/IEEE International Conference on Human-Robot Interaction 174 HRI ✓ ✓
RO-MAN 2022 - 31st IEEE International Conference on Robot and Human Interactive Communication 113 ROMAN
IEEE International Conference on Intelligent Robots and Systems 41 IROS
Proceedings - IEEE International Conference on Robotics and Automation 38 ICRA
Conference on Human Factors in Computing Systems - Proceedings 25 CHI ✓ ✓
HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction 20 HAI ✓
IEEE-RAS International Conference on Humanoid Robots 16 Humanoid
2022 IEEE International Conference on Robotics and Biomimetics, ROBIO 2022 12 ROBIO ✓
2022 IEEE International Conference on Development and Learning, ICDL 2022 12 ICDL ✓
Proceedings of the IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics 12 BIOROB
Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics 11 SMC
2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, ACIIW 2022 10 ACII ✓
Proceedings of the 2022 IEEE International Conference on Human-Machine Systems, ICHMS 2022 9 ICHMS
UMAP2022 - Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization 8 UMAP ✓ ✓
Proceedings of Interaction Design and Children, IDC 2022 8 IDC ✓
ICARM 2022 - 2022 7th IEEE International Conference on Advanced Robotics and Mechatronics 8 ICARM ✓
Proceedings of the Annual Hawaii International Conference on System Sciences 7 HICSS
IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 7 AIM

BibTeX

@misc{spitale2023systematic,
      title={A Systematic Review on Reproducibility in Child-Robot Interaction}, 
      author={Micol Spitale and Rebecca Stower and Elmira Yadollahi and Maria Teresa Parreira and Nida Itrat Abbasi and Iolanda Leite and Hatice Gunes},
      year={2023},
      eprint={2309.01822},
      archivePrefix={arXiv},
      primaryClass={cs.HC}
}