Heartefacts: Augmenting Mobile Video Sharing Using Wrist-Worn Heart Rate Sensors

Authors
Jo Vermeulen, Lindsay MacDonald, Johannes Schöning, Russell Beale, and Sheelagh Carpendale.

In Proceedings of DIS 2016: the Biennial ACM SIGCHI Conference on Designing Interactive Systems, Brisbane, Australia, June 4–8, 2016, 12 pages.
[25.6% acceptance; 418 submissions]

Abstract

An increasing share of our daily interactions with others is mediated through mobile communication technologies. People communicate via text, emoticons, emojis and rich media such as video. We explore the design of Heartefacts, short video clips composed of highlights determined by heart rate changes while watching videos. Our survey investigated video sharing behaviour, and our feasibility study examined the possibility of detecting highlights in videos by monitoring people’s heart rates measured with off-the-shelf wrist-worn sensors. Our results show that people do indeed have measurable responses with respect to their heartbeat patterns to six different emotions elicited by video clips. We compare video highlights verbally identified by our participants to physiological highlights as indicated by their heart rate data and also discuss and compare the automatically generated Heartefacts with video highlights created by an expert in video art. Finally, we discuss design considerations when integrating Heartefacts in mobile technology.

Downloads

Paper