{"id":873,"date":"2020-08-25T08:47:40","date_gmt":"2020-08-25T08:47:40","guid":{"rendered":"https:\/\/iswc.hosting2.acm.org\/iswc20\/?page_id=873"},"modified":"2020-09-29T18:08:15","modified_gmt":"2020-09-29T18:08:15","slug":"papers-by-session","status":"publish","type":"page","link":"https:\/\/iswc.hosting2.acm.org\/iswc20\/program\/papers-by-session\/","title":{"rendered":"Papers by Session"},"content":{"rendered":"<p><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#e2e2e2;border-style:solid;\" id=\"content-start\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-1 fusion-sep-none fusion-title-text fusion-title-size-one\" style=\"margin-top:10px;margin-bottom:15px;\"><h1 class=\"title-heading-left\" style=\"margin:0;\"><span style=\"color: #c83273; font-size: 28px !important;\">IMWUT \/ ISWC<\/span><br \/>\n<span style=\"color: #37408b;\">PAPERS<\/span> <span style=\"color: #c83273;\">BY SESSION<\/span><\/h1><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-2 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: rgba(255,255,255,0);background-position: center center;background-repeat: no-repeat;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;margin-bottom: 0px;margin-top: 25px;border-width: 0px 0px 0px 0px;border-color:#e2e2e2;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-1 fusion_builder_column_4_5 4_5 fusion-four-fifth fusion-column-first\" style=\"width:80%;width:calc(80% - ( ( 4% ) * 0.8 ) );margin-right: 4%;margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-1\"><p>During the UbiComp \/ ISWC 2020 virtual conference the following 15 sessions will be held from Monday to Wednesday, September 12 \u2013 16, 2020 and present 140 accepted <a href=\"https:\/\/iswc.hosting2.acm.org\/iswc20\/program\/imwut\/\">IMWUT papers<\/a> from the last four issues as well as 21 accepted <a href=\"https:\/\/iswc.hosting2.acm.org\/iswc20\/program\/iswc\/\">ISWC Notes and Briefs<\/a>.<\/p>\n<\/div><div class=\"fusion-text fusion-text-2\"><div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-1 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-1 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VcBdk3KGw1p5OYbAOggeN05\"><span class=\"fusion-button-text\">View All ISWC 2020 Presentations<\/span><\/a><\/div>\n<h3>Session Overview<\/h3>\n<\/div><div class=\"fusion-text fusion-text-3\"><h5 style=\"margin-bottom: 0px;\">Monday, September 14, 2020 18:00-19:30 EDT<\/h5>\n<\/div><ul class=\"fusion-checklist fusion-checklist-1\" style=\"font-size:16px;line-height:27.2px;\"><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session1a\"><b>Session 1A:<\/b> \u2018Security, Privacy, and Acceptance\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session1b\"><b>Session 1B:<\/b> \u2018Displays, Tactile, and New Interaction\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session1c\"><b>Session 1C:<\/b> \u2018Sensing I (Behaviour and Emotions)\u2019<\/a><\/div><\/li><\/ul><div class=\"fusion-text fusion-text-4\"><h5 style=\"margin-bottom: 0px;\">Tuesday, September 15, 2020 10:00-11:30 EDT<\/h5>\n<\/div><ul class=\"fusion-checklist fusion-checklist-2\" style=\"font-size:16px;line-height:27.2px;\"><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session2a\"><b>Session 2A:<\/b> \u2018Low-Power and Energy Harvesting\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session2b\"><b>Session 2B:<\/b> \u2018Health and Wellbeing I\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session2c\"><b>Session 2C:<\/b> \u2018Sensing II (Context and Environment)\u2019<\/a><\/div><\/li><\/ul><div class=\"fusion-text fusion-text-5\"><h5 style=\"margin-bottom: 0px;\">Tuesday, September 15, 2020 17:00-18:30 EDT<\/h5>\n<\/div><ul class=\"fusion-checklist fusion-checklist-3\" style=\"font-size:16px;line-height:27.2px;\"><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session3a\"><b>Session 3A:<\/b> \u2018Location and Human Mobility\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session3b\"><b>Session 3B:<\/b> \u2018Touch, Gestures, and Posture\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session3c\"><b>Session 3C:<\/b> \u2018Sensing III (RF and other sensing modes)\u2019<\/a><\/div><\/li><\/ul><div class=\"fusion-text fusion-text-6\"><h5 style=\"margin-bottom: 0px;\">Wednesday, September 16, 2020 09:00-10:30 EDT<\/h5>\n<\/div><ul class=\"fusion-checklist fusion-checklist-4\" style=\"font-size:16px;line-height:27.2px;\"><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session4a\"><b>Session 4A:<\/b> \u2018IoT and Software Tools\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session4b\"><b>Session 4B:<\/b> \u2018Health and Wellbeing II\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session4c\"><b>Session 4C:<\/b> \u2018Human Activity Recognition I\u2019<\/a><\/div><\/li><\/ul><div class=\"fusion-text fusion-text-7\"><h5 style=\"margin-bottom: 0px;\">Wednesday, September 16, 2020 18:00-19:30 EDT<\/h5>\n<\/div><ul class=\"fusion-checklist fusion-checklist-5\" style=\"font-size:16px;line-height:27.2px;\"><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session5a\"><b>Session 5A:<\/b> \u2018Driving and Transportation\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session5b\"><b>Session 5B:<\/b> \u2018Speech interaction + Fabrication\u2019<\/a><\/div><\/li><li class=\"fusion-li-item\"><span style=\"background-color:rgba(101,188,123,0);font-size:14.08px;height:27.2px;width:27.2px;margin-right:11.2px;\" class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-angle-right fas\" style=\"color:#c83273;\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\" style=\"margin-left:38.4px;\"><a href=\"#session5c\"><b>Session 5C:<\/b> \u2018Human Activity Recognition II\u2019<\/a><\/div><\/li><\/ul><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-8\"><h3>Session and Paper Details<\/h3>\n<\/div><div class=\"fusion-text fusion-text-9\"><p><!-- AUTOMATICALLY GENERATED --><\/p>\n<\/div><div class=\"fusion-text fusion-text-10\"><h4 id=\"session1a\" style=\"margin-bottom: 0px;\"><b>Session 1A:<\/b> \u2018Security, Privacy, and Acceptance\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Monday, September 14, 2020 18:00-19:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-2 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-2 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VeUV5yu_5I-uQwatk1-iHit\"><span class=\"fusion-button-text\">View Session 1A Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-1 .fusion-panel:hover, #accordion-873-1 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-1 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-1 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-1 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-1 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-1 .panel-title a:hover, #accordion-873-1 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-1 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-1 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-1\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"423ad69addb569cc8\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#423ad69addb569cc8\" href=\"#423ad69addb569cc8\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMy Mom was Getting this Popup: Understanding Motivations and Processes in Helping Older Relatives with Mobile Security and Privacy\u201d<\/strong>, Tamir Mendel, Eran Toch. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 147.<\/span><\/a><\/h4><\/div><div id=\"423ad69addb569cc8\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Security and privacy pose a serious barrier to the use of mobile technology by older adults. While support from family and friends is known to be an effective enabler in older adults\u2019 technology adoption, we know very little about the family members\u2019 motivations for providing help, the context, and the process in which they provide it. To bridge this gap, we have conducted a mixed method study, qualitatively analyzing the helpers\u2019 assistance stories and quantitatively estimating the factors that affect helpers\u2019 willingness to offer assistance to older relatives regarding mobile security and privacy problems. Our findings point to the potential for helping older relatives, i.e., people are more willing to help and guide them than other social groups. Furthermore, we show that familiarity with an older relative\u2019s preferences is essential in providing meaningful support. We discuss our findings in the context of developing a theory of collective efficacy for security and privacy and new collaborative technologies that can reduce the barriers to social help.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369821\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369821<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"438e2a612460cdaef\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#438e2a612460cdaef\" href=\"#438e2a612460cdaef\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cAuto-Key: Using Autoencoder to Speed Up Gait-based Key Generation in Body Area Networks\u201d<\/strong>, Yuezhong Wu, Qi Lin, Hong Jia, Mahbub Hassan, Wen Hu. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 32.<\/span><\/a><\/h4><\/div><div id=\"438e2a612460cdaef\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With the rising popularity of wearable devices and sensors, shielding Body Area Networks (BANs) from eavesdroppers has become an urgent problem to solve. Since the conventional key distribution systems are too onerous for resource-constrained wearable sensors, researchers are pursuing a new light-weight key generation approach that enables two wearable devices attached at different locations of the user body to generate an identical key simultaneously simply from their independent observations of user gait. A key challenge for such gait-based key generation lies in matching the bits of the keys generated by independent devices despite the noisy sensor measurements, especially when the devices are located far apart on the body affected by different sources of noise. To address the challenge, we propose a novel machine learning framework, called Auto-Key, that uses an autoencoder to help one device predict the gait observations at another distant device attached to the same body and generate the key using the predicted sensor data. We prototype the proposed method and evaluate it using a public acceleration dataset collected from 15 real subjects wearing accelerometers attached to seven different locations of the body. Our results show that, on average, Auto-Key increases the matching rate of independently generated bits from two sensors attached at two different locations by 16.5%, which speeds up the successful generation of fully-matching symmetric keys at independent wearable sensors by a factor of 1.9. In the proposed framework, a subject-specific model can be trained with 50% fewer data and 88% less time by retraining a pre-trained general model when compared to training a new model from scratch. The reduced training complexity makes Auto-Key more practical for edge computing, which provides better privacy protection to biometric and behavioral data compared to cloud-based training.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381004\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381004<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"940f37433d6f98ede\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#940f37433d6f98ede\" href=\"#940f37433d6f98ede\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cWill Online Digital Footprints Reveal Your Relationship Status? An Empirical Study of Social Applications for Sexual-Minority Men\u201d<\/strong>, Jiangtao Wang, Junyi Ma, Yasha Wang, Ning Wang, Leye Wang, Daqing Zhang, Feng Wang, Qin Lv. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 29.<\/span><\/a><\/h4><\/div><div id=\"940f37433d6f98ede\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With the increasing social acceptance and openness, more and more sexual-minority men (SMM) have succeeded in creating and sustaining steady relationships in recent years. Maintaining steady relationships is beneficial to the wellbeing of SMM both mentally and physically. However, the relationship maintaining for them is also challenging due to the much less supports compared to the heterosexual couples, so that it is important to identify those SMM in steady relationship and provide corresponding personalized assistance. Furthermore, knowing SMM\u2019s relationship and the correlations with other visible features is also beneficial for optimizing the social applications\u2019 functionalities in terms of privacy preserving and friends recommendation. With the prevalence of SMM-oriented social apps (called SMMSA for short), this paper investigates the relationship status of SMM from a new perspective, that is, by introducing the SMM\u2019s online digital footprints left on SMMSA (e.g., presented profile, social interactions, expressions, sentiment, and mobility trajectories). Specifically, using a filtered dataset containing 2,359 active SMMSA users with their self-reported relationship status and publicly available app usage data, we explore the correlations between SMM\u2019s relationship status and their online digital footprints on SMMSA and present a set of interesting findings. Moreover, we demonstrate that by utilizing such correlations, it has the potential to construct machine-learning-based models for relationship status inference. Finally, we elaborate on the implications of our findings from the perspective of better understanding the SMM community and improving their social welfare.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380978\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380978<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"e0e5421bfcb013235\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#e0e5421bfcb013235\" href=\"#e0e5421bfcb013235\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cPrivateBus: Privacy Identification and Protection in Large-Scale Bus WiFi Systems\u201d<\/strong>, Zhihan Fang, Boyang Fu, Zhou Qin, Fan Zhag, Desheng Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 9.<\/span><\/a><\/h4><\/div><div id=\"e0e5421bfcb013235\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recently, the ubiquity of mobile devices leads to an increasing demand of public network services, e.g., WiFi hot spots.<br \/>\nAs a part of this trend, modern transportation systems are equipped with public WiFi devices to provide Internet access for passengers as people spend a large amount of time on public transportation in their daily life.<br \/>\nHowever, one of the key issues in public WiFi spots is the privacy concern due to its open access nature.<br \/>\nExisting works either studied location privacy risk in human traces or privacy leakage in private networks such as cellular networks based on the data from cellular carriers.<br \/>\nTo the best of our knowledge, none of these work has been focused on bus WiFi privacy based on large-scale real-world data.<br \/>\nIn this paper, to explore the privacy risk in bus WiFi systems, we focus on two key questions how likely bus WiFi users can be uniquely re-identified if partial usage information is leaked and how we can protect users from the leaked information.<br \/>\nTo understand the above questions, we conduct a case study in a large-scale bus WiFi system, which contains 20 million connection records and 78 million location records from 770 thousand bus WiFi users during a two-month period.<br \/>\nTechnically, we design two models for our uniqueness analyses and protection, i.e., a PB-FIND model to identify the probability a user can be uniquely re-identified from leaked information;<br \/>\na PB-HIDE model to protect users from potentially leaked information.<br \/>\nSpecifically, we systematically measure the user uniqueness on users&#8217; finger traces (i.e., connection URL and domain), foot traces (i.e., locations), and hybrid traces (i.e., both finger and foot traces).<br \/>\nOur measurement results reveal<br \/>\n(i) 97.8% users can be uniquely re-identified by 4 random domain records of their finger traces and 96.2% users can be uniquely re-identified by 5 random locations on buses;<br \/>\n(ii) 98.1% users can be uniquely re-identified by only 2 random records if both their connection records and locations are leaked to attackers.<br \/>\nMoreover, the evaluation results show<br \/>\nour PB-HIDE algorithm protects more than 95% users from the potentially leaked information by inserting only 1.5% synthetic records in the original dataset to preserve their data utility.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380990\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380990<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"50e91ccddd97ead38\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#50e91ccddd97ead38\" href=\"#50e91ccddd97ead38\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cAppMoD: Helping Older Adults Manage Mobile Security with Online Social Help\u201d<\/strong>, Zhiyuan Wan, Lingfeng Bao, Debin Gao, Eran Toch, Xin Xia, Tamir Mendel, David Lo. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 154.<\/span><\/a><\/h4><\/div><div id=\"50e91ccddd97ead38\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The rapid adoption of Smartphone devices has caused increasing security and privacy risks and breaches. Catching up with ever-evolving contemporary smartphone technology challenges leads older adults (aged 50+) to reduce or to abandon their use of mobile technology. To tackle this problem, we present AppMoD, a community-based approach that allows delegation of security and privacy decisions a trusted social connection, such as a family member or a close friend. The trusted social connection can assist in the appropriate decision or make it on behalf of the user. We implement the approach as an Android app and describe the results of three user studies (n=50 altogether), in which pairs of older adults and family members used the app in a controlled experiment. Using app anomalies as an ongoing case study, we show how delegation improves the accuracy of decisions made by older adults. Also, we show how combining decision-delegation with crowdsourcing can enhance the advice given and improve the decision-making process. Our results suggest that a community-based approach can improve the state of mobile security and privacy.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369819\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369819<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"48f50fe86bdafa42f\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#48f50fe86bdafa42f\" href=\"#48f50fe86bdafa42f\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cPrivacy Adversarial Network: Representation Learning for Mobile Data Privacy\u201d<\/strong>, Sicong Liu, Junzhao Du, Anshumali Shrivastava, Lin Zhong. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 144.<\/span><\/a><\/h4><\/div><div id=\"48f50fe86bdafa42f\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The remarkable success of machine learning has fostered a growing number of cloud-based intelligent services for mobile users. Such a service requires a user to send data, e.g. image, voice, and video, to the provider, which presents a serious challenge to user privacy. To address this, prior works either obfuscate the data, e.g., add noise and remove identity information, or send representations extracted from the data, e.g., anonymized features. They struggle to balance between the service utility and data privacy because obfuscated data reduces utility and extracted representation may still reveal sensitive information.<\/p>\n<p>This work departs from prior works in methodology: we leverage adversarial learning to a better balance between privacy and utility. We design a representation encoder that generates the feature representations to optimize against the privacy disclosure risk of sensitive information (a measure of privacy) by the privacy adversaries and concurrently optimize with the task inference accuracy (a measure of utility) by the utility discriminator. The result is the privacy adversarial network (PAN), a novel deep model with the new training algorithm, that can automatically learn representations from the raw data. And the trained encoder can be deployed on the user side to generate representations that satisfy the task-defined utility requirements and the user-specified\/agnostic privacy budgets.<\/p>\n<p>Intuitively, PAN adversarially forces the extracted representations to only convey the information required by the target task. Surprisingly, this constitutes an implicit regularization that actually improves task accuracy. As a result, PAN achieves better utility and better privacy at the same time! We report extensive experiments on six popular datasets and demonstrate the superiority of PAN compared with alternative methods reported in prior work.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369816\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369816<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"4e64153e893cf84d0\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#4e64153e893cf84d0\" href=\"#4e64153e893cf84d0\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cSenCAPTCHA: A Mobile-First CAPTCHA Using Orientation Sensors\u201d<\/strong>, Yunhe Feng, Qing Cao, Hairong Qi, Scott Ruoti. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 43.<\/span><\/a><\/h4><\/div><div id=\"4e64153e893cf84d0\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">CAPTCHAs are used to distinguish between human- and computer-generated (i.e., bot) online traffic. As there is an ever-increasing amount of online traffic from mobile devices, it is necessary to design CAPTCHAs that work well on mobile devices. In this paper, we present SenCAPTCHA, a mobile-first CAPTCHA that leverages the device&#8217;s orientation sensors. SenCAPTCHA works by showing users an image of an animal and asking them to tilt their device to guide a red ball into the center of that animal&#8217;s eye. SenCAPTCHA is especially useful for devices with small screen sizes (e.g., smartphones, smartwatches). In this paper, we describe the design of SenCAPTCHA and demonstrate that it is resilient to various machine learning based attacks. We also report on two usability studies of SenCAPTCHA involving a total of 472 participants; our results show that SenCAPTCHA is viewed as an &#8220;enjoyable&#8221; CAPTCHA and that it is preferred by over half of the participants to other existing CAPTCHA systems.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397312\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397312<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a3dda112c37dc9cce\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#a3dda112c37dc9cce\" href=\"#a3dda112c37dc9cce\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cVocalLock: Sensing Vocal Tract for Passphrase-Independent User Authentication Leveraging Acoustic Signals on Smartphones\u201d<\/strong>, Li Lu, Jiadi Yu, Yingying Chen, Yan Wang. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 51.<\/span><\/a><\/h4><\/div><div id=\"a3dda112c37dc9cce\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recent years have witnessed the surge of biometric-based user authentication for mobile devices due to its promising security and convenience. As a natural and widely-existed behavior, human speaking has been exploited for user authentication. Existing voice-based user authentication explores the unique characteristics from either the voiceprint or mouth movements, which is vulnerable to replay attacks and mimic attacks. During speaking, the vocal tract, including the static shape and dynamic movements, also exhibits the individual uniqueness, and they are hardly eavesdropped and imitated by adversaries. Hence, our work aims to employ the individual uniqueness of vocal tract to realize user authentication on mobile devices. Moreover, most voice-based user authentications are passphrase-dependent, which significantly degrade the user experience. Thus, such user authentications are pressed to be implemented in a passphrase-independent manner while being able to resist various attacks. In this paper, we propose a user authentication system, VocalLock, which senses the whole vocal tract during speaking to identify different individuals in a passphrase-independent manner on smartphones leveraging acoustic signals. VocalLock first utilizes FMCW on acoustic signals to characterize both the static shape and dynamic movements of the vocal tract during speaking, and then constructs a passphrase-independent user authentication model based on the unique characteristics of vocal tract through GMM-UBM. The proposed VocalLock can resist various spoofing attacks, while achieving a satisfactory user experience. Extensive experiments in real environments demonstrate VocalLock can accurately authenticate user identity in a passphrase-independent manner and successfully resist various attacks.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397320\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397320<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"829e9d3991d9169fa\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#829e9d3991d9169fa\" href=\"#829e9d3991d9169fa\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201c(M)ad to See Me? Intelligent Advertisement Placement: Balancing User Annoyance and Advertising Effectiveness\u201d<\/strong>, Ngoc Thi Nguyen, Agustin Zuniga, Hyowon Lee, Pan Hui, Huber Flores, Petteri Nurmi. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 53.<\/span><\/a><\/h4><\/div><div id=\"829e9d3991d9169fa\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Advertising is an unavoidable albeit a frustrating part of mobile interactions. Due to limited form factor, mobile advertisements often resort to intrusive strategies where they temporarily block the user&#8217;s view in an attempt to increase effectiveness by forcing the user&#8217;s attention. While such strategies contribute to advertising awareness and effectiveness, they do so at the cost of degrading the user&#8217;s overall experience and can lead to frustration and annoyance. In this paper, we contribute by developing Perceptive Ads as an intelligent advertisement placement strategy that minimizes disruptions caused by ads while preserving their effectiveness. Our work is the first to simultaneously consider the needs of users, app developers, and advertisers. Ensuring the needs of all stakeholders are taken into account is essential for the adoption of advertising strategies as users (and indirectly developers) would reject strategies that are disruptive but effective, while advertisers would reject strategies that are non-disruptive but inefficient. We demonstrate the effectiveness of our technique through a user study with N = 16 participants and two representative examples of mobile apps that commonly integrate advertisements: a game and a news app. Results from the study demonstrate that our approach improves perception towards advertisements by 43.75% without affecting application interactivity while at the same time increasing advertisement effectiveness by 37.5% compared to a state-of-the-art baseline.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397324\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397324<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a8e1b67521862e6f9\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-1\" data-target=\"#a8e1b67521862e6f9\" href=\"#a8e1b67521862e6f9\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cCountering Acoustic Adversarial Attacks in Microphone-equipped Smart Home Devices\u201d<\/strong>, Sourav Bhattacharya, Dionysis Manousakas, Alberto Gil C. P. Ramos, Stylianos I. Venieris, Nicholas D. Lane, Cecilia Mascolo. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 73.<\/span><\/a><\/h4><\/div><div id=\"a8e1b67521862e6f9\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Deep neural networks (DNNs) continue to demonstrate superior generalization performance in an increasing range of applications, including speech recognition and image understanding. Recent innovations in compression algorithms, design of efficient architectures and hardware accelerators have prompted a rapid growth in deploying DNNs on mobile and IoT devices to redefine user experiences. Relying on the superior inference quality of DNNs, various voice-enabled devices have started to pervade our everyday lives and are increasingly used for, e.g., opening and closing doors, starting or stopping washing machines, ordering products online, and authenticating monetary transactions. As the popularity of these voice-enabled services increases, so does their risk of being attacked. Recently, DNNs have been shown to be extremely brittle under adversarial attacks and people with malicious intentions can potentially exploit this vulnerability to compromise DNN-based voice-enabled systems. Although some existing work already highlights the vulnerability of audio models, very little is known of the behaviour of compressed on-device audio models under adversarial attacks. This paper bridges this gap by investigating thoroughly the vulnerabilities of compressed audio DNNs and makes a stride towards making compressed models robust. In particular, we propose a stochastic compression technique that generates compressed models with greater robustness to adversarial attacks. We present an extensive set of evaluations on adversarial vulnerability and robustness of DNNs in two diverse audio recognition tasks, while considering two popular attack algorithms: FGSM and PGD. We found that error rates of conventionally trained audio DNNs under attack can be as high as 100%. Under both white- and black-box attacks, our proposed approach is found to decrease the error rate of DNNs under attack by a large margin.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397332\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397332<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-11\"><h4 id=\"session1b\" style=\"margin-bottom: 0px;\"><b>Session 1B:<\/b> \u2018Displays, Tactile, and New Interaction\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Monday, September 14, 2020 18:00-19:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-3 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-3 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VdqqllZlwV34_NTDuEXhFq7\"><span class=\"fusion-button-text\">View Session 1B Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-2 .fusion-panel:hover, #accordion-873-2 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-2 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-2 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-2 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-2 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-2 .panel-title a:hover, #accordion-873-2 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-2 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-2 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-2\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"544963d5a61d854ad\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#544963d5a61d854ad\" href=\"#544963d5a61d854ad\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMaking It Personal: Addressing Individual Audience Members in Oral Presentations Using Augmented Reality\u201d<\/strong>, Dhaval Parmar, Timothy Bickmore. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 55.<\/span><\/a><\/h4><\/div><div id=\"544963d5a61d854ad\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Public-speaking situations such as classroom lectures, seminars, and meetings, where speakers must actively engage the audience, require considerable effort from the speaker in gathering verbal and non-verbal feedback from the audience. Garnering feedback can be made easier by technologies such as augmented reality (AR) capable of displaying information in 3D space surrounding the speaker. We present an AR-enabled presentation display system to provide real-time feedback from the audience to the speaker during a presentation. The feedback includes names and affective states of the audience, icons requesting a change in volume and rate of speech, and annotated questions and comments. The design of the feedback system was informed by findings from an exploratory study with academic professionals experienced in delivering presentations. In a between-subjects study, we evaluated presentations displaying feedback information spatially overlaid above the heads of the audience members in one condition and in the periphery of the presenter&#8217;s view in another condition, as compared with a no-AR control condition. Results showed that the presenters in the overlay condition called upon the audience by name significantly more often than in the peripheral and the control conditions, and they rated the overlay condition as more reliable, helpful, and wanting to use it for future presentations compared to the peripheral condition. Overall, AR feedback was considered useful by both the presenters and the audience and did not negatively impact speaker confidence and state anxiety of the presenter.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397336\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397336<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"69fb28d554131a3a7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#69fb28d554131a3a7\" href=\"#69fb28d554131a3a7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cVirtual Paving: Rendering a Smooth Path for People with Visual Impairment through Vibrotactile and Audio Feedback\u201d<\/strong>, Shuchang Xu, Ciyuan Yang, Wenhao Ge, Chun Yu, Yuanchun Shi. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 99.<\/span><\/a><\/h4><\/div><div id=\"69fb28d554131a3a7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Tactile pavings are public works for visually impaired people, designed to indicate a particular path to follow by providing haptic cues underfoot. However, they face many limitations such as installation errors, obstructions, degradation, and limited coverage. To address these issues, we propose Virtual Paving, which aims to assist independent navigation by rendering a smooth path to visually impaired people through multi-modal feedback. This work assumes that a path has been planned to avoid obstacles and focuses on the feedback design to guide users along the path safely, smoothly, and efficiently. Firstly, we extracted the design guidelines of Virtual Paving based on an investigation into visually impaired people&#8217;s current practices and issues with tactile pavings. Next, we developed a multi-modal solution through co-design and evaluation with visually impaired users. This solution included (1) vibrotactile feedback on the shoulders and waist to give readily-perceivable directional cues and (2) audio feedback to describe road conditions ahead of the user. Finally, we evaluated the proposed solution through user tests. Guided by the designed feedback, 16 visually impaired participants successfully completed 127 out of 128 trials with 2.1m-wide basic paths, including straight and curved paths. Subjective feedback indicated that our solution to render Virtual Paving was easy for users to learn, and it also enabled them to walk smoothly. The feasibility and potential limitations for Virtual Paving to support independent navigation in real environments are discussed.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411814\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411814<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"be557a1cb88382f84\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#be557a1cb88382f84\" href=\"#be557a1cb88382f84\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDyadic Mirror: Everyday Second-person Live-view for Empathetic Reflection upon Parent-child Interaction\u201d<\/strong>, Wonjung Kim, Seungchul Lee, Seonghoon Kim, Sungbin Jo, Chungkuk Yoo, Inseok Hwang, Seungwoo Kang, Junehwa Song. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 86.<\/span><\/a><\/h4><\/div><div id=\"be557a1cb88382f84\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">A parent&#8217;s capacity to understand the mental states of both him\/herself and the child is considered to play a significant role in various aspects of parent-child relationship&#8211;e.g., lowering parental stress and supporting cognitive development of the child. We propose Dyadic Mirror, a wearable smart mirror which is designed to foster the aforementioned parental capacity in everyday parent-child interaction. Its key feature is to provide a parent with a second-person live-view from the child, i.e., the parent&#8217;s own face as seen by the child, during their face-to-face interaction. Dyadic Mirror serves as a straightforward cue that helps the parent be aware of (1) his\/her emotional state, and (2) the way he\/she would be now being seen by the child, thereby facilitate the parent to infer the child\u2019s mental state. To evaluate Dyadic Mirror under unconstrained parent-child interactions in real-life, we implemented the working prototype of Dyadic Mirror and deployed it to 6 families over 4 weeks. The participating parents reported extensive experiences with Dyadic Mirror, supporting that Dyadic Mirror has helped them be aware of their recurring but unconscious behaviors, understand their children&#8217;s feelings, reason with the children&#8217;s behaviors, and find self-driven momenta to better their attitude and expressions towards their children.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411815\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411815<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"dd738fd1e655e3b1c\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#dd738fd1e655e3b1c\" href=\"#dd738fd1e655e3b1c\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cScheduling Content in Pervasive Display Systems\u201d<\/strong>, Sarah Clinch, Mateusz Mikusz, Ivan Elhart, Nigel Davies, Marc Langheinrich. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 129.<\/span><\/a><\/h4><\/div><div id=\"dd738fd1e655e3b1c\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Digital displays are a ubiquitous feature of public spaces; London recently deployed a whole network of new displays in its Underground stations, and the screens on One Time Square (New York) allow for presentation of over 16, 000 square feet of digital media. However, despite decades of research into pervasive displays, the problem of scheduling content is under-served and there is little forward momentum in addressing the challenges brought with large-scale and open display networks. This paper presents the first comprehensive architectural model for scheduling in current and anticipated pervasive display systems. In contrast to prior work, our three-stage model separates out the process of high level goal setting from content filtering and selection. Our architecture is motivated by an extensive review of the literature and a detailed consideration of requirements. The architecture is realised with an implementation designed to serve the world\u2019s largest and longest-running research testbed of pervasive displays. A mixed-methods evaluation confirms the viability of the architecture from three angles: demonstrating capability to meet the articulated requirements, performance that comfortably fits within the demands of typical display deployments, and evidence of its ability to serve as the day-to-day scheduling platform for the previously described research testbed. Based on our evaluation and a reflection on paper as a whole, we identify ten implications that will shape future research and development in pervasive display scheduling.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369826\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369826<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"71db7c5ccdf04a610\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#71db7c5ccdf04a610\" href=\"#71db7c5ccdf04a610\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDrawingPresence: A Method for Assessing Temporal Fluctuations of Presence Status in a VR Experience\u201d<\/strong>, Christian Mai, Niklas Thiem, Heinrich Hussmann. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 146.<\/span><\/a><\/h4><\/div><div id=\"71db7c5ccdf04a610\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">One of the main measures to evaluate a head-mounted display (HMD) based experience is the state of feeling present in virtual reality (VR).<br \/>\nThe detection of disturbances of such an experience that occur over time, namely breaks in presence (BIP), enables the evaluation and improvement of these.<br \/>\nExisting methods do not detect BIPs, e.g., questionnaires, or are complex in their application and evaluation, e.g., physiological and behavioral measures.<br \/>\nWe propose a handy post-experience method in which users reflect on their experienced state of presence by drawing a line in a paper-based drawing template.<br \/>\nThe amplitude of the drawn line represents the state of presence of the temporal progress of the experience.<br \/>\nWe propose a descriptive model that describes temporal variations in the drawings by the definition of relevant points over time, e.g., putting on the HMD, phases of the experience, transition into VR, and parameters, e.g., the transition time.<br \/>\nThe descriptive model enables us to objectively evaluate user drawings and represent the course of the drawings by a defined set of parameters.<br \/>\nOur exploratory user study (N=30) showed that the drawings are very consistent between participants and the method is able to securely detect a variety of BIPs.<br \/>\nMoreover, the results indicate that the method might be used in the future to evaluate the strength of BIPs and to reflect the temporal course of a presence experience in detail.<br \/>\nAdditional application examples and a detailed discussion pave the way for others to use our method.<br \/>\nFurther, they serve as a motivation to continue working on the method and the general understanding of temporal fluctuations of the presence experience.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369827\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369827<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"e7420976b7e59e09f\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#e7420976b7e59e09f\" href=\"#e7420976b7e59e09f\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cHeadCross: Exploring Head-Based Crossing Selection on Head-Mounted Displays\u201d<\/strong>, Yukang Yan, Yingtian Shi, Chun Yu, Yuanchun Shi. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 35.<\/span><\/a><\/h4><\/div><div id=\"e7420976b7e59e09f\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We proposeHeadCross, a head-based interaction method to select targets on VR and AR head-mounted displays (HMD). UsingHeadCross, users control the pointer with head movements and to select a target, users move the pointer into the target and then back across the target boundary. In this way, users can select targets without using their hands, which is helpful when users\u2019 hands are occupied by other tasks, e.g., while holding the handrails. However, a major challenge for head-based methods is the false positive problems: unintentional head movements may be incorrectly recognized asHeadCrossgesturesand trigger the selections. To address this issue, we first conduct a user study (Study 1) to observe user behavior whileperformingHeadCrossand identify the behavior differences betweenHeadCrossand other types of head movements. Based on the results, we discuss design implications, extract useful features, and develop the recognition algorithm forHeadCross.To evaluateHeadCross, we conduct two user studies. In Study 2, we comparedHeadCrossto the dwell-based selection method,button-press method, and mid-air gesture-based method. Two typical target selection tasks (text entry and menu selection)are tested on both VR and AR interfaces. Results showed that compared to the dwell-based method, HeadCross improved the sense of control; and compared to two hand-based methods, HeadCross improved the interaction efficiency and reduced fatigue. In Study 3, we comparedHeadCrossto three alternative designs of head-only selection methods. Results show thatHeadCrosswas perceived to be significantly faster than the alternatives. We conclude with the discussion on the interaction potential and limitations of HeadCross<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380983\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380983<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"01514700fe87420c1\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#01514700fe87420c1\" href=\"#01514700fe87420c1\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMobileportation: Nomadic Telepresence for Mobile Devices\u201d<\/strong>, Jacob Young, Tobias Langlotz, Steven Mills, And Holger Regenbrecht,. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 65.<\/span><\/a><\/h4><\/div><div id=\"01514700fe87420c1\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The desire to stay connected to one another over large distances has guided decades of telepresence research. Most focuses on stationary solutions that can deliver high-fidelity telepresence experiences, but these are usually impractical for the wider population who cannot afford the necessary proprietary equipment or are unwilling to regress to non-mobile communication. In this paper we present Mobileportation, a nomadic telepresence prototype that takes advantage of recent developments in mobile technology to provide immersive experiences wherever the user desires by allowing for seamless transitions between ego- and exocentric views within a mutually shared three-dimensional environment. The results of a user study are also discussed that show Mobileportation&#8217;s ability to induce a sense of presence within this environment and with the remote communication partner, as well as the potential of this platform for future telepresence research.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397331\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397331<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"be7bf2e8a37391128\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#be7bf2e8a37391128\" href=\"#be7bf2e8a37391128\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cOnline Survey Study on Social Perceptions Towards Color-Changing On-Skin Displays\u201d<\/b>, Chuang-Wen You, Min-Wei Hung, Ximeng Zhang Po-Chun Huang, Cindy Hsin-Liu Kao, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"be7bf2e8a37391128\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">On-skin displays have emerged as a seamless form factor for visualizing information. However, the non-traditional form factor of these on-skin displays and how they present notifications on the skin may raise concerns for public wear. These perceptions will impact whether a device is eventually adopted or rejected by society. Therefore, researchers must consider the societal facets of device design. In this paper, we study social perceptions towards interacting with a color-changing on-skin display. We examined third-person perspectives through a 254-person online survey. The study was conducted in the United States and Taiwan to distill cross-cultural attitudes. This structured study sheds light on designing on-skin displays reflective of cultural considerations.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414301\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414301<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"c2c5c19e9f17d212d\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#c2c5c19e9f17d212d\" href=\"#c2c5c19e9f17d212d\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cFace Mask Design to Mitigate Facial Expression Occlusion\u201d<\/b>, \u00c7a\u011flar Gen\u00e7, Ashley Colley, Markus L\u00f6chtefeld, Jonna H\u00e4kkil\u00e4, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"c2c5c19e9f17d212d\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The COVID-19 pandemic dictated that wearing face masks during public interactions was the new norm across much of the globe. As the masks naturally occlude part of the wearer\u2019s face, the part of communication that occurs through facial expressions is lost, and could reduce acceptance of mask wear. To address the issue, we created 2 face mask prototypes, incorporating simple expressive display elements and evaluated them in a user study. Aiming toexplore the potential for low-cost solutions, suitable for large-scale deployment, our concepts utilized bi-state electrochromic displays. One concept Mouthy Mask aimed to reproduce the image of the wearer\u2019s mouth, whilst the Smiley Mask was symbolic in nature. The smart face masks were considered useful in public contexts to support short socially expected rituals. Generally a visualization directly representing the wearer\u2019s mouth was preferred to an emoji style visualization. As a contribution, our work presents a stepping stone towards productizable solutions for smart face masks that potentially increase the acceptability of face mask wear in public.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414303\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414303<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"24eea8bd07a8f05a1\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-2\" data-target=\"#24eea8bd07a8f05a1\" href=\"#24eea8bd07a8f05a1\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cConversational Greeting Detection Using Captioning on Head Worn Displays Versus Smartphones\u201d<\/b>, Jason Tu, Georgianna E Lin, Thad Starner, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"24eea8bd07a8f05a1\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">People who are deaf and hard of hearing often have difficulty realizing when someone is attempting to get their attention, especially when mobile. Speech recognition coupled with a head-worn display (HWD) may aid in awareness of when someone calls the user&#8217;s name. As our intended users are often oversubscribed with experiments, we chose to test non-deaf and hard of hearing subjects while refining our procedures. Preliminary findings from three hearing participants wearing sound masking headphones and performing a mobile task suggest that a HWD display may be faster than, and preferred to, a smartphone for displaying captions for attending to one&#8217;s name being called.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414293\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414293<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-12\"><h4 id=\"session1c\" style=\"margin-bottom: 0px;\"><b>Session 1C:<\/b> \u2018Sensing I (Behaviour and Emotions)\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Monday, September 14, 2020 18:00-19:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-4 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-4 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VcNrkwnk5zkRVBp-Vx5e7_H\"><span class=\"fusion-button-text\">View Session 1C Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-3 .fusion-panel:hover, #accordion-873-3 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-3 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-3 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-3 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-3 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-3 .panel-title a:hover, #accordion-873-3 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-3 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-3 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-3\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"7a74fce4175bde2a3\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#7a74fce4175bde2a3\" href=\"#7a74fce4175bde2a3\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cQuantifying the Relationships between Everyday Objects and Emotional States through Deep Learning Based Image Analysis Using Smartphones\u201d<\/strong>, Victor-Alexandru Darvariu, Laura Convertino, Abhinav Mehrotra, Mirco Musolesi. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 7.<\/span><\/a><\/h4><\/div><div id=\"7a74fce4175bde2a3\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">There has been an increasing interest in the problem of inferring emotional states of individuals using sensor and user-generated information as diverse as GPS traces, social media data and smartphone interaction patterns. One aspect that has received little attention is the use of visual context information extracted from the surroundings of individuals and how they relate to it. In this paper, we present an observational study of the relationships between the emotional states of individuals and objects present in their visual environment automatically extracted from smartphone images using deep learning techniques.<\/p>\n<p>We developed MyMood, a smartphone application that allows users to periodically log their emotional state together with pictures from their everyday lives, while passively gathering sensor measurements. We conducted an in-the-wild study with 22 participants and collected 3,305 mood reports with photos. Our findings show context-dependent associations between objects surrounding individuals and self-reported emotional state intensities. The applications of this work are potentially many, from the design of interior and outdoor spaces to the development of intelligent applications for positive behavioral intervention, and more generally for supporting computational psychology studies.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380997\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380997<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"5b796b3df7315e6ab\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#5b796b3df7315e6ab\" href=\"#5b796b3df7315e6ab\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cPredicting Brain Functional Connectivity Using Mobile Sensing\u201d<\/strong>, Mikio Obuchi, Jeremy F. Huckins, Weichen Wang, Alex Dasilva, Courtney Rogers, Eilis Murphy, Elin Hedlund, Paul Holtzheimer, Shayan Nmirjafari, Andrew Campbell. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 23.<\/span><\/a><\/h4><\/div><div id=\"5b796b3df7315e6ab\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Brain circuit functioning and connectivity between specific regions allow us to learn, remember, recognize and think as humans. In this paper, we ask the question if mobile sensing from phones can predict brain functional connectivity. We study the brain resting-state functional connectivity (RSFC) between the ventromedial prefrontal cortex (vmPFC) and the amygdala, which has been shown by neuroscientists to be associated with mental illness such as anxiety and depression. We discuss initial results and insights from the NeuroCence study, an exploratory study of 105 first year college students using neuroimaging and mobile sensing across one semester. We observe correlations between several behavioral features from students\u2019 mobile phones and connectivity between vmPFC and amygdala, including conversation duration (r=0.365, p&lt;0.001), sleep onset time (r=0.299, p&lt;0.001) and the number of phone unlocks (r=0.253, p=0.029). We use a support vector classifier and 10-fold cross validation and show that we can classify whether students have higher (i.e., stronger) or lower (i.e., weaker) vmPFC-amygdala RSFC purely based on mobile sensing data with an F1 score of 0.793. To the best of our knowledge, this is the first paper to report that resting-state brain functional connectivity can be predicted using passive sensing data from mobile phones.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381001\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381001<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"827daabedb74edd75\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#827daabedb74edd75\" href=\"#827daabedb74edd75\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cn-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild\u201d<\/strong>, Nan Gao, Wei Shao, Mohammad Saiedur Rahaman, Flora D Salim. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 79.<\/span><\/a><\/h4><\/div><div id=\"827daabedb74edd75\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The study of student engagement has attracted growing interests to address problems such as low academic performance, disaffection, and high dropout rates. Existing approaches to measuring student engagement typically rely on survey-based instruments. While effective, those approaches are time-consuming and labour-intensive. Meanwhile, both the response rate and quality of the survey are usually poor. As an alternative, in this paper, we investigate whether we can infer and predict engagement at multiple dimensions, just using sensors. We hypothesize that multidimensional student engagement level can be translated into physiological responses and activity changes during the class, and also be affected by the environmental changes. Therefore, we aim to explore the following questions: Can we measure the multiple dimensions of high school student&#8217;s learning engagement including emotional, behavioural and cognitive engagement with sensing data in the wild? Can we derive the activity, physiological, and environmental factors contributing to the different dimensions of student learning engagement? If yes, which sensors are the most useful in differentiating each dimension of the learning engagement? Then, we conduct an in-situ study in a high school from 23 students and 6 teachers in 144 classes over 11 courses for 4 weeks. We present the n-Gage, a student engagement sensing system using a combination of sensors from wearables and environments to automatically detect student in-class multidimensional learning engagement. Extensive experiment results show that n-Gage can accurately predict multidimensional student engagement in real-world scenarios with an average mean absolute error (MAE) of 0.788 and root mean square error (RMSE) of 0.975 using all the sensors. We also show a set of interesting findings of how different factors (e.g., combinations of sensors, school subjects, CO2 level) affect each dimension of the student learning engagement.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411813\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411813<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"7520b008519b19059\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#7520b008519b19059\" href=\"#7520b008519b19059\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cHeartQuake: Accurate Low-Cost Non-Invasive ECG Monitoring Using Bed-Mounted Geophones\u201d<\/strong>, JaeYeon Park, Hyeon Cho, Rajesh Balan, JeongGil Ko. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 93.<\/span><\/a><\/h4><\/div><div id=\"7520b008519b19059\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">This work presents HeartQuake, a low cost, accurate, non-intrusive, geophone-based sensing system for extracting accurate electrocardiogram (ECG) patterns using heartbeat vibrations that penetrate through a bed mattress. In HeartQuake, cardiac activity-originated vibration patterns are captured on a geophone and sent to a server, where the data is filtered to remove the sensor\u2019s internal noise and passed on to a bidirectional long short term memory (Bi-LSTM) deep learning model for ECG waveform estimation. To the best of our knowledge, this is the first solution that can non-intrusively provide accurate ECG waveform characteristics instead of more basic abstract features such as the heart rate. Our extensive experimental results with baseline dataset collected from 21 study participants and a longitudinal dataset from 15 study participants suggest that HeartQuake, even when using a general non-personalized model, can detect all five ECG peaks (e.g., P, Q, R, S, T) with an average error of as low as 13 msec when participants are stationary on the bed. Furthermore, clinically used ECG metrics such as RR interval and QRS segment width can be estimated with errors as low as 3 msec and 10 msec, respectively. When additional noise factors are present (e.g., external vibration and various sleeping habits), the estimation error increases, but can be mitigated by using a personalized model. Finally, a qualitative study with 11 physicians on the clinically perceived quality of HeartQuake-generated ECG signals suggests that HeartQuake can effectively serve as a screening tool for detecting and diagnosing abnormal cardiovascular conditions. In addition, HeartQuake&#8217;s low-cost and non-intrusive nature allow it to be deployed in larger scales compared to current ECG monitoring solutions<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411843\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411843<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"3c68c41646a2cfb2c\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#3c68c41646a2cfb2c\" href=\"#3c68c41646a2cfb2c\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDetection of Artifacts in Ambulatory Electrodermal Activity Data\u201d<\/strong>, Shkurta Gashi, Elena Di Lascio, Bianca Stancu, Vedant Das Swain, Varun Mishra, Martin Gjoreski, Silvia Santini. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 44.<\/span><\/a><\/h4><\/div><div id=\"3c68c41646a2cfb2c\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recent wearable devices enable continuous and unobtrusive monitoring of human\u2019s physiological parameters, like e.g., electrodermal activity and heart rate, over long periods of time in everyday life settings. Continuous monitoring of these parameters enables the creation of systems able to predict affective states and stress with the goal of providing feedback to improve them. Deployment of such systems in everyday life settings is still complex and prone to errors due to the low quality of the collected data impacted by the presence of artifacts. In this paper we present an automatic approach to detect artifacts in electrodermal activity (EDA) signals collected in-the-wild over long periods of time. To this end we first perform a systematic literature review and compile a set of guidelines for human annotators to label artifacts manually and we use these labels as ground-truth to test our automatic approach. To evaluate our approach, we collect physiological data from 13 participants in-the-wild and two human annotators label 107.56 hours of this data set. We make the data set publicly available to other researchers upon request. Our model achieves a recall of 98% for clean and shape artifacts classification on data collected in-the-wild using leave-one-subject-out cross-validation, which is 42 percentage points higher than the baseline. We show that state of the art approaches do not generalize well when tested with completely in-the-wild data and identify only 17% of the artifacts present in our data set, even after manual adaption. We further test the robustness of our approach over time using leave-one-day-out and achieve very similar performance. We then introduce a new metric to evaluate the quality of EDA segments that considers the impact of not only artifacts in the shape of EDA but also artifacts generated by environmental temperature changes or user\u2019s high intensity movement. Our results imply that we can eliminate the need for human annotators or significantly reduce the time they need to label data. Also, our approach can be used in an online manner to automatically detect artifacts in EDA signals.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397316\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397316<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"e849af8e0c39db35a\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#e849af8e0c39db35a\" href=\"#e849af8e0c39db35a\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cIntraoral Temperature and Motion Sensing in Automated Dietary Assessment: A Feasibility Study\u201d<\/b>, Keum San Chun, Sarnab Bhattacharya, Caroline Dolbear, Jordon Kashanchi, Edison Thomaz, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"e849af8e0c39db35a\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recent advances in Automated Dietary Monitoring (ADM) with wearables have shown promising results in eating detection in naturalistic environments. However, determining what an individual is consuming remains a significant challenge. In this paper, we present results of a food type classification study based on a sub-centimeter scale wireless intraoral sensor that continuously measures temperature and jawbone movement. We explored the feasibility of classifying nine different types of foods into five classes based on their water-content and typical serving temperature in a controlled environment (n=4). We demonstrated that the system can classify foods into five classes with a weighted accuracy of 77.5% using temperature-derived features only and with a weighted accuracy of 85.0% using both temperature- and acceleration-derived features. Despite the limitations of our study, these results are encouraging and suggest that intraoral computing might be a viable direction for ADM in the future.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414309\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414309<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"71e97fd896395b3c7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#71e97fd896395b3c7\" href=\"#71e97fd896395b3c7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cTowards a Characterisation of Emotional Intent During Scripted Scenes Using In-ear Movement Sensors\u201d<\/b>, Sabrina A.L. Frohn, Jeevan Singh Matharu, Jamie A Ward, Brief, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"71e97fd896395b3c7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Theatre provides a unique environment in which to obtain detailed data on social interactions in a controlled and repeatable manner. This work introduces a method for capturing and characterising the underlying emotional intent of performers in a scripted scene using in-ear accelerometers. Each scene is acted with different underlying emotional intentions using the theatrical technique of Actioning. The goal of the work is to uncover characteristics in the joint movement patterns that reveal information on the positive or negative valence of these intentions. Preliminary findings over 3&#215;12 (Covid-19 restricted) non-actor trials suggests people are more energetic and more in-sync when using positive versus negative intentions.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414292\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414292<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"32130752e8e510049\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#32130752e8e510049\" href=\"#32130752e8e510049\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cSnacap: Snacking Behavior Monitoring with Smart Fabric Mechanomyography on the Temporalis\u201d<\/b>, Bo Zhou, Paul Lukowicz, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"32130752e8e510049\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">This paper investigates the possibility of using soft smart textiles over the hair regions to detect chewing activities under episodes of snacking in a simulated scenario with everyday activities. The planar pressure textile sensors are used to perform mechanomyography of the temporalis muscles in the form of a cap. 10 participants contributed 30 recording sessions with time periods between 30 and 60 minutes. A frequency analysis method is developed to detect moments of snacking events with continuous sliding windows on 1-second time granularity. Our approach results in a baseline 80% accuracy, over 85% after outlier removal, and above 90% accuracy for some of the participants.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414305\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414305<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"497b24d88a7466961\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-3\" data-target=\"#497b24d88a7466961\" href=\"#497b24d88a7466961\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cGastroDigitalShirt: A smart shirt for digestion acoustics monitoring\u201d<\/b>, Annalisa Baronetto, Luisa S. Graf, Sarah Fischer, Markus F. Neurath, Oliver Amft, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"497b24d88a7466961\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We present the GastroDigitalShirt, a smart T-Shirt for capturing abdominal sounds produced during digestion. The garment prototype embeds an array of eight miniaturised microphones connected to a low-power wearable computer and is designed for long-term recording. We present the microphone integration and shirt wiring layout. With the GastroDigitalShirt we monitored the different digestion phases over six hours in four healthy participants with no prior gastro-intestinal diseases. The collected data were annotated by two independent raters to mark Bowel Sounds (BS) instances. The interrater agreement was substantial, with Cohen&#8217;s Kappa of 0.7, confirming a consistent labeling approach. Overall 3046 BS instances were individually annotated. The extracted BS were structured by Hierarchical Agglomerative Clustering. The analysis highlighted the presence of 4 BS types. The results show that our prototype can capture the main BS types reported in literature.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414297\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414297<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-13\"><h4 id=\"session2a\" style=\"margin-bottom: 0px;\"><b>Session 2A:<\/b> \u2018Low-Power and Energy Harvesting\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Tuesday, September 15, 2020 10:00-11:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-5 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-5 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VffUPyvdYXzH8rvbqb2-Xsq\"><span class=\"fusion-button-text\">View Session 2A Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-4 .fusion-panel:hover, #accordion-873-4 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-4 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-4 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-4 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-4 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-4 .panel-title a:hover, #accordion-873-4 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-4 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-4 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-4\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"205477c639834dc46\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#205477c639834dc46\" href=\"#205477c639834dc46\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cKEHKey: Kinetic Energy Harvester-based Authentication and Key Generation for Body Area Network\u201d<\/strong>, Qi Lin, Weitao Xu, Guohao Lan, Yesheng Cui, Hong Jia, Wen Hu, Mahbub Hassan, Aruna Seneviratne. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 41.<\/span><\/a><\/h4><\/div><div id=\"205477c639834dc46\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">For kinetic-powered body area networks, we explore the feasibility of converting energy harvesting patterns for device authentication and symmetric secret keys generation continuously. The intuition is that at any given time, multiple wearable devices harvest kinetic energy from the same user activity, such as walking, which allows them to independently observe a common secret energy harvesting pattern not accessible to outside devices. Such continuous KEH-based authentication and key generation is expected to be highly power efficient as it obviates the need to employ any extra sensors, such as accelerometer, to precisely track the walking patterns. Unfortunately, lack of precise activity tracking introduces bit mismatches between the independently generated keys, which makes KEH-based authentication and symmetric key generation a challenging problem. We propose KEHKey, a KEH-based authentication and key generation system that employs a compressive sensing-based information reconciliation protocol for wearable devices to effectively correct any mismatches in generated keys. We implement KEHKey using off-the-shelf piezoelectric energy harvesting products and evaluate its performance with data collected from 24 subjects wearing the devices on different body locations including head, torso and hands. Our results show that KEHKey is able to generate the same key for two KEH-embedded devices at a speed of 12.57 bps while reducing energy consumption by 59% compared to accelerometer-based methods, which makes it suitable for continuous operation. Finally, we demonstrate that KEHKey can successfully defend against typical adversarial attacks. In particular, KEHKey is found to be more resilient to video side channel attacks than its accelerometer-based counterparts.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381754\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381754<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f775c128a71b87ddf\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#f775c128a71b87ddf\" href=\"#f775c128a71b87ddf\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cIntermittent Learning: On-Device Machine Learning on Intermittently Powered System\u201d<\/strong>, Seulki Lee, Bashima Islam, Yubo Luo, Shahriar Nirjon. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 141.<\/span><\/a><\/h4><\/div><div id=\"f775c128a71b87ddf\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">This paper introduces intermittent learning &#8212; the goal of which is to enable energy harvested computing platforms capable of executing certain classes of machine learning tasks effectively and efficiently. We identify unique challenges to intermittent learning relating to the data and application semantics of machine learning tasks, and to address these challenges, we devise 1) an algorithm that determines a sequence of actions to achieve the desired learning objective under tight energy constraints, and 2) propose three heuristics that help an intermittent learner decide whether to learn or discard training examples at run-time which increases the energy efficiency of the system. We implement and evaluate three intermittent learning applications that learn the 1) air quality, 2) human presence, and 3) vibration using solar, RF, and kinetic energy harvesters, respectively. We demonstrate that the proposed framework improves the energy efficiency of a learner by up to 100% and cuts down the number of learning examples by up to 50% when compared to state-of-the-art intermittent computing systems that do not implement the proposed intermittent learning framework.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369837\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369837<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"eb7b6a418cd8a2ebf\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#eb7b6a418cd8a2ebf\" href=\"#eb7b6a418cd8a2ebf\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cOptoSense: Towards Ubiquitous Self-Powered Ambient Light Sensing Surfaces\u201d<\/strong>, Dingtian Zhang, Jung Wook Park, Yang Zhang, Yuhui Zhao, Yiyang Wang, Yunzhi Li, Tanvi Bhagwat, Wen-Fang Chou, Xiaojia Jia, Bernard Kippelen, Canek Fuentes-Hernandez, Thad Starner, Gregory D Abowd. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 103.<\/span><\/a><\/h4><\/div><div id=\"eb7b6a418cd8a2ebf\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Ubiquitous computing requires robust and sustainable sensing techniques to detect users for explicit and implicit inputs. Existing solutions with cameras can be privacy-invasive. Battery-powered sensors require user maintenance, preventing practical ubiquitous sensor deployment. We present OptoSense, a general-purpose self-powered sensing system which senses ambient light at the surface level of everyday objects as a high-fidelity signal to infer user activities and interactions. To situate the novelty of OptoSense among prior work and highlight the generalizability of the approach, we propose a design framework of ambient light sensing surfaces, enabling implicit activity sensing and explicit interactions in a wide range of use cases with varying sensing dimensions (0D, 1D, 2D), fields of view (wide, narrow), and perspectives (egocentric, allocentric). OptoSense supports this framework through example applications ranging from object use and indoor traffic detection, to liquid sensing and multitouch input. Additionally, the system can achieve high detection accuracy while being self-powered by ambient light. On-going improvements that replace Optosense&#8217;s silicon-based sensors with organic semiconductors (OSCs) enable devices that are ultra-thin, flexible, and cost effective to scale.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411826\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411826<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"19936925e6775b768\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#19936925e6775b768\" href=\"#19936925e6775b768\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cUbiquiTouch: Self Sustaining Ubiquitous Touch Interfaces\u201d<\/strong>, Anandghan Waghmare, Qiuyue Xue, Dingtian Zhang, Yuxui Zhao, Shiva Mittal, Nivedita Arora, Ceara Byrne, Thad Starner, Gregory D Abowd. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 27.<\/span><\/a><\/h4><\/div><div id=\"19936925e6775b768\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We present UbiquiTouch, an ultra low power wireless touch interface. With an average power consumption of 30.91\u03bcW, UbiquiTouch can run on energy harvested from ambient light. It achieves this performance through low power touch sensing and passive communication to a nearby smartphone using ambient FM backscatter. This approach allows UbiquiTouch to be deployed in mobile situations both in indoor and outdoor locations, without the need for any additional infrastructure for operation. To demonstrate the potential of this technology, we evaluate it in several different and realistic scenarios. Finally, we address the future application space for this technology.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380989\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380989<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"505c3d8edb375f61d\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#505c3d8edb375f61d\" href=\"#505c3d8edb375f61d\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cData-Driven Battery-Lifetime-Aware Scheduling for Electric Bus Fleets\u201d<\/strong>, Songyuan Li, Shibo He, Shuai Wang, Tian He, Jiming Chen. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 142.<\/span><\/a><\/h4><\/div><div id=\"505c3d8edb375f61d\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Electric vehicles (EVs) have experienced a sensational growth in the past few years, due to the potential of mitigating global warming and energy scarcity problems. However, the high manufacturing cost of battery packs and limited battery lifetime hinder EVs from further development. Especially, electric bus, as one of the most important means of public transportation, suffers from long daily operation time and peak-hour passenger overload, which aggravate its battery degradation. To address this issue, we propose a novel data-driven battery-lifetimeaware bus scheduling system. Leveraging practical bus GPS and transaction datasets, we conduct a detailed analysis of passenger behaviors and design a reliable prediction model for passenger arrival rate at each station. By taking passenger waiting queue at each bus station analogous to data buffer in network systems, we apply Lyapunov optimization and obtain a bus scheduling strategy with reliable performance guarantee on both battery degradation rate and passengers\u2019 service quality. To verify the effectiveness of the system, we evaluate our design on a 12-month electric bus operation datasets from the city of Shenzhen. The experimental results show that, compared with two baseline methods, our system reduces the battery degradation rate by 14.3% and 21.7% under the same passenger arrival rate, while preserving good passenger service quality.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369810\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369810<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"996be07ac6ebff622\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#996be07ac6ebff622\" href=\"#996be07ac6ebff622\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cBattery-free GameBoy\u201d<\/strong>, Jasper de Winkel, Vito Kortbeek, Josiah Hester, Przemyslaw Pawelczak. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 111.<\/span><\/a><\/h4><\/div><div id=\"996be07ac6ebff622\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We present ENGAGE, the first battery-free, personal mobile gaming device powered by energy harvested from the gamer actions and sunlight. Our design implements a power failure resilient Nintendo Game Boy emulator that can run off-the-shelf classic Game Boy games like Tetris or Super Mario Land. This emulator is capable of intermittent operation by tracking memory usage, avoiding the need for always checkpointing all volatile memory, and decouples the game loop from user interface mechanics allowing for restoration after power failure. We build custom hardware that harvests energy from gamer button presses and sunlight, and leverages a mixed volatility memory architecture for efficient intermittent emulation of game binaries. Beyond a fun toy, our design represents the first battery-free system design for continuous user attention despite frequent power failures caused by intermittent energy harvesting. We tackle key challenges in intermittent computing for interaction including seamless displays and dynamic incentive-based gameplay for energy harvesting. This work provides a reference implementation and framework for a future of battery-free mobile gaming in a more sustainable Internet of Things.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411839\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411839<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"d65ed180f8e2fb9eb\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#d65ed180f8e2fb9eb\" href=\"#d65ed180f8e2fb9eb\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cZygarde: Time-Sensitive On-Device Deep Inference and Adaptationon Intermittently-Powered Systems\u201d<\/strong>, Bashima Islam, Shahriar Nirjon. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 82.<\/span><\/a><\/h4><\/div><div id=\"d65ed180f8e2fb9eb\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We propose Zygarde \u2014 which is an energy- and accuracy-aware soft real-time task scheduling framework for batteryless systems that flexibly execute deep learning tasks1 that are suitable for running on microcontrollers. The sporadic nature of harvested energy, resource constraints of the embedded platform, and the computational demand of deep neural networks (DNNs) pose a unique and challenging real-time scheduling problem for which no solutions have been proposed in the literature. We empirically study the problem and model the energy harvesting pattern as well as the trade-off between the accuracy and execution of a DNN. We develop an imprecise computing-based scheduling algorithm that improves the timeliness of DNN tasks on intermittently powered systems. We evaluate Zygarde using four standard datasets as well as by deploying it in six real-life applications involving audio and camera sensor systems. Results show that Zygarde decreases the execution time by up to 26% and schedules 9% \u2013 34% more tasks with up to 21% higher inference accuracy, compared to traditional schedulers such as the earliest deadline first (EDF).<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411808\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411808<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"fa4968539ce5fcd94\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-4\" data-target=\"#fa4968539ce5fcd94\" href=\"#fa4968539ce5fcd94\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cCoil Design for Wireless Power Transfer and Communication over Hinges of Smart Glasses\u201d<\/b>, Ken Takaki, Takuya Sasatani, Hironobu Kasashima, Yoshihiro Kawahara, Takeshi Naemura, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"fa4968539ce5fcd94\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Glasses are a suitable platform for embedding sensors and displays around our heads to support our daily lives. Furthermore, aesthetic features, durability, and portability are essential properties of glasses. However, designing such smart glasses is challenging, because connecting different glass frames both mechanically and electrically, result in smart glasses with bulky hinges.<br \/>\nTo overcome this challenge, we propose a new design to embed inductively coupled coil pairs adjacent to glasses hinges to deliver power and data wirelessly to the frames.<br \/>\nPositioning the coils next to the hinges creates sufficient area for a large transmission and reception coil while maintaining the utility of the glasses.<br \/>\nConsequently, we were able to achieve over 85% power efficiency and a communication rate of 50~Mbps between coils that are small enough to be embedded inside the frame of conventional glasses, available on the market.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414299\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414299<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-14\"><h4 id=\"session2b\" style=\"margin-bottom: 0px;\"><b>Session 2B:<\/b> \u2018Health and Wellbeing I\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Tuesday, September 15, 2020 10:00-11:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-6 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-6 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-Vee16fvjAVofgVinv1_BqwM\"><span class=\"fusion-button-text\">View Session 2B Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-5 .fusion-panel:hover, #accordion-873-5 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-5 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-5 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-5 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-5 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-5 .panel-title a:hover, #accordion-873-5 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-5 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-5 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-5\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f658bc635069667cc\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#f658bc635069667cc\" href=\"#f658bc635069667cc\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cA Multi-Sensor Approach to Automatically Recognize Breaks and Work Activities of Knowledge Workers in Academia\u201d<\/strong>, Elena Di Lascio, Shkurta Gashi, Juan Sebastian Hidalgo, Beatrice Nale, Maike E. Debus, Silvia Santini. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 78.<\/span><\/a><\/h4><\/div><div id=\"f658bc635069667cc\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Personal informatics systems for the work environment can help improving workers\u2019 well-being and productivity. Using both self-reported data logged manually by the users and information automatically inferred from sensor measurements, such systems may track users\u2019 activities at work and help them reflect on their work habits through insightful data visualizations. They can further support interventions like, e.g., blocking distractions during work activities or suggest the user to take a break. The ability to automatically recognize when the user is engaged in a work activity or taking a break is thus a fundamental primitive such systems need to implement. In this paper, we explore the use of data collected from personal devices \u2013 smartwatches, laptops, and smartphones \u2013 to automatically recognize when users are working or taking breaks. We<br \/>\ncollect a data set of of continuous streams of sensor data captured from personal devices along with labels indicating whether a user is working or taking a break. We use multiple instruments to facilitate the collection of users\u2019 self-reported labels and discuss our experience with this approach. We analyse the available data \u2013 449 labelled activities of nine knowledge workers collected during a typical work week \u2013 using machine learning techniques and show that user-independent models can achieve a (F1 score) of 94% for the identification of work activities and of 69% for breaks, outperforming baseline methods by 5-10 and 12-54 percentage points, respectively.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411821\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411821<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"5fd0133cd97e07348\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#5fd0133cd97e07348\" href=\"#5fd0133cd97e07348\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cLeveraging Free-Hand Sketches for Potential Screening of PTSD\u201d<\/strong>, Farhana Shahid, Wasifur Rahman, M. Saifur Rahman, Sharmin Akther Purabi, Ayesha Seddiqa, Moin Mostakim, Farhan Feroz, Tanjir Rashid Soron, Fahmida Hossain, Nabila Khan, Anika Binte Islam, Nipi Pau, Ehsan Hoque, A. B. M. Alim Al Islam. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 94.<\/span><\/a><\/h4><\/div><div id=\"5fd0133cd97e07348\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Post-traumatic stress disorder (PTSD) negatively influences a person\u2019s ability to cope and increases psychiatric morbidity. The existing diagnostic tools of PTSD are often difficult to administer within marginalized communities due to language and cultural barriers, lack of skilled clinicians, and stigma around disclosing traumatic experiences. Here, we present an initial proof of concept for a novel, low-cost, and creative method to screen the potential cases of PTSD based on free-hand sketches within three different communities in Bangladesh: Rohingya refugees (n=44), slum-dwellers (n=35), and engineering students (n=85). Due to the low overhead and nonverbal nature of sketching, our proposed method potentially overcomes communication and resource barriers. Using corner and edge detection algorithms, we extracted three features (number of corners, number and average length of strokes) from the images of free-hand sketches. We used these features along with sketch themes, participants&#8217; gender and group to train multiple logistic regression models for potentially screening PTSD (accuracy: 82.9-87.9%). We improved the accuracy (99.29%) by integrating EEG data with sketch features in a Random Forest model for the refugee population. Our proposed initial assessment method of PTSD based on sketches could potentially be integrated with phones and EEG headsets, making it widely accessible to the underrepresented communities.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411835\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411835<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"1119e6c7911ad10d7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#1119e6c7911ad10d7\" href=\"#1119e6c7911ad10d7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cPredicting Subjective Measures of Social Anxiety from Sparsely Collected Mobile Sensor Data\u201d<\/strong>, Haroon Rashid, Sanjana Mendu, Katharine E Daniel, Miranda L. Beltzer, Mehdi Boukhechba, Laura E Barnes, Bethany A. Teachman. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 109.<\/span><\/a><\/h4><\/div><div id=\"1119e6c7911ad10d7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Exploiting the capabilities of smartphones for monitoring social anxiety shows promise for advancing our ability to both identify indicators of and treat social anxiety in natural settings. Smart devices allow researchers to collect passive data unobtrusively through built-in sensors and active data using subjective, self-report measures with Ecological Momentary Assessment (EMA) studies. Prior work has established the potential to predict subjective measures from passive data. However, the majority of the past work on social anxiety has focused on a limited subset of self-reported measures. Furthermore, the data collected in real-world studies often results in numerous missing values in one or more data streams, which ultimately reduces the usable data for analysis and limits the potential of machine learning algorithms. We explore several approaches for addressing these problems in a smartphone based monitoring and intervention study of eighty socially anxious participants over a five week period. Our work complements and extends prior work in two directions: (i) we show the predictability of seven different self-reported dimensions of social anxiety, and (ii) we explore four imputation methods to handle missing data and evaluate their effectiveness in the prediction of subjective measures from the passive data. Our evaluation shows imputation of missing data reduces prediction error by as much as 22%. We discuss the implications of these results for future research.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411823\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411823<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"fe688373e293fcc03\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#fe688373e293fcc03\" href=\"#fe688373e293fcc03\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cSmokingOpp: Detecting the Smoking \u2018Opportunity\u2019 Context Using Mobile Sensors\u201d<\/strong>, Soujanya Chatterjee, Alexander Moreno, Steven Lloyd Lizotte, Sayma Akther, Emre Ertin, Christopher P Fagundes, Cho Lam, James M. Rehg, Neng Wan, David W. Wetter, Santosh Kumar. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 4.<\/span><\/a><\/h4><\/div><div id=\"fe688373e293fcc03\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Context plays a key role in impulsive adverse behaviors such as fights, suicide attempts, binge-drinking, and smoking lapse. Several contexts dissuade such behaviors, but some may trigger adverse impulsive behaviors. We define these latter contexts as &#8216;opportunity&#8217; contexts, as their passive detection from sensors can be used to deliver context-sensitive interventions.<\/p>\n<p>In this paper, we define the general concept of &#8216;opportunity&#8217; contexts and apply it to the case of smoking cessation. We operationalize the smoking &#8216;opportunity&#8217; context, using self-reported smoking allowance and cigarette availability. We show its clinical utility by establishing its association with smoking occurrences using Granger causality. Next, we mine several informative features from GPS traces, including the novel location context of smoking spots, to develop the SmokingOpp model for automatically detecting the smoking &#8216;opportunity&#8217; context. Finally, we train and evaluate the SmokingOpp model using 15 million GPS points and 3,432 self-reports from 90 newly abstinent smokers in a smoking cessation study.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380987\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380987<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"3afef35b97d406a06\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#3afef35b97d406a06\" href=\"#3afef35b97d406a06\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cAn Automated Mobile Game-based Screening Tool for Patients with Alcohol Dependence\u201d<\/strong>, Jittrapol Intarasirisawat, Chee Siang Ang, Christos Efstratiou, Luke William Feidhlim Dickens, Burachai Asawathaweeboon, Naranchaya Sriburapar, Dinkar Sharma. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 110.<\/span><\/a><\/h4><\/div><div id=\"3afef35b97d406a06\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Traditional methods for screening and diagnosis of alcohol dependence are typically administered by trained clinicians in medical settings and often rely on interview responses. These self-reports can be unintentionally or deliberately false, and misleading answers can, in turn, lead to inaccurate assessment and diagnosis. In this study, we examine the use of user-game interaction patterns on mobile games to develop an automated diagnostic and screening tool for alcohol-dependent patients. Our approach relies on the capture of interaction patterns during gameplay, while potential patients engage with popular mobile games on smartphones. The captured signals include gameplay performance, touch gestures, and device motion, with the intention of identifying patients with alcohol dependence. We evaluate the classification performance of various supervised learning algorithms on data collected from 40 patients and 40 age-matched healthy adults. The results show that patients with alcohol dependence can be automatically identified accurately using the ensemble of touch, device motion, and gameplay performance features on 3-minute samples (accuracy=0.95, sensitivity=0.95, and specificity=0.95). The present findings provide strong evidence suggesting the potential use of user-game interaction metrics on existing mobile games as discriminant features for developing an implicit measure to identify alcohol dependence conditions. In addition to supporting healthcare professionals in clinical decision-making, the game-based self-screening method could be used as a novel strategy to promote alcohol dependence screening, especially outside of clinical settings.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411837\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411837<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"1cda6b70b4d7507ce\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#1cda6b70b4d7507ce\" href=\"#1cda6b70b4d7507ce\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cBodyCompass: Monitoring Sleep Posture with Wireless Signals\u201d<\/strong>, Shichao Yue, Yuzhe Yang, Hao Wang, Hariharan Rahul, Dina Katabi. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 66.<\/span><\/a><\/h4><\/div><div id=\"1cda6b70b4d7507ce\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Monitoring sleep posture is important for avoiding bedsores after surgery, reducing apnea events, tracking the progression of Parkinson&#8217;s disease, and even alerting epilepsy patients to potentially fatal sleep postures. Today, there is no easy way to track sleep postures. Past work has proposed installing cameras in the bedroom, mounting accelerometers on the subject&#8217;s chest, or embedding pressure sensors in their bedsheets. Unfortunately, such solutions jeopardize either the privacy of the user or their sleep comfort.<\/p>\n<p>In this paper, we introduce BodyCompass, the first RF-based system that provides accurate sleep posture monitoring overnight in the user&#8217;s own home. BodyCompass works by studying the RF reflections in the environment. It disentangles RF signals that bounced off the subject&#8217;s body from other multipath signals. It then analyzes those signals via a custom machine learning algorithm to infer the subject&#8217;s sleep posture. BodyCompass is easily transferable and can apply to new homes and users with minimal effort. We empirically evaluate BodyCompass using over 200 nights of sleep data from 26 subjects in their own homes. Our results show that, given one week, one night, or 16 minutes of labeled data from the subject, BodyCompass&#8217;s corresponding accuracy is 94%, 87%, and 84%, respectively.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397311\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397311<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"c23cc7f625d7091c0\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#c23cc7f625d7091c0\" href=\"#c23cc7f625d7091c0\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cExtraction and Interpretation of Deep Autoencoder-based Temporal Features from Wearables for Forecasting Personalized Mood, Health, and Stress\u201d<\/strong>, Boning Li, Akane Sano. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 49.<\/span><\/a><\/h4><\/div><div id=\"c23cc7f625d7091c0\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Continuous wearable sensor data in high resolution contain physiological and behavioral information that can be utilized to predict human health and wellbeing, establishing the foundation for developing early warning systems to eventually improve human health and wellbeing. We propose a deep neural network framework, the Locally Connected Long Short-Term Memory Denoising AutoEncoder (LC-LSTM-DAE), to automatically extract features from passively collected raw sensor data and perform personalized prediction of self-reported mood, health, and stress scores with high precision. We enabled personalized learning of features by finetuning the general representation model with participant-specific data. The framework was evaluated using wearable sensor data and wellbeing labels collected from college students (total 6391 days from N=239). Sensor data include skin temperature, skin conductance, and acceleration; wellbeing labels include self-reported mood, health and stress scored 0 &#8212; 100. Compared to the prediction performance based on hand-crafted features, the proposed framework achieved higher precision with a smaller number of features. We also provide statistical interpretation and visual explanation to the automatically learned features and the prediction models. Our results show the possibility of predicting self-reported mood, health, and stress accurately using an interpretable deep learning framework, ultimately for developing real-time health and wellbeing monitoring and intervention systems that can benefit various populations.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397318\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397318<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"e344dba1ee7d041a7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#e344dba1ee7d041a7\" href=\"#e344dba1ee7d041a7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMaking Sense of Sleep: Multimodal Sleep Stage Classification in a Large, Diverse Population Using Movement and Cardiac Sensing\u201d<\/strong>, Bing Zhai, Ignacio Perez-Pozuelo, Emma A.D. Clifton, Joao Palotti, Yu Guan. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 67.<\/span><\/a><\/h4><\/div><div id=\"e344dba1ee7d041a7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Traditionally, sleep monitoring has been performed in hospital or clinic environments, requiring complex and expensive equipment set-up and expert scoring. Wearable devices increasingly provide a viable alternative for sleep monitoring, able to collect movement and heart rate (HR) data. In this work, we present a set of algorithms for sleep-wake and sleep-stage classification based upon actigraphy and cardiac sensing amongst 1,743 participants. We devise movement and cardiac features that could be extracted from research-grade wearable sensors and derive models and evaluate their performance in the largest open-access dataset for human sleep science. Our results demonstrated that neural network models outperform traditional machine learning methods and heuristic models for both sleep-wake and sleep-stage classification. Convolutional neural networks (CNNs) and long-short term memory (LSTM) networks were the best performers for sleep-wake and sleep-stage classification, respectively. Using SHAP (SHapley Additive exPlanation) with Random Forest we identified that frequency features from cardiac sensors are critical to sleep-stage classification. Finally, we introduced an ensemble-based approach to sleep-stage classification, which outperformed all other baselines, achieving an accuracy of 78.2% and F1 score of 69.8% on the classification task for three sleep stages. Together, this work represents the first systematic multimodal evaluation of sleep-wake and sleep-stage classification in a large, diverse population. Alongside the presentation of an accurate sleep-stage classification approach, the results highlight multimodal wearable sensing approaches as scalable methods for accurate sleep-classification, providing guidance on optimal algorithm deployment for automated sleep assessment. The code used in this study can be found online at: https:\/\/github.com\/bzhai\/multimodal_sleep_stage_benchmark.git<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397325\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397325<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"73dc3e6e6a6856cb4\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#73dc3e6e6a6856cb4\" href=\"#73dc3e6e6a6856cb4\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cFatigue Assessment using ECG and Actigraphy Sensors\u201d<\/b>, Yang Bai, Yu Guan, Wan\u2011Fai Ng, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"73dc3e6e6a6856cb4\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Fatigue is one of the key factors in the loss of work efficiency and health-related quality of life, and most fatigue assessment methods were based on self-reporting, which may suffer from many factors such as recall bias. To address this issue, we developed an automated system using wearable sensing and machine learning techniques for objective fatigue assessment. ECG\/Actigraphy data were collected from subjects in free-living environments. Preprocessing and feature engineering methods were applied, before interpretable solution and deep learning solution were introduced. Specifically, for interpretable solution, we proposed a feature selection approach which can select less correlated and high informative features for better understanding system&#8217;s decision-making process. For deep learning solution, we used state-of-the-art self-attention model, based on which we further proposed a consistency self-attention (CSA) mechanism for fatigue assessment. Extensive experiments were conducted, and very promising results were achieved.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414308\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414308<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"5eab7f9ad3112d66a\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-5\" data-target=\"#5eab7f9ad3112d66a\" href=\"#5eab7f9ad3112d66a\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cA Wearable Magnetic Field Based Proximity Sensing System for Monitoring COVID-19 Social Distancing\u201d<\/b>, Sizhen Bian, HYMALAI BELLO, Bo Zhou, Paul Lukowicz, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"5eab7f9ad3112d66a\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We present a wearable, oscillating magnetic field-based proximity sensing system to monitor social distancing as suggested to prevent COVID 19 spread (being between 1.5 and 2.0m) apart. We evaluate the system both in controlled lab experiments and in a real life large hardware store setting. We demonstrate that, due physical properties of the magnetic field, the system is much more robust than current BT based sensing, in particular being nearly 100% correct when it comes to distinguishing between distances above and below the 2.0m threshold.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414313\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414313<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-15\"><h4 id=\"session2c\" style=\"margin-bottom: 0px;\"><b>Session 2C:<\/b> \u2018Sensing II (Context and Environment)\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Tuesday, September 15, 2020 10:00-11:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-7 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-7 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VeB8zxqs-pWCAkxN0rOkGe3\"><span class=\"fusion-button-text\">View Session 2C Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-6 .fusion-panel:hover, #accordion-873-6 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-6 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-6 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-6 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-6 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-6 .panel-title a:hover, #accordion-873-6 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-6 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-6 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-6\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"87743fdaa88d41c0b\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#87743fdaa88d41c0b\" href=\"#87743fdaa88d41c0b\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cReVibe: A context-assisted evening recall approach to improve self-report adherence\u201d<\/strong>, Mashfiqui Rabbi, Katherine Li, H. Yanna Yan, Kelly Hall, Predrag Klasnja, Susan Murphy. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 149.<\/span><\/a><\/h4><\/div><div id=\"87743fdaa88d41c0b\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Besides passive sensing, ecological momentary assessments (EMAs) are one of the primary methods to collect in-the-moment data in ubiquitous computing and mobile health. While EMAs have the advantage of low recall bias, a disadvantage is that they frequently interrupt the user and thus long-term adherence is generally poor. In this paper, we propose a less-disruptive self-reporting method, &#8220;assisted recall,&#8221; in which in the evening individuals are asked to answer questions concerning a moment from earlier in the day assisted by contextual information such as location, physical activity, and ambient sounds collected around the moment to be recalled. blue Such contextual information is automatically collected from phone sensor data, so that self-reporting does not require devices other than a smartphone. We hypothesized that providing assistance based on such automatically collected contextual information would increase recall accuracy (i.e., if recall responses for a moment match the EMA responses at the same moment) as compared to no assistance, and we hypothesized that the overall completion rate of evening recalls (assisted or not) would be higher than for in-the-moment EMAs. We conducted a two-week study (N=54) where participants completed recalls and EMAs each day. We found that providing assistance via contextual information increased recall accuracy by 5.6% (p=0.032) and the overall recall completion rate was on average 27.8% (p&lt;0.001) higher than that of EMAs.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369806\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369806<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"86389900be9001406\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#86389900be9001406\" href=\"#86389900be9001406\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cA Multi-perspective Analysis of Social Context and Personal Factors in Office Settings for the Design of an Effective Mobile Notification System\u201d<\/strong>, Seyma Kucukozer Cavdar, Tugba Taskaya-Temizel, Mirco Musolesi, Peter Tino. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 15.<\/span><\/a><\/h4><\/div><div id=\"86389900be9001406\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">In this study, we investigate the effects of social context, personal and mobile phone usage on the inference of work engagement\/challenge levels of knowledge workers and their responsiveness to well-being related notifications. Our results show that mobile application usage is associated to the responsiveness and work engagement\/challenge levels of knowledge workers. We also developed multi-level (within- and between-subjects) models for the inference of attentional states and engagement\/challenge levels with mobile application usage indicators as inputs, such as the number of applications used prior to notifications, the number of switches between applications, and application category usage. The results of our analysis show that the following features are effective for the inference of attentional states and engagement\/challenge levels: the number of switches between mobile applications in the last 45 minutes and the duration of application usage in the last 5 minutes before users&#8217; response to ESM messages.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381000\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381000<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"64eb83daf58b7dff8\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#64eb83daf58b7dff8\" href=\"#64eb83daf58b7dff8\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cA Multisensor Person-Centered Approach to Understand the Role of Daily Activities in Job Performance with Organizational Personas\u201d<\/strong>, Vedant Das Swain, Koustuv Saha, Hemang Rajvanshy, Anusha Sirigiri, Julie M. Gregg, Suwen Lin, Gonzalo J. Martinez, Stephen M. Mattingly, Shayan Mirjafari, Raghu Mulukutla, Subigya Nepal, Kari Nies, Manikanta D. Reddy, Pablo Robles-Granda, Andrew T. Campbell, Nitesh V. Chawla, Sidney D'Mello, Anind K. Dey, Kaifeng Jiang, Qiang Liu, Gloria Mark, Edward Moskal, Aaron Striegel, Louis Tay, Gregory D. Abowd, Munmun De Choudhury. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 130.<\/span><\/a><\/h4><\/div><div id=\"64eb83daf58b7dff8\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Several psychologists posit that performance is not only a function of personality but also of situational contexts, such as day-level activities. Yet in practice, since only personality assessments are used to infer job performance, they provide a limited perspective by ignoring activity. However, multi-modal sensing has the potential to characterize these daily activities. This paper illustrates how empirically measured activity data complements traditional effects of personality to explaina worker\u2019s performance. We leverage sensors in commodity devices to quantify the activity context of 603 information workers. By applying classical clustering methods on this multi-sensor data, we take a person-centered approach to describe workers in terms of both personality and activity. We encapsulate both these facets into an analytical framework that we call organizational personas. On interpreting these organizational personas we find empirical evidence to support that, independent of a worker\u2019s personality, their activity is associated with job performance. While the effects of personality are consistent with the literature, we find that the activity is equally effective in explaining organizational citizenship behavior and is less but significantly effective for task proficiency and deviant behaviors. Specifically, personas that exhibit a daily-activity pattern with fewer location visits, batched phone-use, shorter desk-sessions and longer sleep duration, tend to perform better on all three performance metrics. Organizational personas are a descriptive framework to identify the testable hypotheses that can disentangle the role of malleable aspects like activity in determining the performance of a worker population.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369828\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369828<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f8fa547eda62e3d67\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#f8fa547eda62e3d67\" href=\"#f8fa547eda62e3d67\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cVocaBura: A Method for Supporting Second Language Vocabulary Learning While Walking\u201d<\/strong>, Ari Hautasaari, Takeo Hamada, Kuntaro Ishiyama, Shogo Fukushima. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 135.<\/span><\/a><\/h4><\/div><div id=\"f8fa547eda62e3d67\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Learning a new language is difficult and time-consuming. Apart from dedicated classroom study, second language (L2) learners often lack opportunities to switch their attention to vocabulary learning over other daily routines. In this work, we propose a method that enables L2 learners to study new vocabulary items during their dead time, such as when commuting to school or work. We developed a smartphone application, VocaBura, which combines audio learning with location-relevant L1-L2 word pairs to allow users to discover new vocabulary items while walking past buildings, shops and other locations. Our evaluation results indicated that Japanese beginner level English learners were able to retain more vocabulary items with the proposed method compared to traditional audio-based study despite being less aware of L2 vocabulary acquisition having occurred. In our second study, we report on the level of English vocabulary coverage for L2 learning achievable with our proposed method. We discuss several design implications for educational technologies supporting second language learning.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369824\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369824<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"bc98b9413eb96be5b\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#bc98b9413eb96be5b\" href=\"#bc98b9413eb96be5b\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cPersonalized Context-aware Collaborative Online Activity Prediction\u201d<\/strong>, Yali Fan, Zhen Tu, Yong Li, Xiang Chen, Hui Gao, Lin Zhang, Li Su, Depeng Jin. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 132.<\/span><\/a><\/h4><\/div><div id=\"bc98b9413eb96be5b\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With the rapid development of Internet services and mobile devices, nowadays, users can connect to online services anytime and anywhere. Naturally, user&#8217;s online activity behavior is coupled with time and location contexts and highly influenced by them. Therefore, personalized context-aware online activity modelling and prediction is very meaningful and necessary but also very challenging, due to the complicated relationship between users, activities, spatial and temporal contexts and data sparsity issues. To tackle the challenges, we introduce offline check-in data as auxiliary data and build a user-location-time-activity 4D-tensor and a location-time-POI 3D-tensor, aiming to model the relationship between different entities and transfer semantic features of time and location contexts among them. Accordingly, in this paper we propose a transfer learning based collaborative tensor factorization method to achieve personalized context-aware online activity prediction. Based on real-world datasets, we compare the performance of our method with several state-of-the-arts and demonstrate that our method can provide more effective prediction results in the high sparsity scenario. With only 30% of observed time and location contexts, our solution can achieve 40% improvement in predicting user&#8217;s Top5 activity behavior in new time and location scenarios. Our study is the first step forward for transferring knowledge learned from offline check-in behavior to online activity prediction to provide better personalized context-aware recommendation services for mobile users.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369829\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369829<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a0a40768249e09e32\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#a0a40768249e09e32\" href=\"#a0a40768249e09e32\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cCityGuard: Citywide Fire Risk Forecasting Using A Machine Learning Approach\u201d<\/strong>, Qianru Wang, Junbo Zhang, Bin Guo, Zexia Hao, Yifang Zhou, Junkai Sun, Zhiwen Yu, Yu Zheng. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 156.<\/span><\/a><\/h4><\/div><div id=\"a0a40768249e09e32\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Forecasting the fire risk is of great importance to fire prevention deployments in a city, which can reduce loss even deaths caused by fires. However, it is very challenging because fires are influenced by many complex factors, including spatial correlations, temporal dependencies, even the mixture of these two and external factors. Firstly, the fire risk of a region is influenced by temporal effect of internal factors (e.g., the historical fire risk records) and temporal effect of external factors (e.g., weather). Secondly, a region&#8217;s fire risk is not only influenced by its inherent geospatial attributes (e.g., POIs) but also dependent on other regions in spatial.<br \/>\nTo address these challenges, we propose a machine learning approach to forecast the fire risk, entitled NeuroFire. NeuroFire can represent internal and external temporal effect then combine the temporal representation and spatial dependencies by a spatial-temporal loss function.<br \/>\nExperimental evaluations on real-world datasets show that our NeuroFire outperforms 9 baselines, demonstrating the performance of our approach by several visualizations. Moreover, we implement a citywide fire forecasting system named CityGuard to display the analysis and forecasting results, which can assist the fire rescue department in deploying fire prevention.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369814\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369814<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"64cf2441497daf2dd\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#64cf2441497daf2dd\" href=\"#64cf2441497daf2dd\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cFine-Grained Air Pollution Inference with Mobile Sensing Systems: A Weather-Related Deep Autoencoder Model\u201d<\/strong>, Rui Ma, Ning Liu, Xiangxiang Xu, Yue Wang, Hae Young Noh, Pei Zhang, Lin Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 52.<\/span><\/a><\/h4><\/div><div id=\"64cf2441497daf2dd\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Air pollution is a global health threat. Except static official air quality stations, mobile sensing systems are deployed for urban air pollution monitoring to achieve larger sensing coverage and greater sampling granularity. However, the data sparsity and irregularity also bring great challenges for pollution map recovery. To address these problems, we propose a deep autoencoder framework based inference algorithm. Under the framework, a partially observed pollution map formed by the irregular samples are input into the model, then an encoder and a decoder work together to recover the entire pollution map. Inside the decoder, we adopt a convolutional long short-term memory (ConvLSTM) model by revealing its physical interpretation with an atmospheric dispersion model, and further present a weather-related ConvLSTM to enable quasi real-time applications.<br \/>\nTo evaluate our algorithm, a half-year data collection was deployed with a real-world system on a coastal area including the Sino-Singapore Tianjin Eco-city in north China. With the resolution of 500m\u00d7500m\u00d71h, our offline method is proved to have high robustness against low sampling coverage and accidental sensor errors, obtaining 14.9% performance improvement over existing methods. Our quasi real-time model better captures the spatiotemporal dependencies in the pollution map with unevenly distributed samples than other real-time approaches, obtaining 4.2% error reduction.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397322\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397322<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"65eb39daaff9d08ae\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#65eb39daaff9d08ae\" href=\"#65eb39daaff9d08ae\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cSmartwatch-based Topic Suggestion to Enrich Casual Conversations in Awkward Encounters\u201d<\/b>, Hiromu Ogawa, Pattie Maes, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"65eb39daaff9d08ae\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Encounters with casual acquaintances are common in our daily lives. In such situations, people are sometimes unable to find an appropriate topic for conversation, and as such, an awkward silence follows. However, we believe that this awkward encounter can be an opportunity to build a good relationship with the acquaintance through a brief conversation if an appropriate topic is discovered. In this study, we examined a method to enrich casual conversations for an unintended encounter by following three strategies. (1) an online questionnaire survey that involves 10,750 participants to determine how they experience awkward encounters. (2) the design and implementation of a smartwatch-based topic suggestion that relies on finding a commonality in the users\u2019 video-viewing histories. (3) demos and semi-structured interviews that involves 15 participants to evaluate this approach. This investigation demonstrates that this novel approach can help users overcome the awkwardness of conversations with casual acquaintances.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414310\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414310<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f0718cc878e6512bf\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-6\" data-target=\"#f0718cc878e6512bf\" href=\"#f0718cc878e6512bf\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cField Study of a Tactile Sound Awareness Device for Deaf and Hard of Hearing Users\u201d<\/b>, Dhruv Jain, Brendon Chiu, Steven Goodman, Chris Schmandt, Leah Findlater, Jon Froehlich, Brief, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"f0718cc878e6512bf\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Sound can provide important information about the environment, human activity, and situational cues but can be inaccessible to deaf or hard of hearing (DHH) people. In this paper, we explore a wearable tactile technology to provide sound feedback to DHH people. After implementing a wrist-worn tactile prototype, we performed a four-week field study with 12 DHH people. Participants reported that our device increased awareness of sounds by conveying actionable cues (e.g., appliance alerts) and \u2018experiential\u2019 sound information (e.g., bird chirp patterns).<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414291\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414291<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-16\"><h4 id=\"session3a\" style=\"margin-bottom: 0px;\"><b>Session 3A:<\/b> \u2018Location and Human Mobility\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Tuesday, September 15, 2020 17:00-18:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-8 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-8 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-Vep8k1cU3F8Yl5J3DNf5byT\"><span class=\"fusion-button-text\">View Session 3A Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-7 .fusion-panel:hover, #accordion-873-7 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-7 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-7 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-7 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-7 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-7 .panel-title a:hover, #accordion-873-7 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-7 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-7 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-7\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"4d2d6afd099f63ce5\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#4d2d6afd099f63ce5\" href=\"#4d2d6afd099f63ce5\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cPMF: A Privacy-preserving Human Mobility Prediction Framework via Federated Learning\u201d<\/strong>, Jie Feng, Can Rong, Funing Sun, Diansheng Guo, Yong Li. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 10.<\/span><\/a><\/h4><\/div><div id=\"4d2d6afd099f63ce5\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With the popularity of mobile devices and location-based social network, understanding and modelling the human mobility becomes an important topic in the field of ubiquitous computing. With the model developing from personal models with own information to the joint models with population information, the prediction performance of proposed models become better and better. Meanwhile, the privacy issues of these models come into the view of community and the public: collecting and uploading private data to the centralized server without enough regulation. In this paper, we propose PMF, a privacy-preserving mobility prediction framework via federated learning, to solve this problem without significantly sacrificing the prediction performance. In our framework, based on the deep learning mobility model, no private data is uploaded into the centralized server and the only uploaded thing is the updated model parameters which are difficult to crack and thus more secure. Furthermore, we design a group optimization method for the training on local devices to achieve better trade-off between performance and privacy. Finally, we propose a fine-tuned personal adaptor for personal modelling to further improve the prediction performance. We conduct extensive experiments on three real-life mobility datasets to demonstrate the superiority and effectiveness of our methods in privacy protection settings.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381006\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381006<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"fccb6288ee7e4eed0\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#fccb6288ee7e4eed0\" href=\"#fccb6288ee7e4eed0\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMAIL: Multi-Scale Attention-Guided Indoor Localization Using Geomagnetic Sequences\u201d<\/strong>, Qun Niu, Tao He, Ning Liu, Suining He, Xiaonan Luo, Fan Zhou. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 54.<\/span><\/a><\/h4><\/div><div id=\"fccb6288ee7e4eed0\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Knowing accurate indoor locations of pedestrians has great social and commercial values, such as pedestrian heatmapping and targeted advertising. Location estimation with sequential inputs (e.g., geomagnetic sequences) has received much attention lately, mainly because they enhance the localization accuracy with temporal correlations. Nevertheless, it is challenging to realize accurate localization with geomagnetic sequences due to environmental factors, such as non-uniform ferromagnetic disturbances. To address this, we propose MAIL, a multi-scale attention-guided indoor localization network, which turns these challenges into favorable advantages. Our key contributions are as follows. First, instead of extracting a single holistic feature from an input sequence directly, we design a scale-based feature extraction unit that takes variational anomalies at different scales into consideration. Second, we propose an attention generation scheme that identifies attention values for different scales. Rather than setting fixed numbers, MAIL learns them adaptively with the input sequence, thus increasing its adaptability and generality. Third, guided by attention values, we fuse multi-scale features by paying more attention to prominent ones and estimate current location with the fused feature. We evaluate the performance of MAIL in three different trial sites. Evaluation results show that MAIL reduces the mean localization error by more than 36% compared with the state-of-the-art competing schemes.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397335\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397335<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"6ee87e3af2a6010a6\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#6ee87e3af2a6010a6\" href=\"#6ee87e3af2a6010a6\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cTourgether: Exploring Tourists\u2019 Real-time Sharing of Experiences as a Means of Encouraging Point-of-Interest Exploration\u201d<\/strong>, Yung-Ju Chang, Chu-Yuan Yang, Ying-Hsuan Kuo, Wen-Hao Cheng, Chun-Liang Yang, Fang-Yu Lin, I-Hui Yeh, Chih-Kuan Hsieh, Ching-Yu Hsieh, Yu-Shuen Wang. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 128.<\/span><\/a><\/h4><\/div><div id=\"6ee87e3af2a6010a6\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We developed Tourgether, an app that enables tourists\u2019 mutual sharing of their experiences via check-ins in real time, to enhance their awareness and exploration of various points of interest (POIs) in a tourism region. We conducted formative studies and a between-subjects field experiment to assess how tourists used Tourgether in their travels, and the influence of real-time experience-sharing on unplanned POI visits, respectively. The results of the formative studies indicated that seeing shared real-time experiences encouraged tourists to explore and make unplanned visits to less well-known POIs, and that their decisions to make unplanned POI visits were dependent on familiarity, worthiness, and convenience. The app also created a feeling of co-presence among tourists, boosting their desire to interact with others. Two strong motivators for tourists to check in on the app were identified: contributing to other tourists, and recording journeys. Our experimental results further showed that seeing shared real-time experiences prompted the participants to make more unplanned visits than would have been the case if they had not seen them. This influence was more prominent among tourists who planned more POI visits. Other differences in the usage and influence of Tourgether across these two groups will also be discussed.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369832\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369832<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"e720b31ef6e6f4f6d\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#e720b31ef6e6f4f6d\" href=\"#e720b31ef6e6f4f6d\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cExtending Coverage of Stationary Sensing Systems with Mobile Sensing Systems for Human Mobility Modeling\u201d<\/strong>, Yu Yang, Zhihan Fang, Xiaoyang Xie, Fan Zhang, Yunhuai Liu, Desheng Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 100.<\/span><\/a><\/h4><\/div><div id=\"e720b31ef6e6f4f6d\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Human mobility modeling has many applications in location-based services, mobile networking, city management, and epidemiology. Previous sensing approaches for human mobility are mainly categorized into two types: stationary sensing systems (e.g., surveillance cameras and toll booths) and mobile sensing systems (e.g., smartphone apps and vehicle tracking devices). However, stationary sensing systems only provide mobility information of human in limited coverage (e.g., camera-equipped roads) and mobile sensing systems only capture a limited number of people (e.g., people using a particular smartphone app). In this work, we design a novel system Mohen to model human mobility with a heterogeneous sensing system. The key novelty of Mohen is to fundamentally extend the sensing coverage of a large-scale stationary sensing system with a small-scale sensing system. Based on the evaluation on data from real-world urban sensing systems, our system outperforms them by 35% and achieves a competitive result to an Oracle method.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411827\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411827<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"6198ded3c35d55b87\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#6198ded3c35d55b87\" href=\"#6198ded3c35d55b87\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cLearning from Hometown and Current City: Cross-city POI Recommendation via Interest Drift and Transfer Learning\u201d<\/strong>, Jingtao Ding, Guanghui Yu, Yong Li, Depeng Jin, Hui Gao. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 131.<\/span><\/a><\/h4><\/div><div id=\"6198ded3c35d55b87\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With more and more frequent population movement between different cities, like users\u2019 travel or business trip, recommending personalized cross-city Point-of-Interests (POIs) for these users has become an important scenario of POI recommendation tasks. However, traditional models degrade significantly due to sparsity problem because travelers only have limited visiting behaviors. Through a detailed analysis of real-world check-data, we observe 1) the phenomenon of travelers\u2019 interest drift and transfer co-exist between hometown and current city; 2) differences between popular POIs among locals and travelers. Motivated by this, we propose a POI Recommendation framework with User Interest Drift and Transfer (PR-UIDT), which jointly considers above two factors when designing user and POI latent vector. In this framework, user vector is divided into a city-independent part and another city-dependent part, and POI is represented as two independent vectors for locals and travelers, respectively. To evaluate the proposed framework, we implement it with a square error based matrix factorization model and a ranking error based matrix factorization model, respectively, and conduct extensive experiments on three real-world datasets. The experiment results demonstrate the superiority of PR-UIDT framework, with a relative improvement of 0.4% \u223c 20.5% over several state-of-the-art baselines, as well as the practicality of applying this framework to real-world applications and multi-city scenarios. Further qualitative analysis confirms both the plausibility and validity of combining user interest transfer and drift into cross-city POI recommendation.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369822\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369822<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"ca9612e2482d24451\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#ca9612e2482d24451\" href=\"#ca9612e2482d24451\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cCellPred: A Behavior-aware Scheme for Cellular Data Usage Prediction\u201d<\/strong>, Zhou Qin, Fang Cao, Yu Yang, Shuai Wang, Yunhuai Liu, Chang Tan, Desheng Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 40.<\/span><\/a><\/h4><\/div><div id=\"ca9612e2482d24451\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Cellular data usage consumption prediction is an important topic in cellular networks related researches. Accurately predicting future data usage can benefit both the cellular operators and the users, which can further enable a wide range of applications. Different from previous work focusing on statistical approaches, in this paper, we propose a scheme called CellPred to predict cellular data usage from an individual user perspective considering user behavior patterns. Specifically, we utilize explicit user behavioral tags collected from subscription data to function as an external aid to enhance the user&#8217;s mobility and usage prediction. Then we aggregate individual user data usage to cell tower level to obtain the final prediction results.<br \/>\nTo our knowledge, this is the first work studying cellular data usage prediction from an individual user behavior-aware perspective based on large-scale cellular signaling and behavior tags from the subscription data. The results show that our method improves the data usage prediction accuracy compared to the state-of-the-art methods; we also comprehensively demonstrate the impact of contextual factors on CellPred performance.<br \/>\nOur work can shed light on broad cellular networks researches related to human mobility and data usage. Finally, we discuss issues such as limitations, applications of our approach, and insights from our work.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380982\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380982<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"c1588b946fdfb96d2\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#c1588b946fdfb96d2\" href=\"#c1588b946fdfb96d2\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDecentralized Attention-based Personalized Human Mobility Prediction\u201d<\/strong>, Zipei Fan, Xuan Song, Renhe Jiang, Quanjun Chen, Ryosuke Shibasaki. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 133.<\/span><\/a><\/h4><\/div><div id=\"c1588b946fdfb96d2\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Human mobility prediction is essential to a variety of human-centered computing applications achieved through upgrading of location-based services (LBS) to future-location-based services (FLBS). Previous studies on human mobility prediction have mainly focused on centralized human mobility prediction, where user mobility data are collected, trained and predicted at the cloud server side. However, such a centralized approach leads to a high risk of privacy issues, and a real-time centralized system for processing such a large volume of distributed data is extremely difficult to apply. Moreover, a large and dynamic set of users makes the predictive model extremely challenging to personalize. In this paper, we propose a novel decentralized attention-based human mobility predictor in which 1) no additional training procedure is required for personalized prediction, 2) no additional training procedure is required for incremental learning, and 3) the predictor can be trained and predicted in a decentralized way. We tested our method on big data of real-world mobile phone user GPS and on Android devices, and achieved a low-power consumption and a good prediction accuracy without collecting user data in the server or applying additional training on the user side.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369830\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369830<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"19677013a058eea8a\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#19677013a058eea8a\" href=\"#19677013a058eea8a\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cThe StoryTeller: Scalable Building- and AP-independent Deep Learning-based Floor Prediction\u201d<\/strong>, Rizanne Elbakly, Moustafa Youssef. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 8.<\/span><\/a><\/h4><\/div><div id=\"19677013a058eea8a\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Due to the recent proliferation of location-based services indoors, the need for an accurate floor estimation technique that is easy to deploy in any typical multi-story building is higher than ever. Current approaches that attempt to solve the floor localization problem include sensor-based systems and 3D fingerprinting. Nevertheless, these systems incur high deployment and maintenance overhead, suffer from sensor drift and calibration issues, and\/or are not available to all users.<\/p>\n<p>In this paper, we propose StoryTeller, a deep learning-based technique for floor prediction in multi-story buildings. StoryTeller leverages the ubiquitous WiFi signals to generate images that are input to a Convolutional Neural Network (CNN) which is trained to predict floors based on detected patterns in visible WiFi scans. Input images are created such that they capture the current WiFi-scan in an AP-independent manner. In addition, a novel virtual building concept is used to normalize the information in order to make them building-independent. This allows StoryTeller to reuse a trained network for a completely new building, significantly reducing the deployment overhead.<\/p>\n<p>We have implemented and evaluated StoryTeller using three different buildings with a side-by-side comparison with the state-of-the-art floor estimation techniques. The results show that StoryTeller can estimate the user&#8217;s floor at least 98.3% within one floor of the actual ground truth floor. This accuracy is consistent across the different testbeds and for scenarios where the models used were trained in a completely different building than the tested building. This highlights StoryTeller&#8217;s ability to generalize to new buildings and its promise as a scalable, low-overhead, high-accuracy floor localization system.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380979\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380979<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"be8af3181c818e6a7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-7\" data-target=\"#be8af3181c818e6a7\" href=\"#be8af3181c818e6a7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDynamic Public Resource Allocation Based on Human Mobility Prediction\u201d<\/strong>, Sijie Ruan, Jie Bao, Yuxuan Liang, Ruiyuan Li, Tianfu He, Chuishi Meng, Yanhua Li, Yingcai Wu, Yu Zheng. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 25.<\/span><\/a><\/h4><\/div><div id=\"be8af3181c818e6a7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The objective of public resource allocation, e.g., the deployment of billboards, surveillance cameras, base stations, trash bins, is to serve more people. However, due to the dynamics of human mobility patterns, people are distributed unevenly on the spatial and temporal domains. As a result, in many cases, redundant resources have to be deployed to meet the crowd coverage requirements, which leads to high deployment costs and low usage. Fortunately, with the development of unmanned vehicles, the dynamic allocation of those public resources becomes possible.<br \/>\nTo this end, we provide the first attempt to design an effective and efficient scheduling algorithm for the dynamic public resource allocation. We formulate the problem as a novel multi-agent long-term maximal coverage scheduling (MALMCS) problem, which considers the crowd coverage and the energy limitation during a whole day. Two main components are employed in the system: 1) multi-step crowd flow prediction, which makes multi-step crowd flow prediction given the current crowd flows and external factors; and 2) energy adaptive scheduling, which employs a two-step heuristic algorithm, i.e., energy adaptive scheduling (EADS), to generate a scheduling plan that maximizes the crowd coverage within the service time for agents. Extensive experiments based on real crowd flow data in Happy Valley (a popular theme park in Beijing) demonstrate the effectiveness and efficiency of our approach.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380986\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380986<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-17\"><h4 id=\"session3b\" style=\"margin-bottom: 0px;\"><b>Session 3B:<\/b> \u2018Touch, Gestures, and Posture\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Tuesday, September 15, 2020 17:00-18:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-9 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-9 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VephwObPY9jBydboEkCIDip\"><span class=\"fusion-button-text\">View Session 3B Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-8 .fusion-panel:hover, #accordion-873-8 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-8 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-8 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-8 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-8 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-8 .panel-title a:hover, #accordion-873-8 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-8 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-8 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-8\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"44377ab2d962483b2\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#44377ab2d962483b2\" href=\"#44377ab2d962483b2\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cRecognizing Unintentional Touch on Interactive Tabletop\u201d<\/strong>, Xuhai Xu, Chun Yu, Yuntao Wang, Yuanchun Shi. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 33.<\/span><\/a><\/h4><\/div><div id=\"44377ab2d962483b2\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">A multi-touch interactive tabletop is designed to embody the benefits of a digital computer within the familiar surface of a physical tabletop. However, the nature of current multi-touch tabletops to detect and react to all forms of touch, including unintentional touches, impedes users from acting naturally on them. In our research, we leverage gaze direction, head orientation and screen contact data to identify and filter out unintentional touches, so that users can take full advantage of the physical properties of an interactive tabletop,e.g., resting hands or leaning on the tabletop during the interaction. To achieve this, we first conducted a user study to identify behavioral pattern differences (gaze, head and touch) between completing usual tasks on digital versus physical tabletops. We then compiled our findings into five types of spatiotemporal features, and train a machine learning model to recognize unintentional touches with an F1 score of 91.3%, outperforming the state-of-the-art model by 4.3%. Finally, we evaluated our algorithm in a real-time filtering system. A user study shows that our algorithm is stable and the improved tabletop effectively screens out unintentional touches, and provide more relaxing and natural user experience. By linking their gaze and head behavior to their touch behavior, our work sheds light on the possibility of future tabletop technology to improve the understanding of users\u2019 input intention.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381011\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381011<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"df06178d104470498\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#df06178d104470498\" href=\"#df06178d104470498\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cLearning to Recognize Handwriting Input with Acoustic Features\u201d<\/strong>, Huanpu Yin, Anfu Zhou, Guangyuan Su, Bo Chen, Liang Liu, Huadong Ma. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 64.<\/span><\/a><\/h4><\/div><div id=\"df06178d104470498\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">For mobile or wearable devices with a small touchscreen, handwriting input (instead of typing on the touchscreen) is highly desirable for efficient human-computer interaction. Previous passive acoustic-based handwriting solutions mainly focus on print-style capital input, which is inconsistent with people&#8217;s daily habits and thus causes inconvenience. In this paper, we propose WritingRecorder, a novel universal text entry system that enables free-style lowercase handwriting recognition. WritingRecorder leverages the built-in microphone of the smartphones to record the handwritten sound, and then designs an adaptive segmentation method to detect letter fragments in real-time from the recorded sound. Then we design a neural network named Inception-LSTM to extract the hidden and unique acoustic pattern associated with the writing trajectory of each letter and thus classify each letter. Moreover, we adopt a word selection method based on language model, so as to recognize legislate words from all possible letter combinations. We implement WritingRecorder as an APP on mobile phones and conduct the extensive experimental evaluation. The results demonstrate that WritingRecorder works in real-time and can achieve 93.2% accuracy even for new users without collecting and training on their handwriting samples, under a series of practical scenarios.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397334\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397334<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a44b2e062883c86f0\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#a44b2e062883c86f0\" href=\"#a44b2e062883c86f0\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cFingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist\u201d<\/strong>, Fang Hu, Peng He, Songlin Xu, Yin Li, Cheng Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 71.<\/span><\/a><\/h4><\/div><div id=\"a44b2e062883c86f0\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">In this paper, we present FingerTrak, a minimal-obtrusive wristband that enables continuous 3D finger tracking and hand pose estimation with four miniature thermal cameras mounted closely on a form-fitting wristband. FingerTrak explores the feasibility of continuously reconstructing the entire hand postures (20 finger joints positions) without the needs of seeing all fingers. We demonstrate that our system is able to estimate the entire hand posture by observing only the outline of the hand, i.e., hand silhouettes from the wrist using low-resolution (32*24) thermal cameras. A customized deep neural network is developed to learn to &#8221;stitch&#8221; these multi-view images and estimate 20 joints positions in 3D space. Our user study with 11 participants shows that the system can achieve an average angular error of 6.46\u00b0 when tested under the same background, and 8.06\u00b0 when tested under a different background. FingerTrak also shows encouraging results with the re-mounting of the device and has the potential to reconstruct some of the complicated poses. We conclude this paper with further discussions of the opportunities and challenges of this technology.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397306\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397306<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"5ed71d1f3aa851b29\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#5ed71d1f3aa851b29\" href=\"#5ed71d1f3aa851b29\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cReady, Steady, Touch! \u2014 Sensing Physical Contact with a Finger-Mounted IMU\u201d<\/strong>, Yilei Shi, Haimo Zhang, Kaixing Zhao, Jiashuo Cao, Mengmeng Sun, Suranga Nanayakkara. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 59.<\/span><\/a><\/h4><\/div><div id=\"5ed71d1f3aa851b29\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">A finger held in the air exhibits microvibrations, which are reduced when it touches a static object. When a finger moves along a surface, the friction between them produces vibrations, which can not be produced with a free-moving finger in the air. With an inertial measurement unit (IMU) capturing such motion characteristics, we demonstrate the feasibility to detect contact between the finger and static objects. We call our technique ActualTouch. Studies show that a single nail-mounted IMU on the index finger provides sufficient data to train a binary touch status classifier (i.e.,touchvs.no-touch), with an accuracy above 95%, generalised across users. This model, trained on a rigid tabletop surface, was found to retain an average accuracy of 96% for 7 other types of everyday surfaces with varying rigidity, and in walking and sitting scenarios where no touch occurred. ActualTouch can be combined with other interaction techniques, such as in a uni-stroke gesture recogniser on arbitrary surfaces, where touch status from ActualTouch is used to delimit the motion gesture data that feed into the recogniser. We demonstrate the potential of ActualTouch in a range of scenarios, such as interaction for augmented reality applications, and leveraging daily surfaces and objects for ad-hoc interactions.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397309\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397309<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"3fda908ff99e34185\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#3fda908ff99e34185\" href=\"#3fda908ff99e34185\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cKeep the Phone in Your Pocket: Enabling Smartphone Operation with an IMU Ring for Visually Impaired People\u201d<\/strong>, Guanhong Liu, Yizheng Gu, Yiwen Yin, Chun Yu, Yuntao Wang, Haipeng Mi, Yuanchun Shi. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 58.<\/span><\/a><\/h4><\/div><div id=\"3fda908ff99e34185\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Previous studies have shown that visually impaired users face a unique set of pain points in smartphone interaction including locating and removing the phone from a pocket, two-handed interaction while holding a cane, and keeping personal data private in a public setting. In this paper, we present a ring-based input interaction that enables in-pocket smartphone operation. By wearing a ring with an Inertial Measurement Unit on the index finger, users can perform gestures on any surface (e.g., tables, thighs) using subtle, one-handed gestures and receive auditory feedback via earphones. We conducted participatory studies to obtain a set of versatile commands and corresponding gestures. We subsequently trained an SVM model to recognize these gestures and achieved a mean accuracy of 95.5% on 15 classifications. Evaluation results showed that our ring interaction is more efficient than some baseline phone interactions and is easy, private, and fun to use.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397308\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397308<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a6e053b774d55350d\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#a6e053b774d55350d\" href=\"#a6e053b774d55350d\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cHow Subtle Can It Get? A Trimodal Study of Ring-sized Interfaces for One-Handed Drone Control\u201d<\/strong>, Yui-Pan Yau, Lik Hang Lee, Zheng Li, Tristan Braud, Yi-Hsuan Ho, Pan Hui. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 63.<\/span><\/a><\/h4><\/div><div id=\"a6e053b774d55350d\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Flying drones have become common objects in our daily lives, serving a multitude of purposes. Many of these purposes involve outdoor scenarios where the user combines drone control with another activity. Traditional interaction methods rely on physical or virtual joysticks that occupy both hands, thus restricting drone usability. In this paper, we investigate one-handed human-to-drone-interaction by leveraging three modalities: force, touch, and IMU. After prototyping three different combinations of these modalities on a smartphone, we evaluate them against the current commercial standard through two user experiments. These experiments help us to find the combination of modalities that strikes a compromise between user performance, perceived task load, wrist rotation, and interaction area size. Accordingly, we select a method that achieves faster task completion times than the two-handed commercial baseline by 16.54% with the merits of subtle user behaviours inside a small-size ring-form device and implements this method within the ring-form device. The last experiment involving 12 participants shows that thanks to its small size and weight, the ring device displays better performance than the same method implemented on a mobile phone. Furthermore, users unanimously found the device useful for controlling a drone in mobile scenarios (AVG = 3.92\/5), easy to use (AVG = 3.58\/5) and easy to learn (AVG = 3.58\/5). Our findings give significant design clues in search of subtle and effective interaction through finger augmentation devices with drone control. The users with our prototypical system and a multi-modal on-finger device can control a drone with subtle wrist rotation(pitch gestures: 43.24\u00b0 amplitude and roll gestures: 46.35\u00b0 amplitude) and unnoticeable thumb presses within a miniature-sized area of (1.08 * 0.61 cm2).<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397319\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397319<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"52cfb5fc9b5f9318b\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#52cfb5fc9b5f9318b\" href=\"#52cfb5fc9b5f9318b\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDesigning and Evaluating Hand-to-Hand Gestures with Dual Commodity Wrist-Worn Devices\u201d<\/strong>, Yiqin Lu, Bingjian Huang, Chun Yu, Guahong Liu, Yuanchun Shi. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 20.<\/span><\/a><\/h4><\/div><div id=\"52cfb5fc9b5f9318b\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Hand gestures provide a natural and easy-to-use way to input commands. However, few works have studied the design space of bimanual hand gestures or attempted to infer gestures that involve devices on both hands. We explore the design space of hand-to-hand gestures, a group of gestures that are performed by touching one hand with the other hand. Hand-to-hand gestures are easy to perform and provide haptic feedback on both hands. Moreover, hand-to-hand gestures generate simultaneous vibration on two hands that can be sensed by dual off-the-shelf wrist-worn devices. In this work, we derive a hand-to-hand gesture vocabulary with subjective ratings from users and select gesture sets for real-life scenarios. We also take advantage of devices on both wrists to demonstrate their gesture-sensing capability. Our results show that the recognition accuracy for fourteen gestures is 94.6% when the user is stationary, and the accuracy for five gestures is 98.4% or 96.3% when the user is walking or running, respectively. This is significantly more accurate than a single device worn on either wrist. Our further evaluation also validates that users can easily remember hand-to-hand gestures and use our technique to invoke commands in real-life contexts.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380984\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380984<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"b034e7dedd2e4add1\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#b034e7dedd2e4add1\" href=\"#b034e7dedd2e4add1\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cListen to Your Fingers: User Authentication based on Geometry Biometrics of Touch Gesture\u201d<\/strong>, Huijie Chen, Fan Li, Wan Du, Song Yang, Matthew Conn, Yu Wang. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 75.<\/span><\/a><\/h4><\/div><div id=\"b034e7dedd2e4add1\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Inputting a pattern or PIN code on the touch screen is a popular method to prevent unauthorized access to mobile devices. However, these sensitive tokens are highly susceptible to being inferred by various types of side-channel attacks, which can compromise the security of the private data stored in the device. This paper presents a second-factor authentication method, TouchPrint, which relies on the user&#8217;s hand posture shape traits (dependent on the individual different posture type and unique hand geometry biometrics)<br \/>\nwhen the user inputs PIN or pattern. It is robust against the behavioral variability of inputting a passcode and places no restrictions on input manner (e.g., number of the finger touching the screen, moving speed, or pressure). To capture the spatial characteristic of the user&#8217;s hand posture shape when input the PIN or pattern, TouchPrint performs active acoustic sensing to scan the user&#8217;s hand posture when his\/her finger remains static at some reference positions on the screen (e.g., turning points for the pattern and the number buttons for the PIN code), and extracts the multipath effect feature from the echo signals reflected by the hand. Then, TouchPrint fuses with the spatial multipath feature-based identification results generated from the multiple reference positions to facilitate a reliable and secure MFA system. We build a prototype on smartphone and then evaluate the performance of TouchPrint comprehensively in a variety of scenarios. The experiment results demonstrate that TouchPrint can effectively defend against the replay attacks and imitate attacks. Moreover, TouchPrint can achieve an authentication accuracy of about 92% with only ten training samples.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411809\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411809<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"17caddc3457193ffa\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#17caddc3457193ffa\" href=\"#17caddc3457193ffa\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cWearable Magnetic Field Sensing for Finger Tracking\u201d<\/b>, Kent Lyons, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"17caddc3457193ffa\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Obtaining a signal useful for continuous pointing input is still an open problem for wearables. While magnetic field sensing is one promising approach, there are significant limitations. Our key contribution in this work is a simulation of a system that tracks a magnet in 3D while also accounting for the ambient magnetic field. The simulated sensor data is processed and the position and rotation is determined by using magnetic field equations, a particle filter and a kinematic model of the hand.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414304\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414304<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"4190a2c75580b4d3c\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-8\" data-target=\"#4190a2c75580b4d3c\" href=\"#4190a2c75580b4d3c\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cFacilitating Temporal Synchronous Target Selection through User Behavior Modeling\u201d<\/strong>, Tengxiang Zhang, Xin Yi, Ruolin Gao, Yuntao Wang, Chun Yu, Simin Li, Yuanchun Shi. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 159.<\/span><\/a><\/h4><\/div><div id=\"4190a2c75580b4d3c\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Temporal synchronous target selection is an association-free selection technique: users select a target by generating signals (e.g., finger taps and hand claps) in sync with its unique temporal pattern. However, classical pattern set design and input recognition algorithm of such techniques did not leverage users&#8217; behavioral information, which limits their robustness to imprecise inputs. In this paper, we improve these two key components by modeling users&#8217; interaction behavior. In the first user study, we asked users to tap a finger in sync with blinking patterns with various period and delay, and modeled their finger tapping ability using Gaussian distribution. Based on the results, we generated pattern sets for up to 22 targets that minimized the possibility of confusion due to imprecise inputs. In the second user study, we validated that the optimized pattern sets could reduce error rate from 23% to 7% for the classical Correlation recognizer. We also tested a novel Bayesian, which achieved higher selection accuracy than the Correlation recognizer when the input sequence is short. The informal evaluation results show that the selection technique can be effectively scaled to different modalities and sensing techniques.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369839\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369839<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-18\"><h4 id=\"session3c\" style=\"margin-bottom: 0px;\"><b>Session 3C:<\/b> \u2018Sensing III (RF and other sensing modes)\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Tuesday, September 15, 2020 17:00-18:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-10 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-10 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-Vc3yhtjnD8NBX_shBkukNQM\"><span class=\"fusion-button-text\">View Session 3C Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-9 .fusion-panel:hover, #accordion-873-9 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-9 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-9 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-9 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-9 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-9 .panel-title a:hover, #accordion-873-9 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-9 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-9 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-9\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"45f996ef23caa2f43\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#45f996ef23caa2f43\" href=\"#45f996ef23caa2f43\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cmmASL: Environment-Independent ASL Gesture Recognition Using 60 GHz Millimeter-wave Signals\u201d<\/strong>, Panneer Selvam Santhalingam, Al Amin Hosain, Ding Zhang, Parth Pathak, Huzefa Rangwala, Raja Kushalnagar. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 26.<\/span><\/a><\/h4><\/div><div id=\"45f996ef23caa2f43\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Home assistant devices such as Amazon Echo and Google Home have become tremendously popular in the last couple of years. However, due to their voice-controlled functionality, these devices are not accessible to Deaf and Hard-of-Hearing (DHH) people. Given that over half a million people in the United States communicate using American Sign Language (ASL), there is a need of a home assistant system that can recognize ASL. The objective of this work is to design a home assistant system for DHH users (referred to as mmASL) that can perform ASL recognition using 60 GHz millimeter-wave wireless signals. mmASL has two important components. First, it can perform reliable wake-word detection using spatial spectrograms. Second, using a scalable and extensible multi-task deep learning model, mmASL can learn the phonological properties of ASL signs and use them to accurately recognize the ASL signs. We implement mmASL on 60 GHz software radio platform with phased array, and evaluate it using a large-scale data collection from 15 signers, 50 ASL signs and over 12K sign instances. We show that mmASL is tolerant to the presence of other interfering users and their activities, change of environment and different user positions. We compare mmASL with a well-studied Kinect and RGB camera based ASL recognition systems, and find that it can achieve a comparable performance (87% average accuracy of sign recognition), validating the feasibility of using 60 GHz mmWave system for ASL sign recognition.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381010\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381010<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"207c8fcf8353a8186\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#207c8fcf8353a8186\" href=\"#207c8fcf8353a8186\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cProbing Sucrose Contents in Everyday Drinks Using Miniaturized Near-Infrared Spectroscopy Scanners\u201d<\/strong>, Weiwei Jiang, Gabriele Marini, Niels Van Berkel, Zhanna Sarsenbayeva, Zheyu Tan, Chu Luo, Xin He, Tilman Dingler, Jorge Goncalves, Yoshihiro Kawahara, Vassilis Kostakos. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 136.<\/span><\/a><\/h4><\/div><div id=\"207c8fcf8353a8186\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Near-Infrared Spectroscopy (NIRS) is a non-invasive sensing technique which can be used to acquire information on an object&#8217;s chemical composition. Although NIRS is conventionally used in dedicated laboratories, the recent introduction of miniaturized NIRS scanners has greatly expanded the use cases of this technology. Previous work from the UbiComp community shows that miniaturized NIRS can be successfully adapted to identify medical pills and alcohol concentration. In this paper, we further extend this technology to identify sugar (sucrose) contents in everyday drinks. We developed a standalone mobile device which includes inter alia a NIRS scanner and a 3D printed clamp. The clamp can be attached to a straw-like tube to sense a liquid&#8217;s sucrose content. Through a series of studies, we show that our technique can accurately measure sucrose levels in both lab-made samples and commercially available drinks, as well as classify commercial drinks. Furthermore, we show that our method is robust to variations in the ambient temperature and lighting conditions. Overall, our system can estimate the concentration of sugar with \u00b10.29 g\/100ml error in lab-made samples and &lt; 2.0 g\/100ml error in 18 commercial drinks, and can identify everyday drinks with &gt; 99% accuracy. Furthermore, in our analysis, we are able to discern three characteristic wavelengths in the near-infrared region (1055 nm, 1235 nm and 1545 nm) with acute responses to sugar (sucrose). Our proposed protocol contributes to the development of everyday &#8220;food scanners&#8221; consumers.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369834\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369834<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"707dbddbef82c3f52\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#707dbddbef82c3f52\" href=\"#707dbddbef82c3f52\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMultiSense: Enabling Multi-person Respiration Sensing with Commodity WiFi\u201d<\/strong>, Youwei Zeng, Dan Wu, Jie Xiong, Jinyi Liu, Zhaopeng Liu, Daqing Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 102.<\/span><\/a><\/h4><\/div><div id=\"707dbddbef82c3f52\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">In recent years, we have seen efforts made to simultaneously monitor the respiration of multiple persons based on the channel state information (CSI) retrieved from commodity WiFi devices. Existing approaches mainly rely on spectral analysis of the CSI amplitude to obtain respiration rate information, leading to multiple limitations: (1) spectral analysis works when multiple persons exhibit dramatically different respiration rates, however, it fails to resolve similar rates; (2) spectral analysis can only obtain the average respiration rate over a period of time, and it is unable to capture the detailed rate change over time; (3) they fail to sense the respiration when a target is located at the &#8220;blind spots&#8221; even the target is close to the sensing devices.<\/p>\n<p>To overcome these limitations, we propose MultiSense, the first WiFi-based system that can robustly and continuously sense the detailed respiration patterns of multiple persons even they have very similar respiration rates and are physically closely located. The key insight of our solution is that the commodity WiFi hardware nowadays is usually equipped with multiple antennas. Thus, each individual antenna can receive a different mix copy of signals reflected from multiple persons. We successfully prove that the reflected signals are linearly mixed at each antenna and propose to model the multi-person respiration sensing as a blind source separation (BSS) problem. Then, we solve it using independent component analysis (ICA) to separate the mixed signal and obtain the reparation information of each person. Extensive experiments show that with only one pair of transceivers, each equipped with three antennas, MultiSense is able to accurately monitor respiration even in the presence of four persons, with the mean absolute respiration rate error of 0.73 bpm (breaths per minute).<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411816\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411816<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"945f64cf0a8910b59\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#945f64cf0a8910b59\" href=\"#945f64cf0a8910b59\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cmSense: Towards Mobile Material Sensing with a Single Millimeter-Wave Radio\u201d<\/strong>, Chenshu Wu, Feng Zhang, Beibei Wang, K. J. Ray Liu. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 106.<\/span><\/a><\/h4><\/div><div id=\"945f64cf0a8910b59\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Eyelid stickers are thin strips that temporarily create a crease when attached to the eyelid. The direct contact with the crease that increases and decreases the pressure on the eyelid sticker provides a novel opportunity for sensing blinking. We present Eslucent, an on-skin wearable capacitive sensing device that affords blink detection, building on the form factor of eyelid stickers. It consists of an art layer, conductive thread, fiber eyelid stickers, coated with conductive liquid, and applied the device onto the eyelid crease with adhesive temporary tattoo paper. Eslucent detects blinks during intentional blinking and four involuntary activities by a falling edge detection algorithm in a user study of 14 participants. The average precision was 82% and recall was 70% while achieving the precision and recall of more than 90% in intentional blinking. By embedding interactive technology into a daily beauty product, Eslucent explores a novel wearable form factor for blink detection.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411822\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411822<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"63cca2a349fa24bf5\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#63cca2a349fa24bf5\" href=\"#63cca2a349fa24bf5\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cWiBorder: Precise Wi-Fi based Boundary Sensing via Through-wall Discrimination\u201d<\/strong>, Shengjie Li, Zhaopeng Liu, Yue Zhang, Qin Lv, Xiaopeng Niu, Leye Wang, Daqing Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 89.<\/span><\/a><\/h4><\/div><div id=\"63cca2a349fa24bf5\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recent research has shown great potential of exploiting Channel State Information (CSI) retrieved from commodity Wi-Fi devices for contactless human sensing in smart homes. Despite much work on Wi-Fi based indoor localization and motion\/intrusion detection, no prior solution is capable of detecting a person entering a room with a precise sensing boundary, making room-based services infeasible in the real world. In this paper, we present WiBorder, an innovative technique for accurate determination of Wi-Fi sensing boundary. The key idea is to harness antenna diversity to effectively eliminate random phase shifts while amplifying through-wall amplitude attenuation. By designing a novel sensing metric and correlating it with human&#8217;s through-wall discrimination, WiBorder is able to precisely determine Wi-Fi sensing boundaries by leveraging walls in our daily environments. To demonstrate the effectiveness of WiBorder, we have developed an intrusion detection system and an area detection system. Extensive results in real-life scenarios show that our intrusion detection system achieves a high detection rate of 99.4% and a low false alarm rate of 0.68%, and the area detection system&#8217;s accuracy can be as high as 97.03%. To the best of our knowledge, WiBorder is the first work that enables precise sensing boundary determination via through-wall discrimination, which can immediately benefit other Wi-Fi based applications.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411834\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411834<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"79d30926ba5801ede\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#79d30926ba5801ede\" href=\"#79d30926ba5801ede\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cRFID Tattoo: A Wireless Platform for Speech Recognition\u201d<\/strong>, Jingxian Wang, Chengfeng Pan, Haojian Jin, Vaibhav Singh, Yash Jain, Jason I. Hong, Carmel Majidi, Swarun Kumar. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 155.<\/span><\/a><\/h4><\/div><div id=\"79d30926ba5801ede\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">This paper presents an RF-based assistive technology for voice impairments (i.e., dysphonia), which occurs in an estimated 1% of the global population. We specifically focus on acquired voice disorders where users continue to be able to make facial and lip gestures associated with speech. Despite the rich literature on assistive technologies in this space, there remains a gap for a solution that neither requires external infrastructure in the environment, battery-powered sensors on skin or body-worn manual input devices.<\/p>\n<p>We present RFTattoo, which to our knowledge is the first wireless speech recognition system for voice impairments using batteryless and flexible RFID tattoos. We design specialized wafer-thin tattoos attached around the user\u2019s face and easily hidden by makeup. We build models that process signal variations from these tattoos to a portable RFID reader to recognize various facial gestures corresponding to distinct classes of sounds. We then develop natural language processing models that infer meaningful words and sentences based on the observed series of gestures. A detailed user study with 10 users reveals 86% accuracy in reconstructing the top-100 words in the English language, even without the users making any sounds.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369812\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369812<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a829014ebc1a36c55\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#a829014ebc1a36c55\" href=\"#a829014ebc1a36c55\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cExploring LoRa for Long-range Through-wall Sensing\u201d<\/strong>, Fusang Zhang, Zhaoxin Chang, Kai Niu, Jie Xiong, Beihong Jin, Qin Lv, Daqing Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 68.<\/span><\/a><\/h4><\/div><div id=\"a829014ebc1a36c55\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Wireless signals have been extensively utilized for contactless sensing in the past few years. Due to the intrinsic nature of employing the weak target-reflected signal for sensing, the sensing range is limited. For instance, WiFi and RFID can achieve 3-6 meter sensing range while acoustic-based sensing is limited to less than one meter. In this work, we identify exciting sensing opportunities with LoRa, which is the new long-range communication technology designed for IoT communication. We explore the sensing capability of LoRa, both theoretically and experimentally. We develop the sensing model to characterize the relationship between target movement and signal variation, and propose novel techniques to increase LoRa sensing range to over 25 meters for human respiration sensing. We further build a prototype system which is capable of sensing both coarse-grained and fine-grained human activities. Experimental results show that (1) human respiration can still be sensed when the target is 25 meters away from the LoRa devices, and 15 meters away with a wall in between; and (2) human walking (both displacement and direction) can be tracked accurately even when the target is 30 meters away from the LoRa transceiver pair.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397326\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397326<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"0e3cb36ef36d445a4\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#0e3cb36ef36d445a4\" href=\"#0e3cb36ef36d445a4\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cFingerDraw: Sub-wavelength Level Finger Motion Tracking with WiFi Signals\u201d<\/strong>, Dan Wu, Ruiyang Gao, Youwei Zeng, Jinyi Liu, Leye Wang, Tao Gu, Daqing Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 31.<\/span><\/a><\/h4><\/div><div id=\"0e3cb36ef36d445a4\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">This paper explores the possibility of tracking finger drawings in the air leveraging WiFi signals from commodity devices.<br \/>\nPrior solutions typically require user to hold a wireless transmitter, or need proprietary wireless hardware. They can only recognize a small set of pre-defined hand gestures. This paper introduces FingerDraw, the first sub-wavelength level finger motion tracking system using commodity WiFi devices, without attaching any sensor to finger.<br \/>\nFingerDraw can reconstruct finger drawing trajectory such as digits, alphabets, and symbols with the setting of one WiFi transmitter and two WiFi receivers. It uses a two-antenna receiver to sense the sub-wavelength scale displacement of finger motion in each direction. The theoretical underpinning of FingerDraw is our proposed CSI-quotient model, which uses the channel quotient between two antennas of the receiver to cancel out the noise in CSI amplitude and the random offsets in CSI phase, and quantifies the correlation between CSI value dynamics and object displacement. This channel quotient is sensitive to and enables us to detect small changes in In-phase and Quadrature parts of channel state information due to finger movement.<br \/>\nOur experimental results show that the overall median tracking accuracy is 1.27 cm, and the recognition of drawing ten digits in the air achieves an average accuracy of over 93.0%.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380981\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380981<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"5b4b4cbb93cfd839b\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-9\" data-target=\"#5b4b4cbb93cfd839b\" href=\"#5b4b4cbb93cfd839b\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cV2iFi: in-Vehicle Vital Sign Monitoring via Compact RF Sensing\u201d<\/strong>, Tianyue Zheng, Zhe Chen, Chao Cai, Jun Luo, Xu Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 70.<\/span><\/a><\/h4><\/div><div id=\"5b4b4cbb93cfd839b\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Given the significant amount of time people spend in vehicles, health issues under driving condition have become a major concern. Such issues may vary from fatigue, asthma, stroke, to even heart attack, yet they can be adequately indicated by vital signs and abnormal activities. Therefore, in-vehicle vital sign monitoring can help us predict and hence prevent these issues. Whereas existing sensor-based (including camera) methods could be used to detect these indicators, privacy concern and system complexity both call for a convenient yet effective and robust alternative. This paper aims to develop V^2iFi, an intelligent system performing monitoring tasks using a COTS impulse radio mounted on the windshield. V^2iFi is capable of reliably detecting driver\u2019s vital signs under driving condition and with the presence of passengers, thus allowing for potentially inferring corresponding health issues. Compared with prior work based on Wi-Fi CSI, V^2iFi is able to distinguish reflected signals from multiple users, and hence provide finer-grained measurements under more realistic settings. We evaluate V^2iFi both in lab environments and during real-life road tests; the results demonstrate that respiratory rate, heart rate, and heart rate variability can all be estimated accurately. Based on these estimation results, we further discuss how machine learning models can be applied on top of V^2iFi so as to improve both physiological and psychological wellbeing in driving environments.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397321\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397321<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-19\"><h4 id=\"session4a\" style=\"margin-bottom: 0px;\"><b>Session 4A:<\/b> \u2018IoT and Software Tools\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Wednesday, September 16, 2020 09:00-10:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-11 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-11 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-Vcl1PK69Kwp2iUK4JoOMyf9\"><span class=\"fusion-button-text\">View Session 4A Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-10 .fusion-panel:hover, #accordion-873-10 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-10 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-10 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-10 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-10 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-10 .panel-title a:hover, #accordion-873-10 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-10 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-10 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-10\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"1d86681d9b10168e8\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#1d86681d9b10168e8\" href=\"#1d86681d9b10168e8\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cIoT Inspector: Crowdsourcing Labeled Network Traffic from Smart Home Devices at Scale\u201d<\/strong>, Danny Yuxing Huang, Noah Apthorpe, Frank Li, Gunes Acar, Nick Feamster. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 46.<\/span><\/a><\/h4><\/div><div id=\"1d86681d9b10168e8\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The proliferation of smart home devices has created new opportunities for empirical research in ubiquitous computing, ranging from security and privacy to personal health. Yet, data from smart home deployments are hard to come by, and existing empirical studies of smart home devices typically involve only a small number of devices in lab settings. To contribute to data-driven smart home research, we crowdsource the largest known dataset of labeled network traffic from smart home devices from within real-world home networks. To do so, we developed and released IoT Inspector, an open-source tool that allows users to observe the traffic from smart home devices on their own home networks. Between April 10, 2019 and January 21, 2020, 5,404 users have installed IoT Inspector, allowing us to collect labeled network traffic from 54,094 smart home devices. At the time of publication, IoT Inspector is still gaining users and collecting data from more devices. We demonstrate how this data enables new research into smart homes through two case studies focused on security and privacy. First, we find that many device vendors, including Amazon and Google, use outdated TLS versions and send unencrypted traffic, sometimes to advertising and tracking services. Second, we discover that smart TVs from at least 10 vendors communicated with advertising and tracking services. Finally, we find widespread cross-border communications, sometimes unencrypted, between devices and Internet services that are located in countries with potentially poor privacy practices. To facilitate future reproducible research in smart homes, we will release the IoT Inspector data to the public.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397333\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397333<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f085ce29646718d55\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#f085ce29646718d55\" href=\"#f085ce29646718d55\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMAAT: Mobile Apps As Things in the IoT\u201d<\/strong>, Wyatt Lindquist, Sumi Helal, Ahmed Khaled, Gerald Kotonya, Jaejoon Lee. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 143.<\/span><\/a><\/h4><\/div><div id=\"f085ce29646718d55\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">As the Internet of Things (IoT) proliferates, the potential for its opportunistic interaction with traditional mobile apps becomes apparent. We argue that to fully take advantage of this potential, mobile apps must become things themselves, and interact in a smart space like their hardware counterparts. We present an extension to our Atlas thing architecture on smartphones, allowing mobile apps to behave as things and provide powerful services and functionalities. To this end, we also consider the role of the mobile app developer, and introduce actionable keywords (AKWs)\u2014a dynamically programmable description\u2014to enable potential thing to thing interactions. The AKWs empower the mobile app to dynamically react to services provided by other things, without being known a priori by the original app developer. In this paper, we present the mobile-apps-as-things (MAAT) concept along with its AKW concept and programming construct. For MAAT to be adopted by developers, changes to the existing development environments (IDE) should remain minimal to stay acceptable and practically usable, thus we also propose an IDE plugin to simplify the addition of this dynamic behavior. We present details of MAAT, along with the implementation of the IDE plugin, and give a detailed benchmarking evaluation to assess the responsiveness of our implementation to impromptu interactions and dynamic app behavioral changes. We also investigate another study, targeting Android developers, which evaluates the acceptability and usability of the MAAT IDE plugin.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369823\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369823<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"875f8237dca5fc24c\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#875f8237dca5fc24c\" href=\"#875f8237dca5fc24c\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cGlaze: Overlaying Occupied Spectrum with Downlink IoT Transmissions\u201d<\/strong>, Zerina Kapetanovic, Ali Saffari, Ranveer Chandra, Joshua R. Smith. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 137.<\/span><\/a><\/h4><\/div><div id=\"875f8237dca5fc24c\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Existing Internet of Things (IoT) solutions require expensive infrastructure for sending and receiving data. Emerging technologies such as ambient backscatter help fill this gap by enabling uplink communication for IoT devices. However, there is still no efficient solution to enable low-cost and low-power downlink communication for ambient backscatter systems. In this paper we present Glaze, a system that overlays data on existing wireless signals to create a new channel of downlink communication for IoT backscatter devices. In particular, Glaze uses a new technique that introduces small perturbations to existing signals to convey data. We evaluate the performance of Glaze and show how it can be used across wireless standards such as FM, TV, or Wi-Fi to communicate with devices with minimal impact on existing data transmissions.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369825\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369825<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"c43af08619c9195a7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#c43af08619c9195a7\" href=\"#c43af08619c9195a7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMobile Device Batteries as Thermometers\u201d<\/strong>, Liang He, Youngmoon Lee, Kang G. Shin. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 12.<\/span><\/a><\/h4><\/div><div id=\"c43af08619c9195a7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The ability to sense ambient temperature pervasively, albeit crucial for many applications, is not yet available, causing problems such as degraded indoor thermal comfort and unexpected\/premature shutoffs of mobile devices. To enable pervasive sensing of ambient temperature, we propose use of mobile device batteries as thermometers based on (i) the fact that people always carry their battery-powered smart phones, and (ii) our empirical finding that the temperature of mobile devices&#8217; batteries is highly correlated with that of their operating environment. Specifically, we design and implement Batteries-as-Thermometers (BaT), a temperature sensing service based on the information of mobile device batteries, expanding the ability to sense the device&#8217;s ambient temperature without requiring additional sensors or taking up the limited on-device space. We have evaluated BaT on 6 Android smartphones using 19 laboratory experiments and 36 real-life field-tests, showing an average of 1.25\u00b0C error in sensing the ambient temperature.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381015\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381015<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"033151ec3549136bd\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#033151ec3549136bd\" href=\"#033151ec3549136bd\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDesign and Evaluation of DIO Construction Toolkit for Co-making Shared Constructions\u201d<\/strong>, Jatin Arora, Kartik Mathur, Manvi Goel, Piyush Kumar, Abhijeet Mishra, Aman Parnami. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 127.<\/span><\/a><\/h4><\/div><div id=\"033151ec3549136bd\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We present the design and implementation of DIO, a novel digital-physical construction toolkit to enable constructionist learning for children from age group 8-12 years. The toolkit comprises of dome-shaped (D) tangible modules with various attachments that allow suspension on the body of multiple children and\/or in the environment to support a variety of sensing\/input (I), actuation\/output (O) functionalities. The modules are enabled for wireless communication and can be linked together using an Augmented Reality based programming interface running on a smartphone. The smartphone recognizes our hemispherical modules omnidirectionally through novel computer vision-based 3D patterns; custom-made to provide logical as well as semantic encoding. In this paper, we show how, owing to its unique form-factor, the toolkit enables multi-user constructions for the children and offers a shared learning experience. We further reflect on our learning from a one-year-long iterative design process and contribute a social scaffolding based procedure to engage K-12 children with such constructionist toolkits effectively.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369833\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369833<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"5fe5c6c1dcc30d1e2\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#5fe5c6c1dcc30d1e2\" href=\"#5fe5c6c1dcc30d1e2\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cEnd-User Development of Experience Sampling Smartphone Apps - Recommendations and Requirements\u201d<\/strong>, Daniel J. Rough, Aaron Quigley. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 56.<\/span><\/a><\/h4><\/div><div id=\"5fe5c6c1dcc30d1e2\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Professional programmers are significantly outnumbered by end-users of software, making it problematic to predict the diverse, dynamic needs of these users in advance. An end-user development (EUD) approach, supporting the creation and modification of software independent of professional developers, is one potential solution.<br \/>\nEUD activities are applicable to the work practices of psychology researchers and clinicians, who increasingly rely on software for assessment of participants and patients, but must also depend on developers to realise their requirements.<br \/>\nIn practice, however, the adoption of EUD technology by these two end-user groups is contingent on various contextual factors that are not well understood.<br \/>\nIn this paper, we therefore establish recommendations for the design of EUD tools allowing non-programmers to develop apps to collect data from participants in their everyday lives, known as &#8220;experience sampling&#8221; apps.<br \/>\nWe first present interviews conducted with psychology researchers and practising clinicians on their current working practices and motivation to adopt EUD tools. We then describe our observation of a chronic disease management clinic. Finally, we describe three case studies of psychology researchers using our EUD tool Jeeves to undertake experience sampling studies, and synthesise recommendations and requirements for tools allowing the EUD of experience sampling apps.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397307\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397307<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"ab4784ade2da50305\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#ab4784ade2da50305\" href=\"#ab4784ade2da50305\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cTrace2TAP: Synthesizing Trigger-Action Programs From Traces of Behavior\u201d<\/strong>, Lefan Zhang, Weijia He, Olivia Morkved, Valerie Zhao, Michael L. Littman, Shan Lu, Blase Ur. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 104.<\/span><\/a><\/h4><\/div><div id=\"ab4784ade2da50305\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Two common approaches for automating IoT smart spaces are having users write rules using trigger-action programming (TAP) or training machine learning models based on observed actions. In this paper, we unite these approaches. We introduce and evaluate Trace2TAP, a novel method for automatically synthesizing TAP rules from traces (time-stamped logs of sensor readings and manual actuations of devices). We present a novel algorithm that uses symbolic reasoning and SAT-solving to synthesize TAP rules from traces. Compared to prior approaches, our algorithm synthesizes generalizable rules more comprehensively and fully handles nuances like out-of-order events. Trace2TAP also iteratively proposes modified TAP rules when users manually revert automations. We implemented our approach on Samsung SmartThings. Through formative deployments in ten offices, we developed a clustering\/ranking system and visualization interface to intelligibly present the synthesized rules to users. We evaluated Trace2TAP through a field study in seven additional offices. Participants frequently selected rules ranked highly by our clustering\/ranking system. Participants varied in their automation priorities, and they sometimes chose rules that would seem less desirable by traditional metrics like precision and recall. Trace2TAP supports these differing priorities by comprehensively synthesizing TAP rules and bringing humans into the loop during automation.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411838\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411838<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"ef9548a1d9054bf3e\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#ef9548a1d9054bf3e\" href=\"#ef9548a1d9054bf3e\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cRataplan: Resilient Automation of User Interface Actions with Multi-modal Proxies\u201d<\/strong>, Tom Veuskens, Kris Luyten, Raf Ramakers. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 60.<\/span><\/a><\/h4><\/div><div id=\"ef9548a1d9054bf3e\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We present Rataplan, a robust and resilient pixel-based approach for linking multi-modal proxies to automated sequences of actions in graphical user interfaces (GUIs). With Rataplan, users demonstrate a sequence of actions and answer human-readable follow-up questions to clarify their desire for automation. After demonstrating a sequence, the user can link a proxy input control to the action which can then be used as a shortcut for automating a sequence. Alternatively, output proxies use a notification model in which content is pushed when it becomes available. As an example use case, Rataplan uses keyboard shortcuts and tangible user interfaces (TUIs) as input proxies, and TUIs as output proxies. Instead of relying on available APIs, Rataplan automates GUIs using pixel-based reverse engineering. This ensures our approach can be used with all applications that offer a GUI, including web applications. We implemented a set of important strategies to support robust automation of modern interfaces that have a flat and minimal style, have frequent data and state changes, and have dynamic viewports.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397329\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397329<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"e9c37bf8befd55b6f\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-10\" data-target=\"#e9c37bf8befd55b6f\" href=\"#e9c37bf8befd55b6f\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cDesign Space and Usability of Earable Prototyping\u201d<\/b>, Tobias R\u00f6ddiger, Michael Beigl, Anja Exler, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"e9c37bf8befd55b6f\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Earable computing gains growing attention within research and becomes ubiquitous in society. However, there is an emerging need for prototyping devices as critical drivers of innovation. In our work, we reviewed the features of existing earable platforms. Based on 24 publications, we characterized the design space of earable prototyping. We used the open eSense platform (6-axis IMU, auditory I\/O) to evaluate the problem-based learning usability of non-experts. We collected data from 79 undergraduate students who developed 39 projects. Our questionnaire-based results suggest that the platform creates interest in the subject matter and supports self-directed learning. The projects align with the research space, indicating ease of use, but lack contributions for more challenging topics. Additionally, many projects included games not present in current research. The average SUS score of the platform was 67.0. The majority of problems are technical issues (e.g., connecting, playing music).<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414302\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414302<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-20\"><h4 id=\"session4b\" style=\"margin-bottom: 0px;\"><b>Session 4B:<\/b> \u2018Health and Wellbeing II\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Wednesday, September 16, 2020 09:00-10:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-12 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-12 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VcddDr4EH56h_n9r_7_CeS8\"><span class=\"fusion-button-text\">View Session 4B Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-11 .fusion-panel:hover, #accordion-873-11 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-11 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-11 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-11 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-11 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-11 .panel-title a:hover, #accordion-873-11 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-11 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-11 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-11\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f082023f63773fc5a\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#f082023f63773fc5a\" href=\"#f082023f63773fc5a\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cPersonalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity\u201d<\/strong>, Peng Liao, Kristjan Greenewald, Predrag Klasnja, Susan Murphy. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 18.<\/span><\/a><\/h4><\/div><div id=\"f082023f63773fc5a\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With the recent proliferation of mobile health technologies, health scientists are increasingly interested in developing just-in-time adaptive interventions (JITAIs), typically delivered via notifications on mobile devices and designed to help users prevent negative health outcomes and to promote the adoption and maintenance of healthy behaviors. A JITAI involves a sequence of decision rules (i.e., treatment policies) that take the user&#8217;s current context as input and specify whether and what type of intervention should be provided at the moment. In this work, we describe a reinforcement learning (RL) algorithm that continuously learns and improves the treatment policy embedded in the JITAI as data is being collected from the user. This work is motivated by our collaboration on designing an RL algorithm for HeartSteps V2 based on data collected HeartSteps V1. HeartSteps is a physical activity mobile health application. The RL algorithm developed in this work is being used in HeartSteps V2 to decide, five times per day, whether to deliver a context-tailored activity suggestion.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381007\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381007<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"9cedb99c7aa5debb4\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#9cedb99c7aa5debb4\" href=\"#9cedb99c7aa5debb4\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cExploring the State-of-Receptivity for mHealth Interventions\u201d<\/strong>, Florian K\u00fcnzler, Varun Mishra, Jan-Niklas Kramer, David Kotz, Elgar Fleisch, Tobias Kowatsch. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 140.<\/span><\/a><\/h4><\/div><div id=\"9cedb99c7aa5debb4\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recent advancements in sensing techniques for mHealth applications have led to successful development and deployments of several mHealth intervention designs, including Just-In-Time Adaptive Interventions (JITAI). JITAIs show great potential because they aim to provide the right type and amount of support, at the right time. Timing the delivery of a JITAI such as the user is receptive and available to engage with the intervention is crucial for a JITAI to succeed. Although previous research has extensively explored the role of context in users&#8217; responsiveness towards generic phone notifications, it has not been thoroughly explored for actual mHealth interventions. In this work, we explore the factors affecting users&#8217; receptivity towards JITAIs. To this end, we conducted a study with 189 participants, over a period of 6 weeks, where participants received interventions to improve their physical activity levels. The interventions were delivered by a chatbot-based digital coach &#8212; Ally &#8212; which was available on Android and iOS platforms.<\/p>\n<p>We define several metrics to gauge receptivity towards the interventions, and found that (1) several participant-specific characteristics (age, personality, and device type) show significant associations with the overall participant receptivity over the course of the study, and that (2) several contextual factors (day\/time, phone battery, phone interaction, physical activity, and location), show significant associations with the participant receptivity, in-the-moment. Further, we explore the relationship between the effectiveness of the intervention and receptivity towards those interventions; based on our analyses, we speculate that being receptive to interventions helped participants achieve physical activity goals, which in turn motivated participants to be more receptive to future interventions. Finally, we build machine-learning models to detect receptivity, with up to a 77% increase in F1 score over a biased random classifier.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369805\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369805<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"ffa548cee818e8642\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#ffa548cee818e8642\" href=\"#ffa548cee818e8642\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cTowards the Design of a Ring Sensor-based mHealth System to Achieve Optimal Motor Function in Stroke Survivors\u201d<\/strong>, Yoojung Kim, Hee-Tae Jung, Joonwoo Park, Yangsoo Kim, Nathan Ramasarma, Paolo Bonato, Eun Kyoung Choe, Sunghoon Ivan Lee. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 138.<\/span><\/a><\/h4><\/div><div id=\"ffa548cee818e8642\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Maximizing the motor practice in stroke survivors&#8217; living environments may significantly improve the functional recovery of their stroke-affected upper-limb. A wearable system that can continuously monitor upper-limb performance has been considered as an effective clinical solution for its potential to provide patient-centered, data-driven feedback to improve the motor dosage. Towards that end, we investigate a system leveraging a pair of finger-worn, ring-type accelerometers capable of monitoring both gross-arm and fine-hand movements that are clinically relevant to the performance of daily activities. In this work, we conduct a mixed-methods study to (1) quantitatively evaluate the efficacy of finger-worn accelerometers in measuring clinically relevant information regarding stroke survivors&#8217; upper-limb performance, and (2) qualitatively investigate design requirements for the self-monitoring system, based on data collected from 25 stroke survivors and seven occupational therapists. Our quantitative findings demonstrate strong face and convergent validity of the finger-worn accelerometers, and its responsiveness to changes in motor behavior. Our qualitative findings provide a detailed account of the current rehabilitation process while highlighting several challenges that therapists and stroke survivors face. This study offers promising directions for the design of a self-monitoring system that can encourage the affected limb use during stroke survivors&#8217; daily living.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369817\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369817<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"9ab3e0ecafc4de5a1\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#9ab3e0ecafc4de5a1\" href=\"#9ab3e0ecafc4de5a1\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMachine Learning for Phone-Based Relationship Estimation: The Need to Consider Population Heterogeneity\u201d<\/strong>, Tony Liu, Jennifer Nicholas, Max M.. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 145.<\/span><\/a><\/h4><\/div><div id=\"9ab3e0ecafc4de5a1\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Estimating the category and quality of interpersonal relationships from ubiquitous phone sensor data matters for studying mental well-being and social support. Prior work focused on using communication volume to estimate broad relationship categories, often with small samples. Here we contextualize communications by combining phone logs with demographic and location data to predict interpersonal relationship roles on a varied sample population using automated machine learning methods, producing better performance (F1=0.68) than using communication features alone (F1=0.62). We also explore the effect of age variation in the underlying training sample on interpersonal relationship prediction and find that models trained on younger subgroups, which is popular in the field via student participation and recruitment, generalize poorly to the wider population. Our results not only illustrate the value of using data across demographics, communication patterns and semantic locations for relationship prediction, but also underscore the importance of considering population heterogeneity in phone-based personal sensing studies.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369820\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369820<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"7587874b1b111dbf2\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#7587874b1b111dbf2\" href=\"#7587874b1b111dbf2\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cExamining Opportunities for Goal-Directed Self-Tracking to Support Chronic Condition Management\u201d<\/strong>, Jessica Schroeder, Ravi Karkar, Natalia Murinova, James Fogarty, Sean A. Munson. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 151.<\/span><\/a><\/h4><\/div><div id=\"7587874b1b111dbf2\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Although self-tracking offers potential for a more complete, accurate, and longer-term understanding of personal health, many people struggle with or fail to achieve their goals for health-related self-tracking. This paper investigates how to address challenges that result from current self-tracking tools leaving a person&#8217;s goals for their data unstated and lacking explicit support. We examine supporting people and health providers in expressing and pursuing their tracking-related goals via goal-directed self-tracking, a novel method to represent relationships between tracking goals and underlying data. Informed by a reanalysis of data from a prior study of migraine tracking goals, we created a paper prototype to explore whether and how goal-directed self-tracking could address current disconnects between the goals people have for data in their chronic condition management and the tools they use to support such goals. We examined this prototype in interviews with 14 people with migraine and 5 health providers. Our findings indicate the potential for scaffolding goal-directed self-tracking to: 1) elicit different types and hierarchies of management and tracking goals; 2) help people prepare for all stages of self-tracking towards a specific goal; and 3) contribute additional expertise in patient-provider collaboration. Based on our findings, we present implications for the design of tools that explicitly represent and support an individual&#8217;s specific self-tracking goals.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369809\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369809<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"6639568523261cc9c\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#6639568523261cc9c\" href=\"#6639568523261cc9c\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cAssessBlocks: Exploring Toy Block Play Features for Assessing Stress in Young Children after Natural Disasters\u201d<\/strong>, Xiyue Wang, Kazuki Takashima, Tomoaki Adachi, Patrick Finn, Ehud Sharlin, Yoshifumi Kitamura. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 30.<\/span><\/a><\/h4><\/div><div id=\"6639568523261cc9c\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Natural disasters cause long-lasting mental health problems such as PTSD in children. Following the 2011 Earthquake and Tsunami in Japan, we witnessed a shift of toy block play behavior in young children who suffered from stress after the disaster. The behavior reflected their emotional responses to the traumatic event. In this paper, we explore the feasibility of using data captured from block-play to assess children&#8217;s stress after a major natural disaster. We prototyped sets of sensor-embedded toy blocks, AssessBlocks, that automate quantitative play data acquisition. During a three-year period, the blocks were dispatched to fifty-two post-disaster children. Within a free play session, we captured block features, a child&#8217;s playing behavior, and stress evaluated by several methods. The result from our analysis reveal correlations between block play features and stress measurements and show initial promise of using the effectiveness of using AssessBlocks to assess children&#8217;s stress after a disaster. We provide detailed insights into the potential as well as the challenges of our approach and unique conditions. From these insights we summarize guidelines for future research in automated play assessment systems that support children&#8217;s mental health.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381016\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381016<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"45d890f8684785cc4\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#45d890f8684785cc4\" href=\"#45d890f8684785cc4\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cFoundations for Systematic Evaluation and Benchmarking of a Mobile Food Logger in a Large-scale Nutrition Study\u201d<\/strong>, Jisu Jung, Lyndal Wellard-Cole, Colin Cai, Irena Koprinska, Kalina Yacef, Margaret Allman-Farinelli, Judy Kay. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 47.<\/span><\/a><\/h4><\/div><div id=\"45d890f8684785cc4\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Mobile food logging is important but people find it tedious and difficult to do. Our work tackles the challenging aspect of<br \/>\nsearching a large food database on a small mobile screen. We describe the design of the EaT (Eat and Track) app with its<br \/>\nSearch-Accelerator to support searches on &gt;6,000 foods. We designed a study to harness data from a large nutrition study to provide insights about the use and user experience of EaT. We report the results of our evaluation: a 12-participant lab study and a public health research field study where 1,027-participants entered their nutrition intake for 3 days, logging 30,715 food items. We also analysed 1,163 user-created food entries from 670 participants to gain insights about the causes of failures in the food search. Our core contributions are: 1) the design and evaluation of EaT\u2019s support for accurate and detailed food logging; 2) our study design that harnesses a nutrition research study to provide insights about timeliness of logging and the strengths and weaknesses of the search; 3) new performance benchmarks for mobile food logging.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397327\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397327<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"11b7e9ecb5ff643e9\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#11b7e9ecb5ff643e9\" href=\"#11b7e9ecb5ff643e9\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cFluSense: A Contactless Syndromic Surveillance Platform for Influenza-Like Illness in Hospital Waiting Areas\u201d<\/strong>, Forsad Al Hossain, Andrew A. Lover, George A. Corey, Nicholas G. Reich, Tauhidru Rahman. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 1.<\/span><\/a><\/h4><\/div><div id=\"11b7e9ecb5ff643e9\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We developed a contactless syndromic surveillance platform FluSense that aims to expand the current paradigm of influenza-like illness (ILI) surveillance by capturing crowd-level bio-clinical signals directly related to physical symptoms of ILI from hospital waiting areas in an unobtrusive and privacy-sensitive manner. FluSense proposes a novel edge-computing sensor system, models and data processing pipelines that will track crowd behaviors and influenza-related indicators, such as coughs, and to predict daily ILI and laboratory-confirmed influenza caseloads. FluSense uses a microphone array and a thermal camera along with a neural computing engine to passively and continuously characterize speech and cough activities along with changes in crowd density on the edge in a real-time manner. We conducted an IRB-approved 7 month-long study from December 10, 2018 to July 12, 2019 where we deployed FluSense in four public waiting rooms within the hospital of a large university. During this period, the FluSense platform collected and analyzed more than 350,000 waiting room thermal images and 21 million non-speech audio samples from the hospital waiting areas. FluSense can accurately predict daily patient counts with a Pearson correlation coefficient of 0.95. We compared signals from FluSense with the gold standard laboratory-confirmed influenza case data obtained in the same facility and found that our sensor-based features are strongly correlated with laboratory-confirmed influenza trends.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381014\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381014<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"c756e5bca31655ebe\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#c756e5bca31655ebe\" href=\"#c756e5bca31655ebe\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cDesign and Evaluation of a Wearable Assistive Technology for Hemianopic Stroke Patients\u201d<\/b>, Navid Amini, Jungsoo Lim, Farnaz Mohammadi, Clinton Thodos, Ben Braun, Hassan Ghasemzadeh, Melissa W. Chun, Kouros Nouri-Mahdavi, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"c756e5bca31655ebe\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">\n<p>More than one million people in the US suffer from hemianopia, which blinds the vision in one half of the peripheral vision in both eyes. Hemianopic patients are often not aware of what they cannot see and frequently bump into walls, trip over objects, or walk into people on the side where the peripheral vision is diminished. We present an augmented reality based assistive technology that expands the peripheral vision of hemianopic patients at all distances. In a pilot trial, we evaluate the utility of this assistive technology for ten hemianopic patients. We measure and compare outcomes related to target identification and visual search in the participants. Improvements in target identification are noted in all participants ranging from 18% to 72%. Similarly, all the participants benefit from the assistive technology in performing a visual search task with an average increase of 24% in the number of successful searches compared to unaided trials. The proposed technology is the first instance of an electronic vision enhancement tool for hemianopic patients and is expected to maximize the residual vision and quality of life in this growing, yet largely overlooked population.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414296\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414296<\/a><\/p>\n<\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"41384e7670670771f\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-11\" data-target=\"#41384e7670670771f\" href=\"#41384e7670670771f\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cNeckSense: A Multi-Sensor Necklace for Detecting Eating Activities in Free-Living Conditions\u201d<\/strong>, Shibo Zhang, Yuqi Zhao, Dzung Tri Nguyen, Runsheng Xu, Sougata Sen, Josiah Hester, Nabil Alshurafa. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 72.<\/span><\/a><\/h4><\/div><div id=\"41384e7670670771f\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We present the design, implementation, and evaluation of a multi-sensor, low-power, necklace NeckSense, for automatically and unobtrusively capturing fine-grained information about an individual&#8217;s eating activity and eating episodes, across an entire waking day in a naturalistic setting. NeckSense fuses and classifies the proximity of the necklace from the chin, the ambient light, the Lean Forward Angle, and the energy signals to determine chewing sequences, a building block of the eating activity. It then clusters the identified chewing sequences to determine eating episodes. We tested NeckSense on 11 participants with and 9 participants without obesity, across two studies, where we collected more than 470 hours of data in a naturalistic setting. Our results demonstrate that NeckSense enables reliable eating detection for individuals with diverse body mass index (BMI) profiles, across an entire waking day, even in free-living environments. Overall, our system achieves an F1-score of 81.6% in detecting eating episodes in an exploratory study. Moreover, our system can achieve an F1-score of 77.1% for episodes even in an all-day-around free-living setting. With more than 15.8 hours of battery life, NeckSense will allow researchers and dietitians to better understand natural chewing and eating behaviors. In the future, researchers and dietitians can use NeckSense to provide appropriate real-time interventions when an eating episode is detected or when problematic eating is identified.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397313\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397313<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-21\"><h4 id=\"session4c\" style=\"margin-bottom: 0px;\"><b>Session 4C:<\/b> \u2018Human Activity Recognition I\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Wednesday, September 16, 2020 09:00-10:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-13 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-13 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-Veo919JzizD4ZAAQEDxfIwi\"><span class=\"fusion-button-text\">View Session 4C Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-12 .fusion-panel:hover, #accordion-873-12 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-12 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-12 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-12 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-12 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-12 .panel-title a:hover, #accordion-873-12 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-12 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-12 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-12\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a8b77c5be5fb2977e\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#a8b77c5be5fb2977e\" href=\"#a8b77c5be5fb2977e\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cMETIER: A Deep Multi-Task Learning Based Activity and User Recognition Model Using Wearable Sensors\u201d<\/strong>, Ling Chen, Yi Zhang, Liangying Peng. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 5.<\/span><\/a><\/h4><\/div><div id=\"a8b77c5be5fb2977e\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Activity recognition (AR) and user recognition (UR) using wearable sensors are two key tasks in ubiquitous and mobile computing. Currently, they still face some challenging problems. For one thing, due to the variations in how users perform activities, the performance of a well-trained AR model typically drops on new users. For another, existing UR models are powerless to activity changes, as there are significant differences between the sensor data in different activity scenarios. To address these problems, we propose METIER (deep multi-task learning based activity and user recognition) model, which solves AR and UR tasks jointly and transfers knowledge across them. User-related knowledge from UR task helps AR task to model user characteristics, and activity-related knowledge from AR task guides UR task to handle activity changes. METIER softly shares parameters between AR and UR networks, and optimizes these two networks jointly. The commonalities and differences across tasks are exploited to promote AR and UR tasks simultaneously. Furthermore, mutual attention mechanism is introduced to enable AR and UR tasks to exploit their knowledge to highlight important features for each other. Experiments are conducted on three public datasets, and the results show that our model can achieve competitive performance on both tasks.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381012\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381012<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"d62c261f26364e022\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#d62c261f26364e022\" href=\"#d62c261f26364e022\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cA Systematic Study of Unsupervised Domain Adaptation for Robust Human-Activity Recognition\u201d<\/strong>, Youngjae Chang, Akhil Mathur, Anton Isopoussu, Junehwa Song, Fahim Kawsar. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 39.<\/span><\/a><\/h4><\/div><div id=\"d62c261f26364e022\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Wearable sensors are increasingly becoming the primary interface for monitoring human activities. However, in order to scale human activity recognition (HAR) using wearable sensors to million of users and devices, it is imperative that HAR computational models are robust against real-world heterogeneity in inertial sensor data. In this paper, we study the problem of wearing diversity which pertains to the placement of the wearable sensor on the human body, and demonstrate that even state-of-the-art deep learning models are not robust against these factors. The core contribution of the paper lies in presenting a first-of-its-kind in-depth study of unsupervised domain adaptation (UDA) algorithms in the context of wearing diversity &#8212; we develop and evaluate three adaptation techniques on four HAR datasets to evaluate their relative performance towards addressing the issue of wearing diversity. More importantly, we also do a careful analysis to learn the downsides of each UDA algorithm and uncover several implicit data-related assumptions without which these algorithms suffer a major degradation in accuracy. Taken together, our experimental findings caution against using UDA as a silver bullet for adapting HAR models to new domains, and serve as practical guidelines for HAR practitioners as well as pave the way for future research on domain adaptation in HAR.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380985\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380985<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"94a865638b1dba923\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#94a865638b1dba923\" href=\"#94a865638b1dba923\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cCross-Dataset Activity Recognition via Adaptive Spatial-Temporal Transfer Learning\u201d<\/strong>, Xin Qin, Yiqiang Chen, Jindong Wang, Chaohui Yu. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 148.<\/span><\/a><\/h4><\/div><div id=\"94a865638b1dba923\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Human activity recognition (HAR) aims at recognizing activities by training models on the large quantity of sensor data. Since it is time-consuming and expensive to acquire abundant labeled data, transfer learning becomes necessary for HAR by transferring knowledge from existing domains. However, there are two challenges existing in cross-dataset activity recognition. The first challenge is source domain selection. Given a target task and several available source domains, it is difficult to determine how to select the most similar source domain to the target domain such that negative transfer can be avoided. The second one is accurately activity transfer. After source domain selection, how to achieve accurate knowledge transfer between the selected source and the target domain remains another challenge. In this paper, we propose an Adaptive Spatial-Temporal Transfer Learning (ASTTL) approach to tackle both of the above two challenges in cross-dataset HAR. ASTTL learns the spatial features in transfer learning by adaptively evaluating the relative importance between the marginal and conditional probability distributions. Besides, it captures the temporal features via incremental manifold learning. Therefore, ASTTL can learn the adaptive spatial-temporal features for cross-dataset HAR and can be used for both source domain selection and accurate activity transfer. We evaluate the performance of ASTTL through extensive experiments on 4 public HAR datasets, which demonstrates its effectiveness. Furthermore, based on ASTTL, we design and implement an adaptive cross-dataset HAR system called Client-Cloud Collaborative Adaptive Activity Recognition System (3C2ARS) to perform HAR in the real environment. By collecting activities in the smartphone and transferring knowledge in the cloud server, ASTTL can significantly improve the performance of source domain selection and accurate activity transfer.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369818\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369818<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"db974560a55de0998\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#db974560a55de0998\" href=\"#db974560a55de0998\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cDeepMV: Multi-View Deep Learning for Device-Free Human Activity Recognition\u201d<\/strong>, Hongfei Xue, Wenjun Jiang, Chenglin Miao, Fenglong Ma, Shiyang Wang, Ye Yuan, Shuochao Yao, Aidong Zhang, Lu Su. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 34.<\/span><\/a><\/h4><\/div><div id=\"db974560a55de0998\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recently, significant efforts are made to explore device-free human activity recognition techniques that utilize the information collected by existing indoor wireless infrastructures without the need for the monitored subject to carry a dedicated device. Most of the existing work, however, focuses their attention on the analysis of the signal received by a single device. In practice, there are usually multiple devices &#8220;observing&#8221; the same subject. Each of these devices can be regarded as an information source and provides us an unique &#8220;view&#8221; of the observed subject. Intuitively, if we can combine the complementary information carried by the multiple views, we will be able to improve the activity recognition accuracy. Towards this end, we propose DeepMV, a unified multi-view deep learning framework, to learn informative representations of heterogeneous device-free data. DeepMV can combine different views&#8217; information weighted by the quality of their data and extract commonness shared across different environments to improve the recognition performance. To evaluate the proposed DeepMV model, we set up a testbed using commercialized WiFi and acoustic devices. Experiment results show that DeepMV can effectively recognize activities and outperform the state-of-the-art human activity recognition methods.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380980\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380980<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"4259a08302dc07c38\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#4259a08302dc07c38\" href=\"#4259a08302dc07c38\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cER-Rhythm: Coupling Exercise and Respiration Rhythm Using Lightweight COTS RFID\u201d<\/strong>, Yanni Yang, Jiannong Cao, Xiulong Liu. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 158.<\/span><\/a><\/h4><\/div><div id=\"4259a08302dc07c38\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The locomotor-respiratory coupling (LRC) ratio of a person doing exercise is an important parameter to reflect the exercise safety and effectiveness. Existing approaches that can measure LRC either rely on specialized and costly devices or use heavy sensors, bringing much inconvenience to people during exercise. To overcome these limitations, we propose ER-Rhythm using low-cost and lightweight RFID tags attached on the human body to simultaneously extract and couple the exercise and respiration rhythm for LRC estimation. ER-Rhythm captures exercise locomotion rhythm from the signals of the tags on limbs. However, extracting respiration rhythm from the signals of the tags on the chest during exercise is a challenging task because the minute respiration movement can be overwhelmed by the large torso movement. To address this challenge, we first leverage the unique characteristic of human respiratory mechanism to measure the chest movement while breathing, and then perform dedicated signal fusion of multiple tags interrogated by a pair of antennas to remove the torso movement effect. In addition, we take advantage of the multi-path effect of RF signals to reduce the number of needed antennas for respiration pattern extraction to save the system cost. To couple the exercise and respiration rhythm, we adopt a correlation-based approach to facilitate LRC estimation. The experimental results show that LRC can be estimated accurately up to 92%-95% of the time.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369808\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369808<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"1fc1a9a4a3b0b1df0\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#1fc1a9a4a3b0b1df0\" href=\"#1fc1a9a4a3b0b1df0\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cAuraRing: Precise Electromagnetic Finger Tracking\u201d<\/strong>, Farshid Salemi Parizi, Eric Whitmire, Shwetak Patel. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 150.<\/span><\/a><\/h4><\/div><div id=\"1fc1a9a4a3b0b1df0\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Wearable computing platforms, such as smartwatches and head-mounted mixed reality displays, demand new input devices for high-fidelity interaction. We present AuraRing, a wearable magnetic tracking system designed for tracking fine-grained finger movement. The hardware consists of a ring with an embedded electromagnetic transmitter coil and a wristband with multiple sensor coils. By measuring the magnetic fields at different points around the wrist, AuraRing estimates the five degree-of-freedom pose of the ring. We develop two different approaches to pose reconstruction\u2014a first-principles iterative approach and a closed-form neural network approach. Notably, AuraRing requires no runtime supervised training, ensuring user and session independence. AuraRing has a resolution of 0.1 mm and a dynamic accuracy of 4.4 mm, as measured through a user evaluation with optical ground truth. The ring is completely self-contained and consumes just2.3 mW of power.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369831\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369831<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"66c7753cf3b9b05b3\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#66c7753cf3b9b05b3\" href=\"#66c7753cf3b9b05b3\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cAdversarial Multi-view Networks for Activity Recognition\u201d<\/strong>, Lei Bai, Lina Yao, Xianzhi Wang, Salil S. Kanhere, Bin Guo, Zhiwen Yu. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 42.<\/span><\/a><\/h4><\/div><div id=\"66c7753cf3b9b05b3\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Human activity recognition (HAR) plays an irreplaceable role in various applications and has been a prosperous research topic for years. Recent studies show significant progress in feature extraction (i.e., data representation) using deep learning techniques. However, they face significant challenges in capturing multi-modal spatial-temporal patterns from the sensory data, and they commonly overlook the variants between subjects. We propose a Discriminative Adversarial MUlti-view Network (DAMUN) to address the above issues in sensor-based HAR. We first design a multi-view feature extractor to obtain representations of sensory data streams from temporal, spatial, and spatio-temporal views using convolutional networks. Then, we fuse the multi-view representations into a robust joint representation through a trainable Hadamard fusion module, and finally employ a Siamese adversarial network architecture to decrease the variants between the representations of different subjects. We have conducted extensive experiments under an iterative left-one-subject-out setting on three real-world datasets and demonstrated both the effectiveness and robustness of our approach.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397323\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397323<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"348ee475c23f50dbd\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#348ee475c23f50dbd\" href=\"#348ee475c23f50dbd\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cWeakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearables\u201d<\/strong>, Taoran Sheng, Manfred Huber. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 57.<\/span><\/a><\/h4><\/div><div id=\"348ee475c23f50dbd\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Sensor data streams from wearable devices and smart environments are widely studied in areas like human activity recognition (HAR), person identification, or health monitoring. However, most of the previous works in activity and sensor stream analysis have been focusing on one aspect of the data, e.g. only recognizing the type of the activity or only identifying the person who performed the activity. We instead propose an approach that uses a weakly supervised multi-output siamese network that learns to map the data into multiple representation spaces, where each representation space focuses on one aspect of the data. The representation vectors of the data samples are positioned in the space such that the data with the same semantic meaning in that aspect are closely located to each other. Therefore, as demonstrated with a set of experiments, the trained model can provide metrics for clustering data based on multiple aspects, allowing it to address multiple tasks simultaneously and even to outperform single task supervised methods in many situations. In addition, further experiments are presented that in more detail analyze the effect of the architecture and of using multiple tasks within this framework, that investigate the scalability of the model to include additional tasks, and that demonstrate the ability of the framework to combine data for which only partial relationship information with respect to the target tasks is available.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397330\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397330<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"63672b060c820a38e\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#63672b060c820a38e\" href=\"#63672b060c820a38e\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cEslucent: An Eyelid Interface for Detecting Eye Blinking\u201d<\/b>, Elle Luo, Ruixuan Fu, Alicia Chu, Katia Vega, Cindy Hsin-Liu Kao, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"63672b060c820a38e\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Eyelid stickers are thin strips that temporarily create a crease when attached to the eyelid. The direct contact with the crease that increases and decreases the pressure on the eyelid sticker provides a novel opportunity for sensing blinking. We present Eslucent, an on-skin wearable capacitive sensing device that affords blink detection, building on the form factor of eyelid stickers. It consists of an art layer, conductive thread, fiber eyelid stickers, coated with conductive liquid, and applied the device onto the eyelid crease with adhesive temporary tattoo paper. Eslucent detects blinks during intentional blinking and four involuntary activities by a falling edge detection algorithm in a user study of 14 participants. The average precision was 82% and recall was 70% while achieving the precision and recall of more than 90% in intentional blinking. By embedding interactive technology into a daily beauty product, Eslucent explores a novel wearable form factor for blink detection.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414298\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414298<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"8f525a4205e3ba716\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-12\" data-target=\"#8f525a4205e3ba716\" href=\"#8f525a4205e3ba716\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cMasked Reconstruction based Self-Supervision for Human Activity Recognition\u201d<\/b>, Harish Haresamudram, Apoorva Beedu, Varun Agrawal, Patrick L Grady, Irfan Essa, Judy Hoffman, Thomas Ploetz, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"8f525a4205e3ba716\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The ubiquitous availability of wearable sensing devices has rendered large scale collection of movement data a straightforward endeavor. Yet, annotation of these data remains a challenge and as such, publicly available datasets for human activity recognition (HAR) are typically limited in size as well as in variability, which constrains HAR model training and effectiveness. We introduce masked reconstruction as a viable self-supervised pre-training objective for human activity recognition and explore its effectiveness in comparison to state-of-the-art unsupervised learning techniques. In scenarios with small labeled datasets, the pre-training results in improvements over end-to-end learning on two of the four benchmark datasets. This is promising because the pre-training objective can be integrated &#8220;as is&#8221; into state-of-the-art recognition pipelines to effectively facilitate improved model robustness, and thus, ultimately, leading to better recognition performance.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414306\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414306<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-22\"><h4 id=\"session5a\" style=\"margin-bottom: 0px;\"><b>Session 5A:<\/b> \u2018Driving and Transportation\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Wednesday, September 16, 2020 18:00-19:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-14 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-14 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-Ve5lVqAcTAldheLbvZSUdMu\"><span class=\"fusion-button-text\">View Session 5A Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-13 .fusion-panel:hover, #accordion-873-13 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-13 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-13 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-13 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-13 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-13 .panel-title a:hover, #accordion-873-13 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-13 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-13 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-13\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"69fe7b14a7c3876db\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#69fe7b14a7c3876db\" href=\"#69fe7b14a7c3876db\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cCalm Commute: Guided Slow Breathing for Daily Stress Management in Drivers\u201d<\/strong>, Stephanie Balters, Matthew L. Mauriello, So Yeon Park, James A. Landay, Pablo E. Paredes. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 38.<\/span><\/a><\/h4><\/div><div id=\"69fe7b14a7c3876db\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Commutes provide an opportune time and space for interventions that mitigate stress&#8211;particularly stress accumulated during the workday. In this study, we test the efficacy and safety of haptic guided slow breathing interventions of short duration while driving. We also present design and experimental implications for evolving these interventions from prior simulator to moving vehicle scenarios. We ran a controlled study (N=24) testing a haptic guided breathing system in a closed circuit under normal and stressful driving conditions. Results show the intervention to be successful in both user adoption and system effectiveness with an 82% rate of engagement in intervention and clear reduction of breathing rate and physiological arousal, with no effect on driving safety and minimal effect on performance. The haptic intervention received positive acceptance from the participants: all indicated a willingness to engage with the intervention in the future and all rated the intervention as safe for traffic applications. The results of this study encourage further investigations exploring the use of the intervention on public roads and monitoring for longitudinal health benefits.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380998\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380998<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"c57cbed358e5d1b9a\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#c57cbed358e5d1b9a\" href=\"#c57cbed358e5d1b9a\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cInterruptibility for In-vehicle Multitasking: Influence of Voice Task Demands and Adaptive Behaviors\u201d<\/strong>, Auk Kim, Jung-Mi Park, Uichin Lee. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 14.<\/span><\/a><\/h4><\/div><div id=\"c57cbed358e5d1b9a\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">As a countermeasure to visual-manual distractions, auditory-verbal (voice) interfaces are becoming increasingly popular for in-vehicle systems. This opens up new opportunities for drivers to receive proactive personalized services from various service domains. However, prior studies warned that such interactions can cause cognitive distraction due to the nature of concurrent multitasking with a limited amount of cognitive resources. In this study, we examined (1) how the varying demands of proactive voice tasks under diverse driving situations impact driver interruptibility, and (2) how drivers adapt their concurrent multitasking of driving and proactive voice tasks, and how the adaptive behaviors are related to driver interruptibility. Our quantitative and qualitative analyses showed that in addition to the driving-task demand, the voice-task demand and adaptive behaviors are also significantly related to driver interruptibility. Additionally, we discuss how our findings can be used to design and realize three types of flow-control mechanisms for voice interactions that can improve driver interruptibility.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381009\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381009<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"afef990a5cf708ceb\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#afef990a5cf708ceb\" href=\"#afef990a5cf708ceb\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cRISC: Resource-Constrained Urban Sensing Task Scheduling Based on Commercial Fleets\u201d<\/strong>, Xiaoyang Xie, Zhihan Fang, Yang Wang, Fan Zhang, Desheng Zhang,. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 62.<\/span><\/a><\/h4><\/div><div id=\"afef990a5cf708ceb\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With the trend of vehicles becoming increasingly connected and potentially autonomous, vehicles are being equipped with rich sensing and communication devices. Various vehicular services based on shared real-time sensor data of vehicles from a fleet have been proposed to improve the urban efficiency, e.g., HD-live map, and traffic accident recovery. However, due to the high cost of data uploading (e.g., monthly fees for a cellular network), it would be impractical to make all well-equipped vehicles to upload real-time sensor data constantly. To better utilize these limited uploading resources and achieve an optimal road segment sensing coverage, we present a real-time sensing task scheduling framework, i.e., RISC, for Resource-Constraint modeling for urban sensing by scheduling sensing tasks of commercial vehicles with sensors based on the predictability of vehicles&#8217; mobility patterns. In particular, we utilize the commercial vehicles, including taxicabs, buses, and logistics trucks as mobile sensors to sense urban phenomena, e.g., traffic, by using the equipped vehicular sensors, e.g., dash-cam, lidar, automotive radar, etc.<br \/>\nWe implement RISC on a Chinese city Shenzhen with one-month real-world data from (i) a taxi fleet with 14 thousand vehicles; (ii) a bus fleet with 13 thousand vehicles; (iii) a truck fleet with 4 thousand vehicles. Further, we design an application, i.e., track suspect vehicles (e.g., hit-and-run vehicles), to evaluate the performance of RISC on the urban sensing aspect based on the data from a regular vehicle (i.e., personal car) fleet with 11 thousand vehicles. The evaluation results show that compared to the state-of-the-art solutions, we improved sensing coverage (i.e., the number of road segments covered by sensing vehicles) by 10% on average.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397337\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397337<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"11fa8b1a47b001f75\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#11fa8b1a47b001f75\" href=\"#11fa8b1a47b001f75\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cInSight: Monitoring the state of the driver in low-light using smartphones\u201d<\/strong>, Ishani Janveja, Akshay Nambi, Shruthi Bannur, Sanchit Gupta, Venkat Padmanabhan. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 83.<\/span><\/a><\/h4><\/div><div id=\"11fa8b1a47b001f75\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Road safety is a major public health issue across the globe and over two-thirds of the road accidents occur at nighttime under low-light conditions or darkness. The state of the driver and her\/his actions are the key factors impacting road safety. How can we monitor these in a cost-effective manner and in low-light conditions? RGB cameras present in smartphones perform poorly in low-lighting conditions due to lack of information captured. Hence, existing monitoring solutions rely upon specialized hardware such as infrared cameras or thermal cameras in low-light conditions, but are limited to only high-end vehicles owing to the cost of the hardware. We present InSight, a windshield-mounted smartphone-based system that can be retrofitted to the vehicle to monitor the state of the driver, specifically driver fatigue (based on frequent yawning and eye closure) and driver distraction (based on their direction of gaze). Challenges arise from designing an accurate, yet low-cost and non-intrusive system to continuously monitor the state of the driver.<\/p>\n<p>In this paper, we present two novel and practical approaches for continuous driver monitoring in low-light conditions: (i) Image synthesis: enabling monitoring in low-light conditions using just the smartphone RGB camera by synthesizing a thermal image from RGB with a Generative Adversarial Network, and (ii) Near-IR LED: using a low-cost near-IR (NIR) LED attachment to the smartphone, where the NIR LED acts as a light source to illuminate the driver\u2019s face, which is not visible to the human eyes, but can be captured by standard smartphone cameras without any specialized hardware. We show that the proposed techniques can capture the driver&#8217;s face accurately in low-lighting conditions to monitor driver&#8217;s state. Further, since NIR and thermal imagery is significantly different than RGB images, we present a systematic approach to generate labelled data, which is used to train existing computer vision models. We present an extensive evaluation of both the approaches with data collected from 15 drivers in controlled basement area and on real roads in low-light conditions. The proposed NIR LED setup has an accuracy (F1-score) of 85% and 93.8% in detecting driver fatigue and distraction, respectively in low-light.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411819\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411819<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"cfca17d4b7d5a817a\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#cfca17d4b7d5a817a\" href=\"#cfca17d4b7d5a817a\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cCarOSense: Car Occupancy Sensing with the Ultra-Wideband Keyless Infrastructure\u201d<\/strong>, Yongsen Ma, Yunze Zeng, Vivek Jain. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 91.<\/span><\/a><\/h4><\/div><div id=\"cfca17d4b7d5a817a\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Ultra-Wideband (UWB) is a popular technology to provide high accuracy localization, asset tracking and access control applications. Due to the accurate ranging feature and robustness to relay attacks, car manufacturers are upgrading the keyless entry infrastructure to UWB. As car occupancy monitoring is an essential step to support regulatory requirements and provide customized user experience, we build CarOSense to explore the possibility of reusing UWB keyless infrastructure as an orthogonal sensing modality to detect per-seat car occupancy. CarOSense uses a novel deep learning model, MaskMIMO, to learn spatial\/time features by 2D convolutions and per-seat attentions by a multi-task mask. We collect UWB data from 10 car locations with up to 16 occupancy states in each location. We implement CarOSense as a cross-platform demo and evaluate it in 15 different scenarios, including leave-one-out test of unknown car locations and stress test of unseen scenarios. Results show that the average accuracy is 94.4% for leave-one-out test and 87.0% for stress test. CarOSense is robust in a large set of untrained scenarios with the model trained on a small set of training data. We also benchmark the computation cost and demonstrate that CarOSense is lightweight and can run smoothly in real-time on embedded devices.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411820\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411820<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"87ed5a274c38cd8e5\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#87ed5a274c38cd8e5\" href=\"#87ed5a274c38cd8e5\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cReal-time Travel Time Estimation with Sparse Reliable Surveillance Information\u201d<\/strong>, Wen Zhang, Yag Wang, Xike Xie, Chuancai Ge, Hengchang Lou. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 36.<\/span><\/a><\/h4><\/div><div id=\"87ed5a274c38cd8e5\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Origin-destination (OD) travel time estimation is of paramount importance for applications such as intelligent transportation. In this work, we propose a new solution for OD travel time estimation, with road surveillance camera data. The surveillance information supports accurate and reliable observations at camera-equipped intersections, but is associated with missing and incomplete surveillance records at the camera-free intersections. To overcome this, we propose a modified version of multi-layer graph convolutional networks. The camera surveillance data is used to extract the traffic flow of each intersection, the extracted information serves as the input of the multi-layer GCN based model, based on which the real-time traffic status can be predicted. To enhance the estimation accuracy, we address the effects of various features for the travel time estimation with encoder-decoder networks and embedding techniques. We further improve the generalization of our model by using multi-task learning. Extensive experiments on real datasets are done to verify the effectiveness of our proposals.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380988\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380988<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"322d6844b81b6e076\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#322d6844b81b6e076\" href=\"#322d6844b81b6e076\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cCARIN: Wireless CSI-based Driver Activity Recognition under the Interference of Passengers\u201d<\/strong>, Yunhao Bai, Xiaorui Wang. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 2.<\/span><\/a><\/h4><\/div><div id=\"322d6844b81b6e076\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Recent studies have proposed to use the Channel State Information (CSI) of WiFi wireless channel for human gesture recognition. As an important application, CSI-based driver activity recognition in passenger vehicles has received increasing research attention. However, a serious limitation of almost all the existing WiFi-based recognition solutions is that they can only recognize the activity of a single person at a time, because the activities of other people (if performed at the same time) can interfere with the WiFi signals. In a sharp contrast, there can often be one or more passengers in any vehicles.<br \/>\nIn this paper, we propose CARIN, CSI-based driver Activity Recognition under the INterference of passengers. CARIN features a combination-based solution that profiles all the possible activity combinations of driver and (one or more) passengers in offline training and then performs recognition online. To attack possible combination explosion, we first leverage in-car pressure sensors to significantly reduce combinations, because there are only limited seating options in a passenger vehicle. We then formulate a distance minimization problem for fast runtime recognition. In addition, a period analysis methodology is designed based on the kNN classifier to recognize activities that have a sequence of body movements, like continuous head nodding due to driver fatigue. Our results in a real car with 3,000 real-world traces show that CARIN can achieve an overall F1 score of 90.9%, and outperform the three state-of-the-art solutions by 32.2%.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380992\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380992<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"d754a17a79e254f11\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-13\" data-target=\"#d754a17a79e254f11\" href=\"#d754a17a79e254f11\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cFairCharge: A Data-Driven Fairness-Aware Charging Recommendation System for Large-Scale Electric Taxi Fleets\u201d<\/strong>, Guang Wang, Yongfeng Zhang, Zhihan Fang, Shuai Wang, Fan Zhang, Desheng Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 28.<\/span><\/a><\/h4><\/div><div id=\"d754a17a79e254f11\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Our society is witnessing a rapid taxi electrification process. Compared to conventional gas taxis, a key drawback of electric taxis is their prolonged charging time, which potentially reduces drivers&#8217; daily operation time and income. In addition, insufficient charging stations, intensive charging peaks, and heuristic-based charging station choice of drivers also significantly decrease the charging efficiency of electric taxi charging networks. To improve the charging efficiency (e.g., reduce queuing time in stations) of electric taxi charging networks, in this paper, we design a fairness-aware Pareto efficient charging recommendation system called FairCharge, which aims to minimize the total charging idle time (traveling time + queuing time) in a fleet-oriented fashion combined with fairness constraints. Different from existing works, FairCharge considers fairness as a constraint to potentially achieve long-term social benefits. In addition, our FairCharge considers not only current charging requests, but also possible charging requests of other nearby electric taxis in a near-future duration.<br \/>\nMore importantly, we simulate and evaluate FairCharge with real-world streaming data from the Chinese city Shenzhen, including GPS data and transaction data from more than 16,400 electric taxis, coupled with the data of 117 charging stations, which constitute, to our knowledge, the largest electric taxi network in the world.<br \/>\nThe extensive experimental results show that our fairness-aware FairCharge effectively reduces queuing time and idle time of the Shenzhen electric taxi fleet by 80.2% and 67.7%, simultaneously.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381003\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381003<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-23\"><h4 id=\"session5b\" style=\"margin-bottom: 0px;\"><b>Session 5B:<\/b> \u2018Speech interaction + Fabrication\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Wednesday, September 16, 2020 18:00-19:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-15 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-15 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VefyZroyR78lmwhhww-ZBSB\"><span class=\"fusion-button-text\">View Session 5B Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-14 .fusion-panel:hover, #accordion-873-14 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-14 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-14 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-14 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-14 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-14 .panel-title a:hover, #accordion-873-14 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-14 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-14 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-14\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"bc3309ac3ea8f00b1\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#bc3309ac3ea8f00b1\" href=\"#bc3309ac3ea8f00b1\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cOptiStructures: Fabrication of Room-Scale Interactive Structures with Embedded Fiber Bragg Grating Optical Sensors and Displays\u201d<\/strong>, Saiganesh Swaminathan, Jonathon Fagert, Michael Rivera, Andrew Cao, Gierad Laput, Hae Young Noh, Scott E Hudson. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 50.<\/span><\/a><\/h4><\/div><div id=\"bc3309ac3ea8f00b1\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">A recent topic of considerable interest in the &#8220;smart building&#8221; community involves building interactive devices using sensors and rapidly creating these objects using new fabrication methods. However, much of this work has been done at what might be called hand scale, with less attention paid to larger objects and structures (at furniture or room scales) despite the fact that we are very often literally surrounded by such objects. In this work, we present a new set of techniques for creating interactive objects at these scales. We demonstrate the fabrication of both input sensors and displays directly into cast materials &#8212; those formed from a liquid or paste which solidifies in a mold; including, for example: concrete, plaster, polymer resins, and composites.<\/p>\n<p>Through our novel set of sensing and fabrication techniques, we enable human activity recognition at room-scale and across a variety of materials. Our techniques create objects that appear the same as typical passive objects, but contain internal fiber optics for both input sensing and simple displays. We use a new fabrication device to inject optical fibers into CNC milled molds. Fiber Bragg Grating optical sensors configured as very sensitive vibration sensors are embedded in these objects. These require no internal power, can be placed at multiple locations along with a single fiber, and can be interrogated from the end of the fiber. We evaluate the performance of our system by creating two full-scale application prototypes: an interactive wall, and an interactive table. With these prototypes, we demonstrate the ability of our system to sense a variety of human activities across eight different users. Our tests show that with suitable materials these sensors can detect and classify both direct interactions (such as tapping) and more subtle vibrations caused by activities such as walking across the floor nearby.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397310\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397310<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"ea34830a7294a4999\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#ea34830a7294a4999\" href=\"#ea34830a7294a4999\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cSilver Tape: Inkjet-Printed Circuits Peeled-and-Transferred on Versatile Substrates\u201d<\/strong>, Tingyu Cheng, Koya Narumi, Youngwook Do, Yang Zhang, Tung D. Ta, Takuya Sasatani, Eric Markvicka, Yoshihiro Kawahara, Lining Yao, Gregory D. Abowd, Hyunjoo Oh. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 6.<\/span><\/a><\/h4><\/div><div id=\"ea34830a7294a4999\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">We propose Silver Tape, a simple yet novel fabrication technique to transfer inkjet-printed silver traces from paper onto versatile substrates, without time-\/space- consuming processes such as screen printing or heat sintering. This allows users to quickly implement silver traces with a variety of properties by exploiting a wide range of substrates. For instance, high flexibility can be achieved with Scotch tape, high transparency with polydimethylsiloxane (PDMS), heat durability with Kapton polyimide tape, water solubility with 3M water-soluble tape, and beyond. Many of these properties are not achievable with conventional substrates that are used for inkjet-printing conductive traces. Specifically, our technique leverages the commonly undesired low adhesion property of the inkjet printing films and repurposes these films as temporary transfer media. We describe our fabrication methods with a library of materials we can utilize, evaluate the mechanical and electrical properties of the transferred traces, and conclude with several demonstrative applications. We believe Silver Tape enriches novel interactions for the ubiquitous computing domain, by enabling digital fabrication of electronics on versatile materials, surfaces, and shapes.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381013\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381013<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"19938c69f6e9f25ce\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#19938c69f6e9f25ce\" href=\"#19938c69f6e9f25ce\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cFLECTILE: 3D-Printable Soft Actuators for Wearable Computing\u201d<\/b>, Likun Fang, Tobias R\u00f6ddiger, Hongye Sun, Norbert Willenbacher, Michael Beigl, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"19938c69f6e9f25ce\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Rapid prototyping and fast manufacturing processes are critical drivers for implementing wearable devices. This paper shows an exemplary method for building flexible, fully elastomeric, vibrotactile electromagnetic actuators based on the Lorentz force law.<br \/>\nThis paper also introduces the design parameters required for well-functioning actuators and studies the properties of such actuators. The crucial element of actuator is a helical planer coil manufactured from &#8220;capillary&#8221; silver TPU (Thermoplastic polyurethane), an ultra-stretchable conductor. This paper leverages the novel material to manufacture soft vibration actuators in fewer and simpler steps than previous approaches. Best practice and procedure for building a wearable actuator are reported. We show that dimension of actuators are easily configurable and can be printed in batch-size-one using 3D printing. Actuators can be attached directly to the skin as all the components of FLECTILE are made from biocompatible polymers. Tests on the driving properties have confirmed that the actuator could reach a broad scope of frequency up to 200 Hz with a small voltage (5 V) required. A user study showed that vibrations of the actuator are well perceivable by six study participants under an observing, hovering, and resting condition.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414307\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414307<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"8059d125afb998de4\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#8059d125afb998de4\" href=\"#8059d125afb998de4\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cBraceIO: Biosensing through Hydrogel Dental Ligatures\u201d<\/b>, Eldy S. Lazaro Vasquez, Ali Yetisen, Katia Vega, Brief, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"8059d125afb998de4\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Dental braces are a semi-permanent dental treatment that are in direct contact with our metabolism (saliva), food and liquids we ingest, and our environment while smiling or talking. This paper introduces braceIO, biochemical ligatures on dental braces that change colors depending on saliva concentration levels (pH, nitric oxide and acid uric), and can be read by an external device. This work presents our fabrication process of the ligatures and external device, and the technical evaluation of the absorption time, colorimetric measurement tests and the color map to the biosensor level in the app. This project aims to maintain the shape, wearability and aesthetics of traditional ligatures but with embedded biosensors. We propose a novel device that senses metabolism changes with a different biosensor ligature worn in each tooth to access multiple biodata and create seamless interactive devices.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414290\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414290<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"da31b23f639c25076\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#da31b23f639c25076\" href=\"#da31b23f639c25076\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201c\u201cHe Is Just Like Me\u201d: A Study of the Long-Term Use of Smart Speakers by Parents and Children\u201d<\/strong>, Radhika Garg, Subhasree Sengupta. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 11.<\/span><\/a><\/h4><\/div><div id=\"da31b23f639c25076\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Over the past few years, the technological vision of the HCI and UbiComp communities regarding conversational devices has become manifest in the form of smart speakers such as Google Home and Amazon Echo. Even though millions of households have adopted and integrated these devices into their daily lives, we lack a deep understanding of how different members of a household use such devices. To this end, we conducted interviews with 18 families and collected their Google Home Activity logs to understand the usage patterns of adults and children. Our findings reveal that there are substantial differences in the ways smart speakers are used by adults and children in families over an extended period of time. We report on how parents influence children&#8217;s use and how different users perceive the devices. Finally, we discuss the implications of our findings and provide guidelines for improving the design of future smart speakers and conversational agents.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3381002\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3381002<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"358a067109cbd5fd8\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#358a067109cbd5fd8\" href=\"#358a067109cbd5fd8\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cEchoWhisper: Exploring an Acoustic-based Silent Speech Interface for Smartphone Users\u201d<\/strong>, Yang Gao, Yincheng Jin, Jiyang Li, Seokmin Choi, Zhanpeng Jin. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 80.<\/span><\/a><\/h4><\/div><div id=\"358a067109cbd5fd8\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">With the rapid growth of artificial intelligence and mobile computing, intelligent speech interface has recently become one of the prevalent trends and has already presented huge potentials to the public. To address the privacy leakage issue during the speech interaction or accommodate some special demands, silent speech interfaces have been proposed to enable people&#8217;s communication without vocalizing their sound (e.g., lip reading, tongue tracking). However, most existing silent speech mechanisms require either background illuminations or additional wearable devices. In this study, we propose the EchoWhisper as a novel user-friendly, smartphone-based silent speech interface. The proposed technique takes advantage of the micro-Doppler effect of the acoustic wave resulting from mouth and tongue movements and assesses the acoustic features of beamformed reflected echoes captured by the dual microphones in the smartphone. Using human subjects who perform a daily conversation task with over 45 different words, our system can achieve a WER (word error rate) of 8.33%, which shows the effectiveness of inferring silent speech content. Moreover, EchoWhisper has also demonstrated its reliability and robustness to a variety of configuration settings and environmental factors, such as smartphone orientations and distances, ambient noises, body motions, and so on.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411830\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411830<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"6428b896badc899f5\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#6428b896badc899f5\" href=\"#6428b896badc899f5\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cUsing Sonar for Liveness Detection to Protect Smart Speakers against Remote Attackers\u201d<\/strong>, Yeonjoon Lee, Yue Zhao, Jiutian Zeng, Kwangwuk Lee, Nan Zhang, Faysal Hossain Shezan, Yuan Tian, Kai Chen, Xiaofeng Wang. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 16.<\/span><\/a><\/h4><\/div><div id=\"6428b896badc899f5\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Smart speakers, which wait for voice commands and complete tasks for users, are becoming part of common households. While voice commands came with basic functionalities in the earlier days, as the market grew, various commands with critical functionalities were developed; e.g., access banking services, send money, open front door. Such voice commands can cause serious consequences once smart speakers are attacked. Recent research shows that smart speakers are vulnerable to malicious voice commands sent from other speakers (e.g., TV, baby monitor, radio) in the same area. In this work, we propose the SPEAKER-SONAR, a sonar-based liveness detection system for smart speakers. Our approach aims to protect the smart speakers from remote attackers that leverage network-connected speakers to send malicious commands. The key idea of our approach is to make sure that the voice command is indeed coming from the user. For this purpose, the SPEAKER-SONAR emits an inaudible sound and tracks the user&#8217;s direction to compare it with the direction of the received voice command. The SPEAKER-SONAR does not require additional action from the user and works through an automatic consistency check. We built the SPEAKER-SONAR on a raspberry pi 3b, a circular microphone array, and a commodity speaker by imitating the Amazon Echo. Our evaluation shows that the SPEAKER-SONAR can reject remote voice attacks with an average accuracy of 95.5% in 2 meters, which significantly raises the bar for remote attackers. To the best of our knowledge, our defense is able to defend against known remote voice attack techniques.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380991\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380991<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"6892c13a996badbe4\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#6892c13a996badbe4\" href=\"#6892c13a996badbe4\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cInvestigating Users\u2019 Preferences and Expectations for Always-Listening Voice Assistants\u201d<\/strong>, Madiha Tabassum, Tomasz Kosi\u0144ski, Alisa Frik, Nathan Malkin, Primal Wijesekera, Serge Egelman, Heather Lipford. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 153.<\/span><\/a><\/h4><\/div><div id=\"6892c13a996badbe4\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Many consumers now rely on different forms of voice assistants, both stand-alone devices and those built into smartphones. Currently, these systems react to specific wake-words, such as &#8220;Alexa,&#8221; &#8220;Siri,&#8221; or &#8220;Ok Google.&#8221; However, with advancements in natural language processing, the next generation of voice assistants could instead always listen to the acoustic environment and proactively provide services and recommendations based on conversations without being explicitly invoked. We refer to such devices as &#8220;always listening voice assistants&#8221; and explore expectations around their potential use. In this paper, we report on a 178-participant survey investigating the potential services people anticipate from such a device and how they feel about sharing their data for these purposes. Our findings reveal that participants can anticipate a wide range of services pertaining to a conversation; however, most of the services are very similar to those that existing voice assistants currently provide with explicit commands. Participants are more likely to consent to share conversation when they do not find it sensitive, they are comfortable with the service and find it beneficial, and when they already own a stand-alone voice assistant. Based on our findings we discuss the privacy challenges in designing an always-listening voice assistant.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369807\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369807<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f059f9b4fc3a047a7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#f059f9b4fc3a047a7\" href=\"#f059f9b4fc3a047a7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cAssumptions Checked: How Families Learn About and Use the Echo Dot\u201d<\/strong>, Erin Beneteau, Yini Guan, Olivia K. Richards, Mingrui Ray Zhang, Julie A. Kientz, Jason Yip, Alexis Hiniker. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 3.<\/span><\/a><\/h4><\/div><div id=\"f059f9b4fc3a047a7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Users of voice assistants often report that they fall into patterns of using their device for a limited set of interactions, like checking the weather and setting alarms. However, it\u2019s not clear if limited use is, in part, due to lack of learning about the device\u2019s functionality. We recruited 10 diverse families to participate in a one-month deployment study of the Echo Dot, enabling us to investigate: 1) which features families are aware of and engage with, and 2) how families explore, discover, and learn to use the Echo Dot. Through audio recordings of families\u2019 interactions with the device and pre- and post-deployment interviews, we find that families\u2019 breadth of use decreases steadily over time and that families learn about functionality through trial and error, asking the Echo Dot about itself, and through outside influencers such as friends and family. Formal outside learning influencers, such as manufacturer emails, are less influential. Drawing from diffusion of innovation theory, we describe how a home-based voice interface might be positioned as a near-peer to the user, and that by describing its own functionality using just-in-time learning, the home-based voice interface becomes a trustworthy learning influencer from which users can discover new functionalities.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380993\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380993<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"4cc8db096255766b4\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-14\" data-target=\"#4cc8db096255766b4\" href=\"#4cc8db096255766b4\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cWhat If Conversational Agents Became Invisible? Comparing Users\u2019 Mental Models According to Physical Entity of AI Speaker\u201d<\/strong>, Sunok Lee, Minji Cho, Sangsu Lee. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 88.<\/span><\/a><\/h4><\/div><div id=\"4cc8db096255766b4\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The popularity of conversational agents (CAs) in the form of AI speakers that support ubiquitous smart homes has increased because of their seamless interaction. However, recent studies have revealed that the use of AI speakers decreases over time, which shows that current agents do not fully support smart homes. Because of this problem, the possibility of unobtrusive, invisible intelligence without a physical device has been suggested. To explore CA design direction that enhances the user experience in smart homes, we aimed to understand each feature by comparing an invisible agent with visible ones embedded in stand-alone AI speakers. We conducted a drawing study to examine users\u2019 mental models formed through communicating with two different physical entities (i.e., visible and invisible CAs). From the drawings, interviews, and surveys, we identified how users\u2019 mental models and interactions differed depending on the presence of a physical entity. We found that a physical entity affected users\u2019 perceptions, expectations, and interactions toward the agent.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411840\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411840<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:15px;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-24\"><h4 id=\"session5c\" style=\"margin-bottom: 0px;\"><b>Session 5C:<\/b> \u2018Human Activity Recognition II\u2019<\/h4>\n<h5 style=\"margin-top: 0px;\">Wednesday, September 16, 2020 18:00-19:30 EDT<\/h5>\n<div class=\"fusion-button-wrapper\"><style type=\"text\/css\">.fusion-button.button-16 {border-radius:4px;}<\/style><a class=\"fusion-button button-flat fusion-button-default-size button-default button-16 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.youtube.com\/playlist?list=PLqhXYFYmZ-VfcQX5Bk_pcpDSsHT6qP9K9\"><span class=\"fusion-button-text\">View Session 5C Presentations<\/span><\/a><\/div>\n<p>&nbsp;<\/p>\n<\/div><style type=\"text\/css\">#accordion-873-15 .fusion-panel:hover, #accordion-873-15 .fusion-panel.hover{ background-color: #f9f9fb } #accordion-873-15 .fusion-panel { border-color:#e2e2e2; border-width:1px; background-color:#ffffff; }.fusion-accordian  #accordion-873-15 .panel-title a .fa-fusion-box{ color: #ffffff;}.fusion-accordian  #accordion-873-15 .panel-title a .fa-fusion-box:before{ font-size: 13px; width: 13px;}.fusion-accordian  #accordion-873-15 .fa-fusion-box { background-color: #212934;border-color: #212934;}.fusion-accordian  #accordion-873-15 .panel-title a:hover, #accordion-873-15 .fusion-toggle-boxed-mode:hover .panel-title a { color: #37408b;}.fusion-accordian  #accordion-873-15 .panel-title .active .fa-fusion-box,.fusion-accordian  #accordion-873-15 .panel-title a:hover .fa-fusion-box { background-color: #37408b!important;border-color: #37408b!important;}<\/style><div class=\"accordian fusion-accordian\"><div class=\"panel-group\" id=\"accordion-873-15\" role=\"tablist\"><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"01049cf539e266064\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#01049cf539e266064\" href=\"#01049cf539e266064\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cGlobalFusion: A Global Attentional Deep Learning Framework for Multisensor Information Fusion\u201d<\/strong>, Shengzhong Liu, Shuochao Yao, Jinyang Li, Dongxin Liu, Tianshi Wang, Huajie Shao, Tarek Abdelzaher. 2020 Proc. ACM IMWUT. Volume 4, Issue 1, Article 19.<\/span><\/a><\/h4><\/div><div id=\"01049cf539e266064\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The paper enhances deep-neural-network-based inference in sensing applications by introducing a lightweight attention mechanism called the global attention module for multi-sensor information fusion. This mechanism is capable of utilizing information collected from higher layers of the neural network to selectively amplify the influence of informative features and suppress unrelated noise at the fusion layer. We successfully integrate this mechanism into a new end-to-end learning framework, called GlobalFusion, where two global attention modules are deployed for spatial fusion and sensing modality fusion, respectively. Through an extensive evaluation on four public human activity recognition (HAR) datasets, we successfully demonstrate the effectiveness of GlobalFusion at improving information fusion quality. The new approach outperforms the state-of-the-art algorithms on all four datasets with a clear margin. We also show that the learned attention weights agree well with human intuition. We then validate the efficiency of GlobalFusion by testing its inference time and energy consumption on commodity IoT devices. Only a negligible overhead is induced by the global attention modules.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3380999\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3380999<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"31854b28ad3415ca8\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#31854b28ad3415ca8\" href=\"#31854b28ad3415ca8\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cLimbMotion: Decimeter-level Limb Tracking for Wearable-based Human-Computer Interaction\u201d<\/strong>, Han Zhou, Yi Gao, Xinyi Song, Wenxin Liu, Wei Dong. 2019 Proc. ACM IMWUT. Volume 3, Issue 4, Article 161.<\/span><\/a><\/h4><\/div><div id=\"31854b28ad3415ca8\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Wearable-based human-computer interaction is a promising technology to enable various applications. This paper aims to track the 3D posture of the entire limb, both wrist\/ankle and elbow\/knee, of a user wearing a smart device. This limb tracking technology can trace the geometric motion of the limb, without introducing any training stage usually required in gesture recognition approaches. Nonetheless, the tracked limb motion can also be used as a generic input for gesture-based applications. The 3D posture of a limb is defined by the relative positions among main joints, e.g., shoulder, elbow, and wrist for an arm. When a smartwatch is worn on the wrist of a user, its position is affected by both elbow and shoulder motions. It is challenging to infer the entire 3D posture when only given a single point of sensor data from the smartwatch. In this paper, we propose LimbMotion, an accurate and real-time limb tracking system. The performance gain of LimbMotion comes from multiple key technologies, including an accurate attitude estimator based on a novel two-step filter, fast acoustic ranging, and point clouds-based positioning. We implemented LimbMotion and evaluated its performance using extensive experiments, including different gestures, moving speeds, users, and limbs. Results show that LimbMotion achieves real-time tracking with a median error of 7.5cm to 8.9cm, which outperforms the state-of-the-art approach by about 32%.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3369836\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3369836<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"c30620b1010f2cf47\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#c30620b1010f2cf47\" href=\"#c30620b1010f2cf47\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cVibroSense: Recognizing home activities by deep learning subtle vibrations on an interior surface of a house from a single point usingLaser Doppler Vibrometry\u201d<\/strong>, Wei Sun, Tuochao Chen, Jiayi Zheng, Zhenyu Lei, Lucy Wang, Benjamin Steeper, Peng He, Matthew Dressa, Feng Tian, Cheng Zhang. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 96.<\/span><\/a><\/h4><\/div><div id=\"c30620b1010f2cf47\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Smart homes of the future are envisioned to have the ability to recognize many types of home activities such as running a washing machine, flushing the toilet, and using a microwave. In this paper, we present a new sensing technology, VibroSense, which is able to recognize 18 different types of activities throughout a house by observing structural vibration patterns on a wall or ceiling using a laser Doppler vibrometer. The received vibration data is processed and sent to a deep neural network which is trained to distinguish between 18 activities. We conducted a system evaluation, where we collected data of 18 home activities in 5 different houses for 2 days in each house. The results demonstrated that our system can recognize 18 home activities with an average accuracy of up to 96.6%. After re-setup of the device on the second day, the average recognition accuracy decreased to 89.4%. We also conducted follow-up experiments, where we evaluated VibroSense under various scenarios to simulate real-world conditions. These included simulating online recognition, differentiating between specific stages of a device\u2019s activity, and testing the effects of shifting the laser\u2019s position during re-setup. Based on these results, we discuss the opportunities and challenges of applying VibroSense in real-world applications.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411828\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411828<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"a9af83982bc512f9e\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#a9af83982bc512f9e\" href=\"#a9af83982bc512f9e\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cSyncWISE: Window Induced Shift Estimation for Synchronization ofVideo and Accelerometry from Wearable Sensors\u201d<\/strong>, Yun Zhang, Shibo Zhang, Santosh Kumar, James M. Rehg, Nabil Alshurafa, Bonnie Spring, Miao Liu, Elyse Daly, Samuel Battalio. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 107.<\/span><\/a><\/h4><\/div><div id=\"a9af83982bc512f9e\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The development and validation of computational models to detect daily human behaviors (e.g., eating, smoking, brushing) using wearable devices requires labeled data collected from the natural field environment, with tight time synchronization of the micro-behaviors (e.g., start\/end times of hand-to-mouth gestures during a smoking puff or an eating gesture) and the associated labels. Video data is increasingly being used for such label collection. Unfortunately, wearable devices and video cameras with independent (and drifting) clocks make tight time synchronization challenging. To address this issue, we present the Window Induced Shift Estimation method for Synchronization (SyncWISE) approach. We demonstrate the feasibility and effectiveness of our method by synchronizing the timestamps of a wearable camera and wearable accelerometer from 163 videos representing 45.2 hours of data from 21 participants enrolled in a real-world smoking cessation study. Our approach shows significant improvement over the state-of-the-art, even in the presence of high data loss, achieving 91 synchronization accuracy given a synchronization tolerance of 700 milliseconds. Our method also achieves state-of-the-art synchronization performance on the CMU-MMAC dataset.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411824\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411824<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"b845b02c6f30dbfba\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#b845b02c6f30dbfba\" href=\"#b845b02c6f30dbfba\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cESPRESSO: Entropy and Shape Aware Time Series Segmentation for Processing Heterogeneous Sensor Data\u201d<\/strong>, Shohreh Deldari, Daniel Smith, Amin Sadri, Flora D Salim. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 77.<\/span><\/a><\/h4><\/div><div id=\"b845b02c6f30dbfba\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Extracting informative and meaningful temporal segments from high-dimensional wearable sensor data, smart devices, or IoT data is a vital preprocessing step in applications such as Human Activity Recognition (HAR), trajectory prediction, gesture recognition, and lifelogging. In this paper, we propose ESPRESSO (Entropy and ShaPe awaRe timE-Series SegmentatiOn), a hybrid segmentation model for multi-dimensional time-series that is formulated to exploit the entropy and temporal shape properties of time-series. ESPRESSO differs from existing methods that focus upon particular statistical or temporal properties of time-series exclusively. As part of model development, a novel temporal representation of time-series \ud835\udc4a\ud835\udc36\ud835\udc34\ud835\udc36 was introduced along with a greedy search approach that estimate segments based upon the entropy metric.ESPRESSOwasshown to offer superior performance to four state-of-the-art methods across seven public datasets of wearable and wear-free sensing. In addition, we undertake a deeper investigation of these datasets to understand how ESPRESSO and its constituent methods perform with respect to different dataset characteristics. Finally, we provide two interesting case-studies to show how applying ESPRESSO can assist in inferring daily activity routines and the emotional state of humans.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411832\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411832<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"f67a80352da116c0f\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#f67a80352da116c0f\" href=\"#f67a80352da116c0f\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cRobust Unsupervised Factory Activity Recognition with Body-worn Accelerometer Using Temporal Structure of Multiple Sensor Data Motifs\u201d<\/strong>, Qingxin Xia, Joseph Korpela, Yasuo Namioka, Takuya Maekawa. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 97.<\/span><\/a><\/h4><\/div><div id=\"f67a80352da116c0f\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">This paper presents a robust unsupervised method for recognizing factory work using sensor data from body-worn acceleration sensors.<br \/>\nIn line-production systems, each factory worker repetitively performs a predefined work process with each process consisting of a sequence of operations.<br \/>\nBecause of the difficulty in collecting labeled sensor data from each factory worker, unsupervised factory activity recognition has been attracting attention in the ubicomp community.<br \/>\nHowever, prior unsupervised factory activity recognition methods can be adversely affected by any outlier activities performed by the workers.<br \/>\nIn this study, we propose a robust factory activity recognition method that tracks frequent sensor data motifs, which can correspond to particular actions performed by the workers, that appear in each iteration of the work processes.<br \/>\nSpecifically, this study proposes tracking two types of motifs: period motifs and action motifs, during the unsupervised recognition process.<br \/>\nA period motif is a unique data segment that occurs only once in each work period (one iteration of an overall work process).<br \/>\nAn action motif is a data segment that occurs several times in each work period, corresponding to an action that is performed several times in each period.<br \/>\nTracking multiple period motifs enables us to roughly capture the temporal structure and duration of the work period even when outlier activities occur.<br \/>\nAction motifs, which are spread throughout the work period, permit us to precisely detect the start time of each operation.<br \/>\nWe evaluated the proposed method using sensor data collected from workers in actual factories and achieved state-of-the-art performance.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411835\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411835<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"eb776716c72bfd6ac\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#eb776716c72bfd6ac\" href=\"#eb776716c72bfd6ac\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cIMUTube: Automatic extraction of virtual on-body accelerometry from video for human activity recognition\u201d<\/strong>, Hyeokhyen Kwon, Catherine Tong, Harish Haresamudram, Yan Gao, Nicholas D Lane, Gregory D Abowd, Thomas Ploetz. 2020 Proc. ACM IMWUT. Volume 4, Issue 3, Article 87.<\/span><\/a><\/h4><\/div><div id=\"eb776716c72bfd6ac\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">The lack of large-scale, labeled data sets impedes progress in developing robust and generalized predictive models for on-body sensor-based human activity recognition (HAR). Labeled data in human activity recognition is scarce and hard to come by, as sensor data collection is expensive, and the annotation is time-consuming and error-prone. To address this problem, we introduce IMUTube, an automated processing pipeline that integrates existing computer vision and signal processing techniques to convert videos of human activity into virtual streams of IMU data. These virtual IMU streams represent accelerometry at a wide variety of locations on the human body. We show how the virtually-generated IMU data improves the performance of a variety of models on known HAR datasets. Our initial results are very promising, but the greater promise of this work lies in a collective approach by the computer vision, signal processing, and activity recognition communities to extend this work in ways that we outline. This should lead to on-body, sensor-based HAR becoming yet another success story in large-dataset breakthroughs in recognition.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3411841\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3411841<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"59baf1f2472cca3e7\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#59baf1f2472cca3e7\" href=\"#59baf1f2472cca3e7\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><strong>\u201cLeveraging Polarization of WiFi Signals to Simultaneously Track Multiple People\u201d<\/strong>, Raghav H. Venkatnarayan, Muhammad Shahzad, Sangki Yun, Christina Vlachou, Kyu-Han Kim. 2020 Proc. ACM IMWUT. Volume 4, Issue 2, Article 45.<\/span><\/a><\/h4><\/div><div id=\"59baf1f2472cca3e7\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">This paper presents WiPolar, an approach that simultaneously tracks multiple people using commodity WiFi devices. While two recent papers have also demonstrated multi-person tracking using commodity devices, they either require the people to continuously keep moving without stopping, and\/or require the number of people to be input manually, and\/or keep the WiFi devices from performing their primary function of data communication. Motivated by the increasing availability of polarized antennas on modern WiFi devices, WiPolar leverages signal polarization to perform accurate multi-person tracking using commodity devices while addressing the three limitations of prior work mentioned above. The key insight that WiPolar is based on is that different people expose different instantaneous horizontal and vertical radar cross-sections to WiFi transmitters due to differences in their physiques and orientations with respect to the transmitter. This enables WiPolar to accurately separate the multipaths reflected from different people, which, in turn, allows it to track them simultaneously. To the best of our knowledge, this is the first work that leverages polarization of WiFi signals to localize and track people. We implement WiPolar using commodity WiFi devices and extensively evaluate it for tracking up to five people in three different environments. Our results show that WiPolar achieved a median tracking error of just 56cm across all experiments. It also accurately tracks people even when they were not moving. WiPolar achieved a median tracking error of 74cm for people that were either stationary or just taking a small pause.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3397317\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3397317<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"9d2a4dffcf21aadd2\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#9d2a4dffcf21aadd2\" href=\"#9d2a4dffcf21aadd2\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cTowards Deep Clustering of Human Activities from Wearables\u201d<\/b>, Alireza Abedin, Farbod T. Motlagh, Qinfeng Shi, Hamid Rezatofighi, Damith Ranasinghe, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"9d2a4dffcf21aadd2\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Our ability to exploit low-cost wearable sensing modalities for critical human behaviour and activity monitoring applications in health and wellness is reliant on supervised learning regimes; here, deep learning paradigms have proven extremely successful in learning activity representations from annotated data. However, the costly work of gathering and annotating sensory activity datasets is labor intensive, time consuming and not scalable to large volumes of data. While existing unsupervised remedies of deep clustering leverage network architectures and optimization objectives that are tailored for static image datasets, deep architectures to uncover cluster structures from raw sequence data captured by on-body sensors remains largely unexplored. In this paper, we develop an unsupervised end-to-end learning strategy for the fundamental problem of human activity recognition (HAR) from wearables. Through extensive experiments, including comparisons with existing methods, we show the effectiveness of our approach to jointly learn unsupervised representations for sensory data and generate cluster assignments with strong semantic correspondence to distinct human activities.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414312\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414312<\/a><\/div><\/div><\/div><div class=\"fusion-panel panel-default fusion-toggle-no-divider fusion-toggle-boxed-mode\" role=\"tabpanel\"><div class=\"panel-heading\"><h4 class=\"panel-title toggle\"><a aria-expanded=\"false\" aria-selected=\"false\" aria-controls=\"6ce01e5efa577d31d\" role=\"tab\" data-toggle=\"collapse\" data-parent=\"#accordion-873-15\" data-target=\"#6ce01e5efa577d31d\" href=\"#6ce01e5efa577d31d\"><span class=\"fusion-toggle-icon-wrapper\" aria-hidden=\"true\"><i class=\"fa-fusion-box\" aria-hidden=\"true\"><\/i><\/span><span class=\"fusion-toggle-heading\"><b>\u201cDigging Deeper: Towards a better Understanding of Transfer Learning for Human Activity Recognition\u201d<\/b>, Alexander H\u00f6lzemann, Kristof Van Laerhoven, Note, Proc. ISWC 2020.<\/span><\/a><\/h4><\/div><div id=\"6ce01e5efa577d31d\" class=\"panel-collapse collapse \"><div class=\"panel-body toggle-content fusion-clearfix\">Transfer Learning is becoming increasingly important to the Human Activity Recognition community, as it enables algorithms to reuse what has already been learned from models. It promises shortened training times and increased classification results for new datasets and activity classes. However, the question of what exactly is transferred is not dealt with in detail in many of the recent publications, and it is furthermore often difficult to reproduce the presented results. Therefore we would like to contribute with this paper to the understanding of transfer learning for sensor-based human activity recognition.<br \/>\nIn our experiment use weight transfer to transfer models between two datasets, as well as between sensors from the same dataset. As source- and target- datasets PAMAP2 and Skoda Mini Checkpoint are used. The utilized network architecture is based on a DeepConvLSTM.<br \/>\nThe result of our investigation shows that transfer learning has to be considered in a very differentiated way, since the desired positive effects by applying the method depend very much on the data and also on the architecture used.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.1145\/3410531.3414311\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/doi.org\/10.1145\/3410531.3414311<\/a><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-text fusion-text-25\"><p><!-- \/AUTOMATICALLY GENERATED --><\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-2 fusion_builder_column_1_5 1_5 fusion-one-fifth fusion-column-last\" style=\"width:20%;width:calc(20% - ( ( 4% ) * 0.2 ) );margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-2 fusion-sep-none fusion-title-text fusion-title-size-three\" style=\"font-size:24px;margin-top:10px;margin-bottom:15px;\"><h3 class=\"title-heading-left\" style=\"margin:0;font-size:1em;color:#37408b;\">IMPORTANT DATES<\/h3><\/div><div class=\"fusion-text fusion-text-26\" style=\"font-size:14px;\"><p>Virtual Conference:\n<strong>September 12-17, 2020<\/strong><\/p>\n<\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:-0.9em;margin-bottom:0.1em;width:100%;\"><div class=\"fusion-separator-border sep-single sep-solid\" style=\"border-color:#d1d1d1;border-top-width:1px;\"><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-27\" style=\"font-size:14px;\"><p>Paper Sessions:\n<strong>September 14-17, 2020<\/strong><\/p>\n<\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:20PX;width:100%;\"><\/div><div class=\"fusion-sep-clear\"><\/div><style type=\"text\/css\"><\/style><div class=\"fusion-title title fusion-title-3 fusion-sep-none fusion-title-text fusion-title-size-three\" style=\"font-size:24px;margin-top:10px;margin-bottom:15px;\"><h3 class=\"title-heading-left\" style=\"margin:0;font-size:1em;color:#37408b;\">CONTACT<\/h3><\/div><div class=\"fusion-text fusion-text-28\" style=\"font-size:14px;\"><p><a href=\"mailto:programchairs-2020@ubicomp.org\">programchairs-2020@ubicomp.org<\/a><\/p>\n<\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"margin-left: auto;margin-right: auto;margin-top:-0.9em;margin-bottom:0.1em;width:100%;\"><div class=\"fusion-separator-border sep-single sep-solid\" style=\"border-color:#d1d1d1;border-top-width:1px;\"><\/div><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-text fusion-text-29\" style=\"font-size:14px;\"><p><a href=\"mailto:programchairs-2020@iswc.net\">programchairs-2020@iswc.net<\/a><\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-3 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"background-color: #37408b;background-position: center center;background-repeat: no-repeat;padding-top:20px;padding-right:50px;padding-bottom:50px;padding-left:50px;margin-bottom: 0px;margin-top: 0px;border-width: 0px 0px 0px 0px;border-color:#e2e2e2;border-style:solid;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-3 fusion_builder_column_1_4 1_4 fusion-one-fourth fusion-column-first\" style=\"width:25%;width:calc(25% - ( ( 4% ) * 0.25 ) );margin-right: 4%;margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 40px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-30\"><h2 style=\"margin: 0px; color: white;\"><a style=\"color: white;\" href=\"https:\/\/iswc.hosting2.acm.org\/iswc20\/\">ISWC<\/a><\/h2>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-4 fusion_builder_column_3_4 3_4 fusion-three-fourth fusion-column-last\" style=\"width:75%;width:calc(75% - ( ( 4% ) * 0.75 ) );margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-31\"><h4><span style=\"color: #ffffff; margin-top: 0px !important;\">Past Conferences<\/span><\/h4>\n<p><span style=\"color: #ffffff !important;\">The ACM international joint conference on pervasive and ubiquitous computing (ubicomp) is the result of a merger of the two most renowned conferences in the field: pervasive and ubicomp. while it retains the name of the latter in recognition of the visionary work of mark weiser, its long name reflects the dual history of the new event. a complete list of both ubicomp and pervasive past conferences is provided below.<\/span><\/p>\n<\/div><div class=\"fusion-builder-row fusion-builder-row-inner fusion-row\"><div class=\"fusion-layout-column fusion_builder_column_inner fusion-builder-nested-column-0 fusion_builder_column_inner_1_2 1_2 fusion-one-half fusion-column-first\" style=\"width:50%;width:calc(50% - ( ( 4% ) * 0.5 ) );margin-right: 4%;margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-32\"><p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc19\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2019<\/strong><\/a>, London, England<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc18\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2018<\/strong><\/a>, Singapore<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc17\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2017<\/strong><\/a>, Maui, USA<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc16\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2016<\/strong><\/a>, Heidelberg, Germany<br \/>\n<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a href=\"http:\/\/www.iswc.net\/iswc15\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong><span style=\"color: #ffffff;\">ISWC 2015<\/span><\/strong><\/a>, Osaka, Japan<\/span><\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column_inner fusion-builder-nested-column-1 fusion_builder_column_inner_1_2 1_2 fusion-one-half fusion-column-last\" style=\"width:50%;width:calc(50% - ( ( 4% ) * 0.5 ) );margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-text fusion-text-33\"><p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc14\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2014<\/strong><\/a>, Seattle, USA<br \/>\n<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc13\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2013<\/strong><\/a>, Zurich, Switzerland<br \/>\n<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc12\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2012<\/strong><\/a>, Newcastle, England<br \/>\n<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/www.iswc.net\/iswc11\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2011<\/strong><\/a>, San Francisco, USA<br \/>\n<\/span><\/p>\n<p><span style=\"color: #ffffff!important;\"><a style=\"color: #ffffff!important;\" href=\"http:\/\/web.archive.org\/web\/20100725055813\/http:\/\/www.iswc.net\/iswc10\/inc_html\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>ISWC 2010<\/strong><\/a>, Seoul, Korea<br \/>\n<\/span><\/p>\n<\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column_inner fusion-builder-nested-column-2 fusion_builder_column_inner_1_2 1_2 fusion-one-half fusion-column-first\" style=\"width:50%;width:calc(50% - ( ( 4% ) * 0.5 ) );margin-right: 4%;margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"fusion-alignleft\"><style type=\"text\/css\">.fusion-button.button-17 .fusion-button-text, .fusion-button.button-17 i {color:#c83273;}.fusion-button.button-17 .fusion-button-icon-divider{border-color:#c83273;}.fusion-button.button-17:hover .fusion-button-text, .fusion-button.button-17:hover i,.fusion-button.button-17:focus .fusion-button-text, .fusion-button.button-17:focus i,.fusion-button.button-17:active .fusion-button-text, .fusion-button.button-17:active{color:#37408b;}.fusion-button.button-17:hover .fusion-button-icon-divider, .fusion-button.button-17:hover .fusion-button-icon-divider, .fusion-button.button-17:active .fusion-button-icon-divider{border-color:#37408b;}.fusion-button.button-17:hover, .fusion-button.button-17:focus, .fusion-button.button-17:active{border-color:#ffffff;}.fusion-button.button-17 {border-color:#ffffff;border-radius:4px;}.fusion-button.button-17{background: #ffffff;}.fusion-button.button-17:hover,.button-17:focus,.fusion-button.button-17:active{background: #ffffff;}.fusion-button.button-17 .fusion-button-text {text-transform:uppercase;}<\/style><a class=\"fusion-button button-flat button-large button-custom button-17 fusion-button-default-span fusion-button-default-type\" target=\"_self\" href=\"https:\/\/iswc.hosting2.acm.org\/iswc20\/past-conferences\/\"><span class=\"fusion-button-text\">View All<\/span><\/a><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-5 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"margin-top:0px;margin-bottom:20px;\"><div class=\"fusion-column-wrapper fusion-flex-column-wrapper-legacy\" style=\"background-position:left top;background-repeat:no-repeat;-webkit-background-size:cover;-moz-background-size:cover;-o-background-size:cover;background-size:cover;padding: 0px 0px 0px 0px;\"><div class=\"alignright\"><div class=\"fusion-social-links\"><div class=\"fusion-social-networks\"><div class=\"fusion-social-networks-wrapper\"><a class=\"fusion-social-network-icon fusion-tooltip fusion-facebook fusion-icon-facebook\" style=\"color:#ffffff;font-size:16px;\" data-placement=\"top\" data-title=\"Facebook\" data-toggle=\"tooltip\" title=\"Facebook\" aria-label=\"facebook\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/www.facebook.com\/Iswc.net\"><\/a><a class=\"fusion-social-network-icon fusion-tooltip fusion-twitter fusion-icon-twitter\" style=\"color:#ffffff;font-size:16px;\" data-placement=\"top\" data-title=\"Twitter\" data-toggle=\"tooltip\" title=\"Twitter\" aria-label=\"twitter\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/twitter.com\/ISWCNET\"><\/a><\/div><\/div><\/div><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div>\n<\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":3,"featured_media":0,"parent":577,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"100-width.php","meta":[],"_links":{"self":[{"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/pages\/873"}],"collection":[{"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/comments?post=873"}],"version-history":[{"count":58,"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/pages\/873\/revisions"}],"predecessor-version":[{"id":1405,"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/pages\/873\/revisions\/1405"}],"up":[{"embeddable":true,"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/pages\/577"}],"wp:attachment":[{"href":"https:\/\/iswc.hosting2.acm.org\/iswc20\/wp-json\/wp\/v2\/media?parent=873"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}