{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T02:19:17Z","timestamp":1769307557680,"version":"3.49.0"},"reference-count":95,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T00:00:00Z","timestamp":1652918400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["1317560"],"award-info":[{"award-number":["1317560"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2022,6,30]]},"abstract":"<jats:p>Locating and grasping objects is a critical task in people\u2019s daily lives. For people with visual impairments, this task can be a daily struggle. The support of augmented reality frameworks in smartphones can overcome the limitations of current object detection applications designed for people with visual impairments. We present AIGuide, a self-contained smartphone application that leverages augmented reality technology to help users locate and pick up objects around them. We conducted a user study to investigate the effectiveness of AIGuide in a visual prosthetic for providing guidance; compare it to other assistive technology form factors; investigate the use of multimodal feedback, and provide feedback about the overall experience. We gathered performance data and participants\u2019 reactions and analyzed videos to understand users\u2019 interactions with the nonvisual smartphone user interface. Our results show that AIGuide is a promising technology to help people with visual impairments locate and acquire objects in their daily routine. The benefits of AIGuide may be enhanced with appropriate interaction design.<\/jats:p>","DOI":"10.1145\/3508501","type":"journal-article","created":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T15:51:40Z","timestamp":1646236300000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["AIGuide: Augmented Reality Hand Guidance in a Visual Prosthetic"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4971-2004","authenticated-orcid":false,"given":"Sooyeon","family":"Lee","sequence":"first","affiliation":[{"name":"The Pennsylvania State University, University Park, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5312-6860","authenticated-orcid":false,"given":"Nelson Daniel Troncoso","family":"Aldas","sequence":"additional","affiliation":[{"name":"The Pennsylvania State University, University Park, PA, USA"}]},{"given":"Chonghan","family":"Lee","sequence":"additional","affiliation":[{"name":"The Pennsylvania State University, University Park, PA, USA"}]},{"given":"Mary Beth","family":"Rosson","sequence":"additional","affiliation":[{"name":"The Pennsylvania State University, University Park, PA, USA"}]},{"given":"John M.","family":"Carroll","sequence":"additional","affiliation":[{"name":"The Pennsylvania State University, University Park, PA, USA"}]},{"given":"Vijaykrishnan","family":"Narayanan","sequence":"additional","affiliation":[{"name":"The Pennsylvania State University, University Park, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,5,19]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"[n.d.]. Accessibility\u2014Vision. Retrieved from https:\/\/www.apple.com\/accessibility\/vision\/."},{"key":"e_1_3_1_3_2","unstructured":"[n.d.]. TalkBack\u2014Android Accessibility Help. Retrieved from https:\/\/support.google.com\/accessibility\/android\/topic\/3529932?hl=en&ref_topic=9078845."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2019.8767407"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376143"},{"key":"e_1_3_1_6_2","unstructured":"Aipoly [n.d.]. Retreived May 1 2020 from https:\/\/www.aipoly.com\/."},{"key":"e_1_3_1_7_2","unstructured":"Aira [n.d.]. Retrieved May 1 2020 from https:\/\/aira.io\/."},{"key":"e_1_3_1_8_2","unstructured":"ARAnchor [n.d.]. Retrieved May 7 2020 from https:\/\/developer.apple.com\/documentation\/arkit\/aranchor."},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132525.3132556"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2049536.2049607"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/2049536.2049607"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1177\/154193129303700406"},{"key":"e_1_3_1_13_2","doi-asserted-by":"crossref","unstructured":"Gabriel Baud-Bovy Lope Ben Porquis Fabio Ancarani and Monica Gori. 2017. ABBI: A wearable device for improving spatial cognition in visually-impaired children. In IEEE Biomedical Circuits and Systems Conference (BioCAS\u201917) . 1\u20134.","DOI":"10.1109\/BIOCAS.2017.8325128"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1167\/7.15.37"},{"key":"e_1_3_1_15_2","unstructured":"BeMyEyes. Retreived May 1 2020 from https:\/\/www.bemyeyes.com\/."},{"key":"e_1_3_1_16_2","first-page":"333","volume-title":"Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology","author":"Bigham Jeffrey P.","year":"2010","unstructured":"Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, et\u00a0al. 2010. Vizwiz: Nearly real-time answers to visual questions. In Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology. 333\u2013342."},{"key":"e_1_3_1_17_2","volume-title":"ARCore Reaches 400 Million Devices","author":"Boland Mike","year":"2019","unstructured":"Mike Boland. 2019. ARCore Reaches 400 Million Devices. Retrieved from arinsider.co\/2019\/05\/13\/arcore-reaches-400-million-devices\/."},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3264904"},{"key":"e_1_3_1_19_2","volume-title":"Societal Geo-Innovation","author":"Boularouk Said","year":"2017","unstructured":"Said Boularouk, Didier Josselin, and Eitan Altman. 2017. Open source tools for locomotion and apprehension of space by visually impaired persons: Some propositions to build a prototype based on Arduino, speech recognition and OpenStreetMap. In Societal Geo-Innovation."},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1515\/icom.2014.0026"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702613.2726953"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702613.2726953"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/HAPTICS.2014.6775483"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/1168987.1169042"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/1414471.1414529"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2009.07.004"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3022701"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3022701"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984518"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3234695.3236339"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/1463160.1463179"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132525.3132538"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445676"},{"key":"e_1_3_1_34_2","unstructured":"Implementing an iOS Settings Bundle. Retreived May 5 2020 from https:\/\/developer.apple.com\/library\/archive\/documentation\/Cocoa\/Conceptual\/UserDefaults\/Preferences\/Preferences.html."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/2049536.2049573"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025899"},{"key":"e_1_3_1_37_2","unstructured":"Slim Kammoun Christophe Jouffrais Tiago Guerreiro Hugo Nicolau and Joaquim Jorge. 2012. Guiding blind people with haptic feedback. In Proceedings of Frontiers in Accessibility for Pervasive Computing (Pervasive\u201912) Vol. 3."},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470704"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047232"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502047"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2851613.2851716"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2015.10.002"},{"key":"e_1_3_1_43_2","unstructured":"KNFB Reader [n.d.]. Retrieved May 1 2020 from https:\/\/www.knfbreader.com\/."},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353799"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132525.3134817"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/NSENS.2018.8713628"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2017.2780621"},{"key":"e_1_3_1_48_2","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/978-3-642-31534-3_2","volume-title":"Computers Helping People with Special Needs","author":"Manduchi Roberto","year":"2012","unstructured":"Roberto Manduchi. 2012. Mobile vision as assistive technology for the blind: An experimental study. In Computers Helping People with Special Needs, Klaus Miesenberger, Arthur Karshmer, Petr Penaz, and Wolfgang Zagler (Eds.). Springer, Berlin, 9\u201316."},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557328"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/1878803.1878851"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40238-3_57"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-05095-9_7"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445290"},{"key":"e_1_3_1_54_2","unstructured":"Navilens [n.d.]. Retrieved May 1 2020 from https:\/\/www.navilens.com\/."},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302271"},{"key":"e_1_3_1_56_2","volume-title":"Apple Unveils New IPad Pro with LiDAR Scanner and Trackpad Support in IPadOS","author":"Newsroom Apple","unstructured":"Apple Newsroom. [n.d.]. Apple Unveils New IPad Pro with LiDAR Scanner and Trackpad Support in IPadOS. Retrieved from www.apple.com\/newsroom\/2020\/03\/apple-unveils-new-ipad-pro-with-lidar-scanner-and-trackpad-support-in-ipados\/."},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.2174\/1874943700902010011"},{"key":"e_1_3_1_58_2","unstructured":"Object Recognition [n.d.]. Retrieved May 4 2020 from https:\/\/library.vuforia.com\/articles\/Training\/Object-Recognition."},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/2513383.2513455"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/2513383.2513455"},{"key":"e_1_3_1_61_2","first-page":"16","volume-title":"Conference on Robot Learning","author":"OhnBar Eshed","year":"2018","unstructured":"Eshed OhnBar, Kris Kitani, and Chieko Asakawa. 2018. Personalized dynamics models for adaptive assistive navigation systems. In Conference on Robot Learning. PMLR, 16\u201339."},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2013.6548443"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2531978"},{"key":"e_1_3_1_64_2","doi-asserted-by":"crossref","unstructured":"Martin Pielot Benjamin Poppinga Wilko Heuten and Susanne Boll. 2011. A tactile compass for eyes-free pedestrian navigation In IFIP Conference on Human-Computer Interaction . Springer Berlin Heidelberg 640\u2013656.","DOI":"10.1007\/978-3-642-23771-3_47"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353779"},{"key":"e_1_3_1_66_2","unstructured":"Kay E. Ramey Dionne N. Champion Elizabeth B. Dyer Danielle T. Keifert Christina Krist Peter Meyerhoff Krystal Villanosa and Jaakko Hilpp\u00f6. 2016. Qualitative analysis of video data: Standards and heuristics. In Transforming Learning Empowering Learners: The International Conference of the Learning Sciences C. K. Looi J. L. Polman U. Cress and P. Reimann."},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/354324.354380"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132525.3132535"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2019.2945561"},{"key":"e_1_3_1_70_2","unstructured":"Scanning and Detecting 3D Object [n.d.]. Retrieved May 4 2020 from https:\/\/developer.apple.com\/documentation\/arkit\/scanning_and_detecting_3d_objects."},{"key":"e_1_3_1_71_2","unstructured":"Seeing AI [n.d.]. Retrieved May 1 2020 from https:\/\/www.microsoft.com\/en-us\/ai\/seeing-ai."},{"key":"e_1_3_1_72_2","first-page":"72","volume-title":"Proceedings of the International Workshop on Virtual Rehabilitation","author":"Shah Chirayu","year":"2006","unstructured":"Chirayu Shah, Mourad Bouzit, Meriam Youssef, and Leslie Vasquez. 2006. Evaluation of RU-netra-tactile feedback navigation system for the visually impaired. In Proceedings of the International Workshop on Virtual Rehabilitation. IEEE, 72\u201377."},{"key":"e_1_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702421"},{"key":"e_1_3_1_74_2","volume-title":"What Is ToF Camera Technology on Galaxy and How Does It Work?","author":"Site The Official Samsung Galaxy","unstructured":"The Official Samsung Galaxy Site. [n.d.]. What Is ToF Camera Technology on Galaxy and How Does It Work? Retrieved from www.samsung.com\/global\/galaxy\/what-is\/tof-camera\/."},{"key":"e_1_3_1_75_2","unstructured":"Soundscape [n.d.]. Retrieved May 1 2020 from https:\/\/www.microsoft.com\/en-us\/research\/product\/soundscape\/."},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/2982142.2982175"},{"key":"e_1_3_1_77_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCMC48092.2020.ICCMC-00061"},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132525.3134812"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/2914793"},{"key":"e_1_3_1_80_2","first-page":"643","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Thakoor Kaveri","year":"2014","unstructured":"Kaveri Thakoor, Nii Mante, Carey Zhang, Christian Siagian, James Weiland, Laurent Itti, and G\u00e9rard Medioni. 2014. A system for assisting the visually impaired in localization and grasp of desired objects. In Proceedings of the European Conference on Computer Vision. Springer, 643\u2013657."},{"key":"e_1_3_1_81_2","unstructured":"Understanding ARKit Tracking and Detection [n.d.]. Retrieved from May 4 2020 https:\/\/developer.apple.com\/videos\/play\/wwdc2018\/610."},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1177\/154193129604002430"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/2384916.2384934"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","DOI":"10.1155\/2015\/798748"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7354233"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989772"},{"key":"e_1_3_1_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/2982142.2982160"},{"key":"e_1_3_1_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207734"},{"key":"e_1_3_1_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557085"},{"key":"e_1_3_1_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353788"},{"key":"e_1_3_1_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353788"},{"key":"e_1_3_1_92_2","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X0309701007"},{"key":"e_1_3_1_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376516"},{"key":"e_1_3_1_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/2513383.2513443"},{"key":"e_1_3_1_95_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.36"},{"key":"e_1_3_1_96_2","unstructured":"Zoom [n.d.]. Retrieved from https:\/\/zoom.us\/."}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3508501","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3508501","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:40Z","timestamp":1750188640000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3508501"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,19]]},"references-count":95,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,6,30]]}},"alternative-id":["10.1145\/3508501"],"URL":"https:\/\/doi.org\/10.1145\/3508501","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"value":"1936-7228","type":"print"},{"value":"1936-7236","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,19]]},"assertion":[{"value":"2021-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}