Vibeye: Vibration-mediated object recognition for tangible interactive applications

Seungjae Oh; Gyeore Yun; Chaeyong Park; Jinsoo Kim; Seungmoon Choi

doi:10.1145/3290605.3300906

Vibeye: Vibration-mediated object recognition for tangible interactive applications

Seungjae Oh, Gyeore Yun, Chaeyong Park, Jinsoo Kim, Seungmoon Choi

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Citations (Scopus)

Abstract

We present VibEye: a vibration-mediated recognition system of objects for tangible interaction. A user holds an object between two fingers wearing VibEye. VibEye triggers a vibration from one finger, and the vibration that has propagated through the object is sensed at the other finger. This vibration includes information about the object’s identity, and we represent it using a spectrogram. Collecting the spectrograms of many objects, we formulate the object recognition problem to a classical classification problem among the images. This simple method, when tested with 20 users, shows 92.5% accuracy for 16 objects of the same shape with various materials. This material-based classifier is also extended to the recognition of everyday objects. Lastly, we demonstrate several tangible applications where VibEye provides the needed functionality while enhancing user experiences. VibEye is particularly effective for recognizing objects made of different materials, which is difficult to distinguish by other means such as light and sound.

Original language	English
Title of host publication	CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450359702
DOIs	https://doi.org/10.1145/3290605.3300906
Publication status	Published - 2 May 2019
Event	2019 CHI Conference on Human Factors in Computing Systems, CHI 2019 - Glasgow, United Kingdom Duration: 4 May 2019 → 9 May 2019

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2019 CHI Conference on Human Factors in Computing Systems, CHI 2019
Country/Territory	United Kingdom
City	Glasgow
Period	4/05/19 → 9/05/19

Bibliographical note

Publisher Copyright:
© 2019 Copyright held by the owner/author(s).

Keywords

Augmented reality
Object recognition
Passive haptics
Tangible interaction
Vibration-based sensing
Virtual reality

Access to Document

10.1145/3290605.3300906

Cite this

Oh, S., Yun, G., Park, C., Kim, J., & Choi, S. (2019). Vibeye: Vibration-mediated object recognition for tangible interactive applications. In CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3290605.3300906

@inproceedings{05d3d5a38cc04248bfb451a6c3c5b363,

title = "Vibeye: Vibration-mediated object recognition for tangible interactive applications",

abstract = "We present VibEye: a vibration-mediated recognition system of objects for tangible interaction. A user holds an object between two fingers wearing VibEye. VibEye triggers a vibration from one finger, and the vibration that has propagated through the object is sensed at the other finger. This vibration includes information about the object{\textquoteright}s identity, and we represent it using a spectrogram. Collecting the spectrograms of many objects, we formulate the object recognition problem to a classical classification problem among the images. This simple method, when tested with 20 users, shows 92.5% accuracy for 16 objects of the same shape with various materials. This material-based classifier is also extended to the recognition of everyday objects. Lastly, we demonstrate several tangible applications where VibEye provides the needed functionality while enhancing user experiences. VibEye is particularly effective for recognizing objects made of different materials, which is difficult to distinguish by other means such as light and sound.",

keywords = "Augmented reality, Object recognition, Passive haptics, Tangible interaction, Vibration-based sensing, Virtual reality",

author = "Seungjae Oh and Gyeore Yun and Chaeyong Park and Jinsoo Kim and Seungmoon Choi",

note = "Publisher Copyright: {\textcopyright} 2019 Copyright held by the owner/author(s).; 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019 ; Conference date: 04-05-2019 Through 09-05-2019",

year = "2019",

month = may,

day = "2",

doi = "10.1145/3290605.3300906",

language = "English",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

booktitle = "CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems",

}

Oh, S, Yun, G, Park, C, Kim, J & Choi, S 2019, Vibeye: Vibration-mediated object recognition for tangible interactive applications. in CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, Glasgow, United Kingdom, 4/05/19. https://doi.org/10.1145/3290605.3300906

Vibeye: Vibration-mediated object recognition for tangible interactive applications. / Oh, Seungjae; Yun, Gyeore; Park, Chaeyong et al.
CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2019. (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Vibeye

T2 - 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019

AU - Oh, Seungjae

AU - Yun, Gyeore

AU - Park, Chaeyong

AU - Kim, Jinsoo

AU - Choi, Seungmoon

PY - 2019/5/2

Y1 - 2019/5/2

N2 - We present VibEye: a vibration-mediated recognition system of objects for tangible interaction. A user holds an object between two fingers wearing VibEye. VibEye triggers a vibration from one finger, and the vibration that has propagated through the object is sensed at the other finger. This vibration includes information about the object’s identity, and we represent it using a spectrogram. Collecting the spectrograms of many objects, we formulate the object recognition problem to a classical classification problem among the images. This simple method, when tested with 20 users, shows 92.5% accuracy for 16 objects of the same shape with various materials. This material-based classifier is also extended to the recognition of everyday objects. Lastly, we demonstrate several tangible applications where VibEye provides the needed functionality while enhancing user experiences. VibEye is particularly effective for recognizing objects made of different materials, which is difficult to distinguish by other means such as light and sound.

AB - We present VibEye: a vibration-mediated recognition system of objects for tangible interaction. A user holds an object between two fingers wearing VibEye. VibEye triggers a vibration from one finger, and the vibration that has propagated through the object is sensed at the other finger. This vibration includes information about the object’s identity, and we represent it using a spectrogram. Collecting the spectrograms of many objects, we formulate the object recognition problem to a classical classification problem among the images. This simple method, when tested with 20 users, shows 92.5% accuracy for 16 objects of the same shape with various materials. This material-based classifier is also extended to the recognition of everyday objects. Lastly, we demonstrate several tangible applications where VibEye provides the needed functionality while enhancing user experiences. VibEye is particularly effective for recognizing objects made of different materials, which is difficult to distinguish by other means such as light and sound.

KW - Augmented reality

KW - Object recognition

KW - Passive haptics

KW - Tangible interaction

KW - Vibration-based sensing

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85067597186&partnerID=8YFLogxK

U2 - 10.1145/3290605.3300906

DO - 10.1145/3290605.3300906

M3 - Conference contribution

AN - SCOPUS:85067597186

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 4 May 2019 through 9 May 2019

ER -

Vibeye: Vibration-mediated object recognition for tangible interactive applications

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this