Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation

Hyejeong Jo; Junhyeok Lee; Hye Won Park; Minjae Kim; Yeonwoo Kim; Won Hee Lee

doi:10.1109/ICCE-Asia59966.2023.10326366

Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation

Hyejeong Jo, Junhyeok Lee, Hye Won Park, Minjae Kim, Yeonwoo Kim, Won Hee Lee

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Citation (Scopus)

Abstract

The evaluation of user experience (UX) is a multifaceted process that encompasses a range of methods such as surveys, emotion recognition, and attention recognition. The effectiveness of UX evaluation depends on the integration of dependable and unbiased techniques derived from diverse user-generated data sources. In this context, we introduce a Multimodal INteractive Dashboard (MIND), a web-based platform tailored to furnish a reliable and user-centric avenue for UX evaluation. MIND incorporates three core functionalities: facial emotion recognition, EEG-based attention recognition, and image generation informed by estimated user's poses and affective states. By seamlessly engaging users, MIND facilitates a quantitative assessment of their experiences. The proposed MIND offers multimodal data analytics and visualization to enable insights of time spans of the UX with individual users, helping improve the overall user experience.

Original language	English
Title of host publication	2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9798350344318
DOIs	https://doi.org/10.1109/ICCE-Asia59966.2023.10326366
Publication status	Published - 2023
Event	2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023 - Busan, Korea, Republic of Duration: 23 Oct 2023 → 25 Oct 2023

Publication series

Name	2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023

Conference

Conference	2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023
Country/Territory	Korea, Republic of
City	Busan
Period	23/10/23 → 25/10/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Keywords

EEG
User experience
attention
dashboard
facial emotion recognition
image generation
pose estimation

Access to Document

10.1109/ICCE-Asia59966.2023.10326366

Cite this

Jo, H., Lee, J., Park, H. W., Kim, M., Kim, Y., & Lee, W. H. (2023). Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation. In 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023 (2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCE-Asia59966.2023.10326366

Jo, Hyejeong ; Lee, Junhyeok ; Park, Hye Won et al. / Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation. 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023. Institute of Electrical and Electronics Engineers Inc., 2023. (2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023).

@inproceedings{2eea2c0a9bd04e0380724fb23d30f12f,

title = "Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation",

abstract = "The evaluation of user experience (UX) is a multifaceted process that encompasses a range of methods such as surveys, emotion recognition, and attention recognition. The effectiveness of UX evaluation depends on the integration of dependable and unbiased techniques derived from diverse user-generated data sources. In this context, we introduce a Multimodal INteractive Dashboard (MIND), a web-based platform tailored to furnish a reliable and user-centric avenue for UX evaluation. MIND incorporates three core functionalities: facial emotion recognition, EEG-based attention recognition, and image generation informed by estimated user's poses and affective states. By seamlessly engaging users, MIND facilitates a quantitative assessment of their experiences. The proposed MIND offers multimodal data analytics and visualization to enable insights of time spans of the UX with individual users, helping improve the overall user experience.",

keywords = "EEG, User experience, attention, dashboard, facial emotion recognition, image generation, pose estimation",

author = "Hyejeong Jo and Junhyeok Lee and Park, {Hye Won} and Minjae Kim and Yeonwoo Kim and Lee, {Won Hee}",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023 ; Conference date: 23-10-2023 Through 25-10-2023",

year = "2023",

doi = "10.1109/ICCE-Asia59966.2023.10326366",

language = "English",

series = "2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023",

address = "United States",

}

Jo, H, Lee, J, Park, HW, Kim, M, Kim, Y & Lee, WH 2023, Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation. in 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023. 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023, Institute of Electrical and Electronics Engineers Inc., 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023, Busan, Korea, Republic of, 23/10/23. https://doi.org/10.1109/ICCE-Asia59966.2023.10326366

Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation. / Jo, Hyejeong; Lee, Junhyeok; Park, Hye Won et al.
2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023. Institute of Electrical and Electronics Engineers Inc., 2023. (2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation

AU - Jo, Hyejeong

AU - Lee, Junhyeok

AU - Park, Hye Won

AU - Kim, Minjae

AU - Kim, Yeonwoo

AU - Lee, Won Hee

PY - 2023

Y1 - 2023

N2 - The evaluation of user experience (UX) is a multifaceted process that encompasses a range of methods such as surveys, emotion recognition, and attention recognition. The effectiveness of UX evaluation depends on the integration of dependable and unbiased techniques derived from diverse user-generated data sources. In this context, we introduce a Multimodal INteractive Dashboard (MIND), a web-based platform tailored to furnish a reliable and user-centric avenue for UX evaluation. MIND incorporates three core functionalities: facial emotion recognition, EEG-based attention recognition, and image generation informed by estimated user's poses and affective states. By seamlessly engaging users, MIND facilitates a quantitative assessment of their experiences. The proposed MIND offers multimodal data analytics and visualization to enable insights of time spans of the UX with individual users, helping improve the overall user experience.

AB - The evaluation of user experience (UX) is a multifaceted process that encompasses a range of methods such as surveys, emotion recognition, and attention recognition. The effectiveness of UX evaluation depends on the integration of dependable and unbiased techniques derived from diverse user-generated data sources. In this context, we introduce a Multimodal INteractive Dashboard (MIND), a web-based platform tailored to furnish a reliable and user-centric avenue for UX evaluation. MIND incorporates three core functionalities: facial emotion recognition, EEG-based attention recognition, and image generation informed by estimated user's poses and affective states. By seamlessly engaging users, MIND facilitates a quantitative assessment of their experiences. The proposed MIND offers multimodal data analytics and visualization to enable insights of time spans of the UX with individual users, helping improve the overall user experience.

KW - EEG

KW - User experience

KW - attention

KW - dashboard

KW - facial emotion recognition

KW - image generation

KW - pose estimation

UR - http://www.scopus.com/inward/record.url?scp=85179893083&partnerID=8YFLogxK

U2 - 10.1109/ICCE-Asia59966.2023.10326366

DO - 10.1109/ICCE-Asia59966.2023.10326366

M3 - Conference contribution

AN - SCOPUS:85179893083

T3 - 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023

BT - 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023

Y2 - 23 October 2023 through 25 October 2023

ER -

Jo H, Lee J, Park HW, Kim M, Kim Y, Lee WH. Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation. In 2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023. Institute of Electrical and Electronics Engineers Inc. 2023. (2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023). doi: 10.1109/ICCE-Asia59966.2023.10326366

Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this