Taeyoung Yeon

About Me

I am a PhD student at NYU Tandon in the Human-Centered Technology Innovation and Design program, advised by Professor Vedant Das Swain. Previously, I served as a Post-Baccalaureate Research Fellow at Northwestern University, advised by Professor Karan Ahuja. I earned a Bachelor of Science in Computer Science and Engineering from Seoul National University. Additionally, I worked at the mobile game company, Awesomepiece, as a Full Stack Game Developer.

My research interests include Human-Computer Interaction (HCI), On-Device Machine Learning (ML), Ubiquitous Computing, and real-time healthcare applications.

📄 You can view and download my full CV here.

news

Aug 23, 2026	Starting my PhD at NYU Tandon School of Engineering, advised by Prof. Vedant Das Swain.
Aug 01, 2026	My co-first-author paper (FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices) was accepted to ISMAR 2026! Check my homepage for details.
Feb 09, 2026	Our paper has been accepted to CVPR 2026 Findings!
Nov 13, 2025	Submitted a paper to CVPR 2026.
Jul 07, 2025	My first author academic paper (WatchHAR: Real-time On-device Human Activity Recognition System for Smartwatches) was accepted to ICMI’25. Check my homepage for details.

publications

FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices

Chenfeng Gao^*, Taeyoung Yeon^*, Sungheon Park, and 4 more authors

In Proceedings of the 2026 IEEE International Symposium on Mixed and Augmented Reality (ISMAR ’26), 2026

To appear — paper coming soon
MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

Yiquan Li^*, Taeyoung Yeon^*, Chenfeng Gao, and 3 more authors

In Proceedings of the 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition (Findings), 2026

PDF
WatchHAR: Real-time On-device Human Activity Recognition System for Smartwatches

Taeyoung Yeon, Vasco Xu, Hank Hoffman, and 1 more author

In Proceedings of the 27th ACM International Conference on Multimodal Interaction, 2025

Abs PDF Video

Despite advances in practical and multimodal human activity recognition (HAR), a system that runs entirely on smartwatches in unconstrained environments remains elusive. We present WatchHAR, an audio and inertial-based HAR system that operates fully on smartwatches, addressing privacy and latency issues associated with external data processing. By optimizing each component of the pipeline, WatchHAR achieves compounding performance gains. We introduce a novel architecture that unifies sensor data pre-processing and inference into an end-to-end trainable module, significantly accelerating performance by 25× while maintaining over 90% accuracy on 25+ activity classes. WatchHAR outperforms state-of-the-art models in terms of accuracy while running on the smartwatch directly at 30 Hz for multimodal activity classification and 40 Hz for activity event detection. This research advances edge-based activity recognition, realizing smartwatches’ potential as standalone, minimally-invasive activity tracking devices.