1st International Workshop on Pseudo Privacy Preserving Data-based Human State Estimation, Measurement, and Applications (IW-P3HSE)

Co-located with IEEE ISMAR 2024
On-site event in the Greater Seattle Area, USA
October 21 (Mon), 2024

Call For Contributions

Privacy-Aware Human State Estimation for MR/AR Applications

This workshop focuses on Privacy-Aware Human State Estimation for various Mixed and Augmented Reality (MR/AR) applications, including human pose estimation, human eye gaze tracking, and human mesh reconstruction, which are crucial core technologies for MR/AR technologies. For dealing with human data, ensuring personal data protection-aware technology could highly contribute to the widespread adoption of these technologies in society. Therefore, under the premise that protecting privacy is essential, we would like to explore the theme of Privacy-Preserving Human State Estimation based on P3 (Pseudo Privacy Preserving) data. P3 is an original term made by the organizers.

What can be P3 data?

Here, P3 data refers to data that are "less likely to lead to individual identification," such as

that do not contain semantic information, or measurement information in settings where users are not directly measured from the front.

In short, the P3 data include less personal information than "information that easily leads to individual identification," such as image information that includes the state of a person's face or clothing as texture, speech, and acoustic signals during actions where the user's voice tone, conversation content, and actions can be easily inferred. 

This topic of research encompasses many important technical challenges, such as estimating human state from sparse measurement information, addressing noise commonly encountered in estimation methods based on sparse measurement information, challenges stemming from low spatial resolution when using modalities other than visible light, and methods for visualizing the estimated results. 

Topics

Key topics of the workshop include, but are not limited to:

Submitted papers will be peer-reviewed. Accepted papers will be published on IEEE Xplore as ISMAR2024 adjunct proceedings.

For your reference, here are some relevant work on this topic. Please note that these are just examples. 

We welcome a wide range of submissions, not limited to these topics!

Examples of relevant papers

[1] Ryosuke Hori, Ryo Hachiuma, Mariko Isogawa, Dan Mikami, Hideo Saito, "Silhouette-based 3D Human Pose Estimation Using a Single Wrist-mounted 360° Camera", IEEE Access, vol. 10, pp. 54957-54968, 2022. [Open Access Journal] [Project Page]

[2] Yuto Shibata, Yutaka Kawashima, Mariko Isogawa, Go Irie, Akisato Kimura, Yoshimitsu Aoki. "Listening Human Behavior: 3D Human Pose Estimation with Acoustic Signals", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.13323-13332, 2023. [Project page]

[3] Christen Millerdurai, Hiroyasu Akada, Jian Wang, Diogo Luvizon, Christian Theobalt, Vladislav Golyanik, "EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams",  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.1186-1195, 2024. [Project page]

[4] Kotaro Amaya, Mariko Isogawa. "Adaptive and Robust mmWave-based 3D Human Mesh Estimation for Diverse Poses", IEEE International Conference on Image Processing (ICIP), pp.455-459, 2023. [Paper]

[5] Mariko Isogawa, Ye Yuan, Matthew O'Toole, and Kris Kitani, "Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7013-7022, 2020. [Project page]

[6] Mariko Isogawa, Dorian Chan, Ye Yuan, Kris Kitani, and Matthew O'Toole, "Efficient Non-Line-of-Sight Imaging from Transient Sinograms", 16th European Conference on Computer Vision (ECCV), pp. 193-208, 2020. [Project page]

Important Dates

Submission

Submitted papers will be peer-reviewed. Accepted papers will be published on IEEE Xplore as ISMAR 2024 adjunct Proceedings.

NOTE: At least one author must register for the conference and present the work in-person!!

Organizers

General Co-Chairs

Mariko Isogawa
Keio Univ.

Hideo Saito
Keio Univ.

Shohei Mori
Univ. of Stuttgart

Dieter Schmalstieg
Univ. of Stuttgart

Workshop Advisory Board

Tongliang Liu
Univ. of Sydney

Program Committee Members