Due to the COVID-19 epidemic, video conferencing has evolved as a new
paradigm of communication and teamwork. However, private and personal
information can be easily leaked through cameras during video conferencing.
This includes leakage of a person’s appearance as well as the contents in the
background. This paper proposes a novel way of using online low-resolution
thermal images as conditions to guide the synthesis of RGB images, bringing a
promising solution for real-time video conferencing when privacy leakage is a
concern. SPADE-SR (Spatially-Adaptive De-normalization with Self Resampling), a
variant of SPADE, is adopted to incorporate the spatial property of a thermal
heatmap and the non-thermal property of a normal, privacy-free pre-recorded RGB
image provided in a form of latent code. We create a PAIR-LRT-Human (LRT =
Low-Resolution Thermal) dataset to validate our claims. The result enables a
convenient way of video conferencing where users no longer need to groom
themselves and tidy up backgrounds for a short meeting. Additionally, it allows
a user to switch to a different appearance and background during a conference.
Go to Source of this post
Author Of this post: <a href="http://arxiv.org/find/cs/1/au:+Chiu_S/0/1/0/all/0/1">Sheng-Yang Chiu</a>, <a href="http://arxiv.org/find/cs/1/au:+Huang_Y/0/1/0/all/0/1">Yu-Ting Huang</a>, <a href="http://arxiv.org/find/cs/1/au:+Lin_C/0/1/0/all/0/1">Chieh-Ting Lin</a>, <a href="http://arxiv.org/find/cs/1/au:+Tseng_Y/0/1/0/all/0/1">Yu-Chee Tseng</a>, <a href="http://arxiv.org/find/cs/1/au:+Chen_J/0/1/0/all/0/1">Jen-Jee Chen</a>, <a href="http://arxiv.org/find/cs/1/au:+Tu_M/0/1/0/all/0/1">Meng-Hsuan Tu</a>, <a href="http://arxiv.org/find/cs/1/au:+Tung_B/0/1/0/all/0/1">Bo-Chen Tung</a>, <a href="http://arxiv.org/find/cs/1/au:+Nieh_Y/0/1/0/all/0/1">YuJou Nieh</a>