arXiv Open Access 2024

SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting

Hoon Kim Minje Jang Wonjun Yoon Jisoo Lee Donghyun Na +1 lainnya
Lihat Sumber

Abstrak

We introduce a co-designed approach for human portrait relighting that combines a physics-guided architecture with a pre-training framework. Drawing on the Cook-Torrance reflectance model, we have meticulously configured the architecture design to precisely simulate light-surface interactions. Furthermore, to overcome the limitation of scarce high-quality lightstage data, we have developed a self-supervised pre-training strategy. This novel combination of accurate physical modeling and expanded training dataset establishes a new benchmark in relighting realism.

Topik & Kata Kunci

Penulis (6)

H

Hoon Kim

M

Minje Jang

W

Wonjun Yoon

J

Jisoo Lee

D

Donghyun Na

S

Sanghyun Woo

Format Sitasi

Kim, H., Jang, M., Yoon, W., Lee, J., Na, D., Woo, S. (2024). SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting. https://arxiv.org/abs/2402.18848

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2024
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓