Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignment

Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignment

19 Mar 2024 | Mengting Chen, Xi Chen, Zhonghua Zhai, Chen Ju, Xuewen Hong, Jinsong Lan, Shuai Xiao*
This paper introduces Wear-Any-Way, a novel framework for virtual try-on that supports customizable manipulation of wearing styles. Unlike previous methods, Wear-Any-Way allows users to precisely control the way garments are worn through simple interactions like clicks and drags. The framework is built on a strong baseline using dual U-Nets, one for the main branch and one for reference, with a focus on preserving high-fidelity details and handling complex scenarios. To enable point-based control, the method introduces sparse correspondence alignment, which aligns specific points on the garment and person images. This alignment is achieved through point embedding networks and modified attention layers. The framework demonstrates superior performance in standard virtual try-on tasks and provides a novel interaction form for customizing wearing styles, offering significant implications for the fashion industry.This paper introduces Wear-Any-Way, a novel framework for virtual try-on that supports customizable manipulation of wearing styles. Unlike previous methods, Wear-Any-Way allows users to precisely control the way garments are worn through simple interactions like clicks and drags. The framework is built on a strong baseline using dual U-Nets, one for the main branch and one for reference, with a focus on preserving high-fidelity details and handling complex scenarios. To enable point-based control, the method introduces sparse correspondence alignment, which aligns specific points on the garment and person images. This alignment is achieved through point embedding networks and modified attention layers. The framework demonstrates superior performance in standard virtual try-on tasks and provides a novel interaction form for customizing wearing styles, offering significant implications for the fashion industry.
Reach us at info@study.space