Smart Fitting Room: A One-stop Framework for Matching-aware Virtual Try-on

التفاصيل البيبلوغرافية
العنوان: Smart Fitting Room: A One-stop Framework for Matching-aware Virtual Try-on
المؤلفون: Yu, Mingzhe, Ma, Yunshan, Wu, Lei, Cheng, Kai, Li, Xue, Meng, Lei, Chua, Tat-Seng
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Multimedia
الوصف: The development of virtual try-on has revolutionized online shopping by allowing customers to visualize themselves in various fashion items, thus extending the in-store try-on experience to the cyber space. Although virtual try-on has attracted considerable research initiatives, existing systems only focus on the quality of image generation, overlooking whether the fashion item is a good match to the given person and clothes. Recognizing this gap, we propose to design a one-stop Smart Fitting Room, with the novel formulation of matching-aware virtual try-on. Following this formulation, we design a Hybrid Matching-aware Virtual Try-On Framework (HMaVTON), which combines retrieval-based and generative methods to foster a more personalized virtual try-on experience. This framework integrates a hybrid mix-and-match module and an enhanced virtual try-on module. The former can recommend fashion items available on the platform to boost sales and generate clothes that meets the diverse tastes of consumers. The latter provides high-quality try-on effects, delivering a one-stop shopping service. To validate the effectiveness of our approach, we enlist the expertise of fashion designers for a professional evaluation, assessing the rationality and diversity of the clothes combinations and conducting an evaluation matrix analysis. Our method significantly enhances the practicality of virtual try-on. The code is available at https://github.com/Yzcreator/HMaVTONTest.
نوع الوثيقة: Working Paper
DOI: 10.1145/3652583.3658064
الوصول الحر: http://arxiv.org/abs/2401.16825Test
رقم الانضمام: edsarx.2401.16825
قاعدة البيانات: arXiv