FastSwap: A Lightweight One-Stage Framework for Real-Time Face Swapping

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 55
  • Download : 0
Recent face swapping frameworks have achieved high-fidelity results. However, the previous works suffer from high computation costs due to the deep structure and the use of off-the-shelf networks. To overcome such problems and achieve real-time face swapping, we propose a lightweight one-stage framework, FastSwap. We design a shallow network trained in a self-supervised manner without any manual annotations. The core of our framework is a novel decoder block, called Triple Adaptive Normalization (TAN) block, which effectively integrates the identity and pose information. Besides, we propose a novel data augmentation and switch-test strategy to extract the attributes from the target image, which further enables controllable attribute editing. Extensive experiments on VoxCeleb2 and wild faces demonstrate that our framework generates high-fidelity face swapping results in 123.22 FPS and better preserves the identity, pose, and attributes than other state-of-the-art methods. Furthermore, we conduct an in-depth study to demonstrate the effectiveness of our proposal.
Publisher
Institute of Electrical and Electronics Engineers Inc.
Issue Date
2023-01
Language
English
Citation

23rd IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023, pp.3547 - 3556

DOI
10.1109/WACV56688.2023.00355
URI
http://hdl.handle.net/10203/305997
Appears in Collection
EE-Conference Papers(학술회의논문)
Files in This Item
There are no files associated with this item.

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0