Frame Rate Up Conversion Based on Variational Image Fusion

Cited 26 time in webofscience Cited 0 time in scopus
  • Hit : 436
  • Download : 45
This paper presents a new framework for motion compensated frame rate up conversion (FRUC) based on variational image fusion. The proposed algorithm consists of two steps: 1) generation of multiple intermediate interpolated frames and 2) fusion of those intermediate frames. In the first step, we determine four different sets of the motion vector field using four neighboring frames. We then generate intermediate interpolated frames corresponding to the determined four sets of the motion vector field, respectively. Multiple sets of the motion vector field are used to solve the occlusion problem in motion estimation. In the second step, the four intermediate interpolated frames are fused into a single frame via a variational image fusion process. For effective fusion, we determine fusion weights for each intermediate interpolated frame by minimizing the energy, which consists of a weighted-L-1-norm based data energy and gradient-driven smoothness energy. Experimental results demonstrate that the proposed algorithm improves the performance of FRUC compared with the existing algorithms.
Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Issue Date
2014-01
Language
English
Article Type
Article
Keywords

OPTICAL-FLOW ESTIMATION; RATE UP-CONVERSION; MOTION; INTERPOLATION

Citation

IEEE TRANSACTIONS ON IMAGE PROCESSING, v.23, no.1, pp.399 - 412

ISSN
1057-7149
DOI
10.1109/TIP.2013.2288139
URI
http://hdl.handle.net/10203/187098
Appears in Collection
EE-Journal Papers(저널논문)
Files in This Item
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 26 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0