Analysis of Rolling Shutter Effect on ENF-Based Video Forensics

Vatansever S., DİRİK A. E., Memon N.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, cilt.14, sa.9, ss.2262-2275, 2019 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 14 Sayı: 9
  • Basım Tarihi: 2019
  • Doi Numarası: 10.1109/tifs.2019.2895540
  • Dergi Adı: IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.2262-2275
  • Anahtar Kelimeler: Electric network frequency (ENF), video forensics, multimedia forensics, camera forensics, rolling shutter, idle period, camera verification, time-of-recording, time-stamp, ELECTRIC-NETWORK FREQUENCY, SIGNAL
  • Bursa Uludağ Üniversitesi Adresli: Evet

Özet

Electric network frequency (ENF) is a time-varying signal of the frequency of mains electricity in a power grid. It continuously fluctuates around a nominal value (50/60 Hz) clue to changes in the supply and demand of power over time. Depending on these ENF variations, the luminous intensity of a mains-powered light source also fluctuates. These fluctuations in luminance can he captured by video recordings. Accordingly, the ENF can he estimated from such videos by the analysis of steady content in the video scene. When videos are captured by using a rolling shutter sampling mechanism, as is done mostly with CMOS cameras, there is an idle period between successive frames. Consequently, a number of illumination samples of the scene are effectively lost due to the idle period. These missing samples affect the ENF estimation, in the sense of the frequency shift caused and the power attenuation that results. This paper develops an analytical model for videos captured using a rolling shutter mechanism. This model illustrates how the frequency of the main ENF harmonic varies depending on the idle period length, and how the power of the captured ENF attenuates as idle period increases. Based on this, a novel idle period estimation method for potential use in camera forensics that is able to operate independently of video frame rate is proposed. Finally, a novel time-of-recording verification approach based on the use of multiple ENF components, idle period assumptions, and the interpolation of missing ENF samples is also proposed.