Multimedia file forensics system exploiting file similarity search

Min Ja Kim, Hyuck Yoo, Young Woong Ko

Research output: Contribution to journalArticle

Abstract

With the fast increase of multimedia contents, efficient forensics investigation methods for multimedia files have been required. In multimedia files, the similarity means that the identical media (audio and video) data are existing among multimedia files. This paper proposes an efficient multimedia file forensics system based on file similarity search of video contents. The proposed system needs two key techniques. First is a media-aware information detection technique. The first critical step for the similarity search is to find the meaningful keyframes or key sequences in the shots through a multimedia file, in order to recognize altered files from the same source file. Second is a video fingerprint-based technique (VFB) for file similarity search. The byte for byte comparison is an inefficient similarity searching method for large files such as multimedia. The VFB technique is an efficient method to extract video features from the large multimedia files. It also provides an independent media-aware identification method for detecting alterations to the source video file (e.g., frame rates, resolutions, and formats, etc.). In this paper, we focus on two key challenges: to generate robust video fingerprints by finding meaningful boundaries of a multimedia file, and to measure video similarity by using fingerprint-based matching. Our evaluation shows that the proposed system is possible to apply to realistic multimedia file forensics tools.

Original languageEnglish
Pages (from-to)1-22
Number of pages22
JournalMultimedia Tools and Applications
DOIs
Publication statusAccepted/In press - 2017 Jul 5

Keywords

  • File similarity search
  • fingerprint-based matching
  • media-aware information detection
  • Multimedia file forensics
  • Video fingerprint

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Multimedia file forensics system exploiting file similarity search. / Kim, Min Ja; Yoo, Hyuck; Ko, Young Woong.

In: Multimedia Tools and Applications, 05.07.2017, p. 1-22.

Research output: Contribution to journalArticle

@article{d7a6ed88e1944cf6850430aa27c6c54e,
title = "Multimedia file forensics system exploiting file similarity search",
abstract = "With the fast increase of multimedia contents, efficient forensics investigation methods for multimedia files have been required. In multimedia files, the similarity means that the identical media (audio and video) data are existing among multimedia files. This paper proposes an efficient multimedia file forensics system based on file similarity search of video contents. The proposed system needs two key techniques. First is a media-aware information detection technique. The first critical step for the similarity search is to find the meaningful keyframes or key sequences in the shots through a multimedia file, in order to recognize altered files from the same source file. Second is a video fingerprint-based technique (VFB) for file similarity search. The byte for byte comparison is an inefficient similarity searching method for large files such as multimedia. The VFB technique is an efficient method to extract video features from the large multimedia files. It also provides an independent media-aware identification method for detecting alterations to the source video file (e.g., frame rates, resolutions, and formats, etc.). In this paper, we focus on two key challenges: to generate robust video fingerprints by finding meaningful boundaries of a multimedia file, and to measure video similarity by using fingerprint-based matching. Our evaluation shows that the proposed system is possible to apply to realistic multimedia file forensics tools.",
keywords = "File similarity search, fingerprint-based matching, media-aware information detection, Multimedia file forensics, Video fingerprint",
author = "Kim, {Min Ja} and Hyuck Yoo and Ko, {Young Woong}",
year = "2017",
month = "7",
day = "5",
doi = "10.1007/s11042-017-4969-2",
language = "English",
pages = "1--22",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",

}

TY - JOUR

T1 - Multimedia file forensics system exploiting file similarity search

AU - Kim, Min Ja

AU - Yoo, Hyuck

AU - Ko, Young Woong

PY - 2017/7/5

Y1 - 2017/7/5

N2 - With the fast increase of multimedia contents, efficient forensics investigation methods for multimedia files have been required. In multimedia files, the similarity means that the identical media (audio and video) data are existing among multimedia files. This paper proposes an efficient multimedia file forensics system based on file similarity search of video contents. The proposed system needs two key techniques. First is a media-aware information detection technique. The first critical step for the similarity search is to find the meaningful keyframes or key sequences in the shots through a multimedia file, in order to recognize altered files from the same source file. Second is a video fingerprint-based technique (VFB) for file similarity search. The byte for byte comparison is an inefficient similarity searching method for large files such as multimedia. The VFB technique is an efficient method to extract video features from the large multimedia files. It also provides an independent media-aware identification method for detecting alterations to the source video file (e.g., frame rates, resolutions, and formats, etc.). In this paper, we focus on two key challenges: to generate robust video fingerprints by finding meaningful boundaries of a multimedia file, and to measure video similarity by using fingerprint-based matching. Our evaluation shows that the proposed system is possible to apply to realistic multimedia file forensics tools.

AB - With the fast increase of multimedia contents, efficient forensics investigation methods for multimedia files have been required. In multimedia files, the similarity means that the identical media (audio and video) data are existing among multimedia files. This paper proposes an efficient multimedia file forensics system based on file similarity search of video contents. The proposed system needs two key techniques. First is a media-aware information detection technique. The first critical step for the similarity search is to find the meaningful keyframes or key sequences in the shots through a multimedia file, in order to recognize altered files from the same source file. Second is a video fingerprint-based technique (VFB) for file similarity search. The byte for byte comparison is an inefficient similarity searching method for large files such as multimedia. The VFB technique is an efficient method to extract video features from the large multimedia files. It also provides an independent media-aware identification method for detecting alterations to the source video file (e.g., frame rates, resolutions, and formats, etc.). In this paper, we focus on two key challenges: to generate robust video fingerprints by finding meaningful boundaries of a multimedia file, and to measure video similarity by using fingerprint-based matching. Our evaluation shows that the proposed system is possible to apply to realistic multimedia file forensics tools.

KW - File similarity search

KW - fingerprint-based matching

KW - media-aware information detection

KW - Multimedia file forensics

KW - Video fingerprint

UR - http://www.scopus.com/inward/record.url?scp=85021791588&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85021791588&partnerID=8YFLogxK

U2 - 10.1007/s11042-017-4969-2

DO - 10.1007/s11042-017-4969-2

M3 - Article

AN - SCOPUS:85021791588

SP - 1

EP - 22

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

ER -