Visual rhythm and shot verification

Hyeokman Kim, Jinho Lee, Jae Heon Yang, Sanghoon Sull, Woon Kyung Kim, S. Moon Ho Song

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Typical result of an automatic shot change detection algorithm expectedly includes a certain number of undetected shots as well as falsely detected shots. Even though automatic shot change detection algorithms are continuing to improve, the ultimate goal of automatically detecting all shot changes without false alarms may never be achieved. Thus, allowing a human operator to intervene-to review and verify the result of a shot change detection algorithm, to delete falsely detected shots as well as to find undetected shots-may be the most viable approach currently available for increasing the accuracy of the overall shot detection process. For this exact purpose, we propose a shot verifier based on the visual rhythm. The visual rhythm, an abstraction of the video, is a single image, a sub-sampled version of a full video in which the sampling is performed in a pre-determined and in a systematic fashion. It is a representation of the video, which includes the overall content of the video. But most importantly, the visual rhythm contains patterns or visual features that allow the viewer/operator to distinguish and classify many different types of video effects (edits and otherwise): cuts, wipes, dissolves, fades, camera motions, object motions, flashlights, zooms, etc. The different video effects manifest themselves as different patterns on the visual rhythm. Using the visual rhythm, it becomes possible, without sequentially playing the entire video, to find false positive shots as well as undetected shots. Thus, inclusion of the visual rhythm in the shot verification process will aid the operator to verify detected shots as well as to find undetected shots fast and efficiently. Our newly developed shot verifier based on the visual rhythm has been designed for operator efficiency. The design of our shot verifier presented and the usefulness of the visual rhythm during the shot verification process will be demonstrated.

Original languageEnglish
Pages (from-to)227-245
Number of pages19
JournalMultimedia Tools and Applications
Volume15
Issue number3
DOIs
Publication statusPublished - 2001 Dec 1

Fingerprint

Flashlights
Change Detection
Cameras
Sampling
Operator
Verify
Vision
Motion
False Alarm
False Positive
Inclusion
Camera
Classify
Entire

Keywords

  • Shot verification
  • Video edit effects
  • Visual rhythm

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software
  • Theoretical Computer Science
  • Computational Theory and Mathematics

Cite this

Visual rhythm and shot verification. / Kim, Hyeokman; Lee, Jinho; Yang, Jae Heon; Sull, Sanghoon; Kim, Woon Kyung; Song, S. Moon Ho.

In: Multimedia Tools and Applications, Vol. 15, No. 3, 01.12.2001, p. 227-245.

Research output: Contribution to journalArticle

Kim, Hyeokman ; Lee, Jinho ; Yang, Jae Heon ; Sull, Sanghoon ; Kim, Woon Kyung ; Song, S. Moon Ho. / Visual rhythm and shot verification. In: Multimedia Tools and Applications. 2001 ; Vol. 15, No. 3. pp. 227-245.
@article{eb893d2f076f442785fd43bbebd4ac7a,
title = "Visual rhythm and shot verification",
abstract = "Typical result of an automatic shot change detection algorithm expectedly includes a certain number of undetected shots as well as falsely detected shots. Even though automatic shot change detection algorithms are continuing to improve, the ultimate goal of automatically detecting all shot changes without false alarms may never be achieved. Thus, allowing a human operator to intervene-to review and verify the result of a shot change detection algorithm, to delete falsely detected shots as well as to find undetected shots-may be the most viable approach currently available for increasing the accuracy of the overall shot detection process. For this exact purpose, we propose a shot verifier based on the visual rhythm. The visual rhythm, an abstraction of the video, is a single image, a sub-sampled version of a full video in which the sampling is performed in a pre-determined and in a systematic fashion. It is a representation of the video, which includes the overall content of the video. But most importantly, the visual rhythm contains patterns or visual features that allow the viewer/operator to distinguish and classify many different types of video effects (edits and otherwise): cuts, wipes, dissolves, fades, camera motions, object motions, flashlights, zooms, etc. The different video effects manifest themselves as different patterns on the visual rhythm. Using the visual rhythm, it becomes possible, without sequentially playing the entire video, to find false positive shots as well as undetected shots. Thus, inclusion of the visual rhythm in the shot verification process will aid the operator to verify detected shots as well as to find undetected shots fast and efficiently. Our newly developed shot verifier based on the visual rhythm has been designed for operator efficiency. The design of our shot verifier presented and the usefulness of the visual rhythm during the shot verification process will be demonstrated.",
keywords = "Shot verification, Video edit effects, Visual rhythm",
author = "Hyeokman Kim and Jinho Lee and Yang, {Jae Heon} and Sanghoon Sull and Kim, {Woon Kyung} and Song, {S. Moon Ho}",
year = "2001",
month = "12",
day = "1",
doi = "10.1023/A:1012452131892",
language = "English",
volume = "15",
pages = "227--245",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - Visual rhythm and shot verification

AU - Kim, Hyeokman

AU - Lee, Jinho

AU - Yang, Jae Heon

AU - Sull, Sanghoon

AU - Kim, Woon Kyung

AU - Song, S. Moon Ho

PY - 2001/12/1

Y1 - 2001/12/1

N2 - Typical result of an automatic shot change detection algorithm expectedly includes a certain number of undetected shots as well as falsely detected shots. Even though automatic shot change detection algorithms are continuing to improve, the ultimate goal of automatically detecting all shot changes without false alarms may never be achieved. Thus, allowing a human operator to intervene-to review and verify the result of a shot change detection algorithm, to delete falsely detected shots as well as to find undetected shots-may be the most viable approach currently available for increasing the accuracy of the overall shot detection process. For this exact purpose, we propose a shot verifier based on the visual rhythm. The visual rhythm, an abstraction of the video, is a single image, a sub-sampled version of a full video in which the sampling is performed in a pre-determined and in a systematic fashion. It is a representation of the video, which includes the overall content of the video. But most importantly, the visual rhythm contains patterns or visual features that allow the viewer/operator to distinguish and classify many different types of video effects (edits and otherwise): cuts, wipes, dissolves, fades, camera motions, object motions, flashlights, zooms, etc. The different video effects manifest themselves as different patterns on the visual rhythm. Using the visual rhythm, it becomes possible, without sequentially playing the entire video, to find false positive shots as well as undetected shots. Thus, inclusion of the visual rhythm in the shot verification process will aid the operator to verify detected shots as well as to find undetected shots fast and efficiently. Our newly developed shot verifier based on the visual rhythm has been designed for operator efficiency. The design of our shot verifier presented and the usefulness of the visual rhythm during the shot verification process will be demonstrated.

AB - Typical result of an automatic shot change detection algorithm expectedly includes a certain number of undetected shots as well as falsely detected shots. Even though automatic shot change detection algorithms are continuing to improve, the ultimate goal of automatically detecting all shot changes without false alarms may never be achieved. Thus, allowing a human operator to intervene-to review and verify the result of a shot change detection algorithm, to delete falsely detected shots as well as to find undetected shots-may be the most viable approach currently available for increasing the accuracy of the overall shot detection process. For this exact purpose, we propose a shot verifier based on the visual rhythm. The visual rhythm, an abstraction of the video, is a single image, a sub-sampled version of a full video in which the sampling is performed in a pre-determined and in a systematic fashion. It is a representation of the video, which includes the overall content of the video. But most importantly, the visual rhythm contains patterns or visual features that allow the viewer/operator to distinguish and classify many different types of video effects (edits and otherwise): cuts, wipes, dissolves, fades, camera motions, object motions, flashlights, zooms, etc. The different video effects manifest themselves as different patterns on the visual rhythm. Using the visual rhythm, it becomes possible, without sequentially playing the entire video, to find false positive shots as well as undetected shots. Thus, inclusion of the visual rhythm in the shot verification process will aid the operator to verify detected shots as well as to find undetected shots fast and efficiently. Our newly developed shot verifier based on the visual rhythm has been designed for operator efficiency. The design of our shot verifier presented and the usefulness of the visual rhythm during the shot verification process will be demonstrated.

KW - Shot verification

KW - Video edit effects

KW - Visual rhythm

UR - http://www.scopus.com/inward/record.url?scp=0035576590&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035576590&partnerID=8YFLogxK

U2 - 10.1023/A:1012452131892

DO - 10.1023/A:1012452131892

M3 - Article

VL - 15

SP - 227

EP - 245

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

IS - 3

ER -