Variable silhouette energy image representations for recognizing human actions

Mohiuddin Ahmad, Seong Whan Lee

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Recognizing human actions is an important topic in the computer vision community. One of the challenges of recognizing human actions is describing for the variability that arises when arbitrary view camera captures human performing actions. In this paper, we propose a spatio-temporal silhouette representation, called silhouette energy image (SEI), and multiple variability action models, to characterize motion and shape properties for automatic recognition of human actions in daily life. To address the variability in the recognition of human actions, several parameters, such as anthropometry of the person, speed of the action, phase (starting and ending state of an action), camera observations (distance from camera, slanting motion, and rotation of human body), and view variations are proposed. We construct the variability (or adaptable) models based on SEI and the proposed parameters. Global motion descriptors express the spatio-temporal properties of combined energy templates (SEI and variability action models). Our construction of the optimal model for each action and view is based on the support vectors of global motion descriptions of action models. We recognize different daily human actions of different styles successfully in the indoor and outdoor environment. Our experimental results show that the proposed method of human action recognition is robust, flexible and efficient.

Original languageEnglish
Pages (from-to)814-824
Number of pages11
JournalImage and Vision Computing
Volume28
Issue number5
DOIs
Publication statusPublished - 2010 May 1

Fingerprint

Cameras
Anthropometry
Computer vision

Keywords

  • Action recognition
  • Daily life actions
  • Global motion description
  • Silhouette energy image
  • Variability action models

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Variable silhouette energy image representations for recognizing human actions. / Ahmad, Mohiuddin; Lee, Seong Whan.

In: Image and Vision Computing, Vol. 28, No. 5, 01.05.2010, p. 814-824.

Research output: Contribution to journalArticle

@article{afdcff02967b4e48b43f19ba037cd1fa,
title = "Variable silhouette energy image representations for recognizing human actions",
abstract = "Recognizing human actions is an important topic in the computer vision community. One of the challenges of recognizing human actions is describing for the variability that arises when arbitrary view camera captures human performing actions. In this paper, we propose a spatio-temporal silhouette representation, called silhouette energy image (SEI), and multiple variability action models, to characterize motion and shape properties for automatic recognition of human actions in daily life. To address the variability in the recognition of human actions, several parameters, such as anthropometry of the person, speed of the action, phase (starting and ending state of an action), camera observations (distance from camera, slanting motion, and rotation of human body), and view variations are proposed. We construct the variability (or adaptable) models based on SEI and the proposed parameters. Global motion descriptors express the spatio-temporal properties of combined energy templates (SEI and variability action models). Our construction of the optimal model for each action and view is based on the support vectors of global motion descriptions of action models. We recognize different daily human actions of different styles successfully in the indoor and outdoor environment. Our experimental results show that the proposed method of human action recognition is robust, flexible and efficient.",
keywords = "Action recognition, Daily life actions, Global motion description, Silhouette energy image, Variability action models",
author = "Mohiuddin Ahmad and Lee, {Seong Whan}",
year = "2010",
month = "5",
day = "1",
doi = "10.1016/j.imavis.2009.09.018",
language = "English",
volume = "28",
pages = "814--824",
journal = "Image and Vision Computing",
issn = "0262-8856",
publisher = "Elsevier Limited",
number = "5",

}

TY - JOUR

T1 - Variable silhouette energy image representations for recognizing human actions

AU - Ahmad, Mohiuddin

AU - Lee, Seong Whan

PY - 2010/5/1

Y1 - 2010/5/1

N2 - Recognizing human actions is an important topic in the computer vision community. One of the challenges of recognizing human actions is describing for the variability that arises when arbitrary view camera captures human performing actions. In this paper, we propose a spatio-temporal silhouette representation, called silhouette energy image (SEI), and multiple variability action models, to characterize motion and shape properties for automatic recognition of human actions in daily life. To address the variability in the recognition of human actions, several parameters, such as anthropometry of the person, speed of the action, phase (starting and ending state of an action), camera observations (distance from camera, slanting motion, and rotation of human body), and view variations are proposed. We construct the variability (or adaptable) models based on SEI and the proposed parameters. Global motion descriptors express the spatio-temporal properties of combined energy templates (SEI and variability action models). Our construction of the optimal model for each action and view is based on the support vectors of global motion descriptions of action models. We recognize different daily human actions of different styles successfully in the indoor and outdoor environment. Our experimental results show that the proposed method of human action recognition is robust, flexible and efficient.

AB - Recognizing human actions is an important topic in the computer vision community. One of the challenges of recognizing human actions is describing for the variability that arises when arbitrary view camera captures human performing actions. In this paper, we propose a spatio-temporal silhouette representation, called silhouette energy image (SEI), and multiple variability action models, to characterize motion and shape properties for automatic recognition of human actions in daily life. To address the variability in the recognition of human actions, several parameters, such as anthropometry of the person, speed of the action, phase (starting and ending state of an action), camera observations (distance from camera, slanting motion, and rotation of human body), and view variations are proposed. We construct the variability (or adaptable) models based on SEI and the proposed parameters. Global motion descriptors express the spatio-temporal properties of combined energy templates (SEI and variability action models). Our construction of the optimal model for each action and view is based on the support vectors of global motion descriptions of action models. We recognize different daily human actions of different styles successfully in the indoor and outdoor environment. Our experimental results show that the proposed method of human action recognition is robust, flexible and efficient.

KW - Action recognition

KW - Daily life actions

KW - Global motion description

KW - Silhouette energy image

KW - Variability action models

UR - http://www.scopus.com/inward/record.url?scp=76449086521&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=76449086521&partnerID=8YFLogxK

U2 - 10.1016/j.imavis.2009.09.018

DO - 10.1016/j.imavis.2009.09.018

M3 - Article

VL - 28

SP - 814

EP - 824

JO - Image and Vision Computing

JF - Image and Vision Computing

SN - 0262-8856

IS - 5

ER -