Visual categorization of social interactions

Stephan de la Rosa, Rabia N. Choudhery, Cristóbal Curio, Shimon Ullman, Liav Assif, Heinrich Bulthoff

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Prominent theories of action recognition suggest that during the recognition of actions the physical patterns of the action is associated with only one action interpretation (e.g., a person waving his arm is recognized as waving). In contrast to this view, studies examining the visual categorization of objects show that objects are recognized in multiple ways (e.g., a VW Beetle can be recognized as a car or a beetle) and that categorization performance is based on the visual and motor movement similarity between objects. Here, we studied whether we find evidence for multiple levels of categorization for social interactions (physical interactions with another person, e.g., handshakes). To do so, we compared visual categorization of objects and social interactions (Experiments 1 and 2) in a grouping task and assessed the usefulness of motor and visual cues (Experiments 3, 4, and 5) for object and social interaction categorization. Additionally, we measured recognition performance associated with recognizing objects and social interactions at different categorization levels (Experiment 6). We found that basic level object categories were associated with a clear recognition advantage compared to subordinate recognition but basic level social interaction categories provided only a little recognition advantage. Moreover, basic level object categories were more strongly associated with similar visual and motor cues than basic level social interaction categories. The results suggest that cognitive categories underlying the recognition of objects and social interactions are associated with different performances. These results are in line with the idea that the same action can be associated with several action interpretations (e.g., a person waving his arm can be recognized as waving or greeting).

Original languageEnglish
Pages (from-to)1233-1271
Number of pages39
JournalVisual Cognition
Volume22
DOIs
Publication statusPublished - 2015 Jan 1

Fingerprint

Interpersonal Relations
Beetles
Cues
Recognition (Psychology)
Social Interaction

Keywords

  • Basic level
  • Objects
  • Social interactions
  • Sub-ordinate level
  • Visual categorization

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Cognitive Neuroscience
  • Arts and Humanities (miscellaneous)

Cite this

de la Rosa, S., Choudhery, R. N., Curio, C., Ullman, S., Assif, L., & Bulthoff, H. (2015). Visual categorization of social interactions. Visual Cognition, 22, 1233-1271. https://doi.org/10.1080/13506285.2014.991368

Visual categorization of social interactions. / de la Rosa, Stephan; Choudhery, Rabia N.; Curio, Cristóbal; Ullman, Shimon; Assif, Liav; Bulthoff, Heinrich.

In: Visual Cognition, Vol. 22, 01.01.2015, p. 1233-1271.

Research output: Contribution to journalArticle

de la Rosa, S, Choudhery, RN, Curio, C, Ullman, S, Assif, L & Bulthoff, H 2015, 'Visual categorization of social interactions', Visual Cognition, vol. 22, pp. 1233-1271. https://doi.org/10.1080/13506285.2014.991368
de la Rosa S, Choudhery RN, Curio C, Ullman S, Assif L, Bulthoff H. Visual categorization of social interactions. Visual Cognition. 2015 Jan 1;22:1233-1271. https://doi.org/10.1080/13506285.2014.991368
de la Rosa, Stephan ; Choudhery, Rabia N. ; Curio, Cristóbal ; Ullman, Shimon ; Assif, Liav ; Bulthoff, Heinrich. / Visual categorization of social interactions. In: Visual Cognition. 2015 ; Vol. 22. pp. 1233-1271.
@article{78de5f3d428a40499da6f0f560d49e4c,
title = "Visual categorization of social interactions",
abstract = "Prominent theories of action recognition suggest that during the recognition of actions the physical patterns of the action is associated with only one action interpretation (e.g., a person waving his arm is recognized as waving). In contrast to this view, studies examining the visual categorization of objects show that objects are recognized in multiple ways (e.g., a VW Beetle can be recognized as a car or a beetle) and that categorization performance is based on the visual and motor movement similarity between objects. Here, we studied whether we find evidence for multiple levels of categorization for social interactions (physical interactions with another person, e.g., handshakes). To do so, we compared visual categorization of objects and social interactions (Experiments 1 and 2) in a grouping task and assessed the usefulness of motor and visual cues (Experiments 3, 4, and 5) for object and social interaction categorization. Additionally, we measured recognition performance associated with recognizing objects and social interactions at different categorization levels (Experiment 6). We found that basic level object categories were associated with a clear recognition advantage compared to subordinate recognition but basic level social interaction categories provided only a little recognition advantage. Moreover, basic level object categories were more strongly associated with similar visual and motor cues than basic level social interaction categories. The results suggest that cognitive categories underlying the recognition of objects and social interactions are associated with different performances. These results are in line with the idea that the same action can be associated with several action interpretations (e.g., a person waving his arm can be recognized as waving or greeting).",
keywords = "Basic level, Objects, Social interactions, Sub-ordinate level, Visual categorization",
author = "{de la Rosa}, Stephan and Choudhery, {Rabia N.} and Crist{\'o}bal Curio and Shimon Ullman and Liav Assif and Heinrich Bulthoff",
year = "2015",
month = "1",
day = "1",
doi = "10.1080/13506285.2014.991368",
language = "English",
volume = "22",
pages = "1233--1271",
journal = "Visual Cognition",
issn = "1350-6285",
publisher = "Psychology Press Ltd",

}

TY - JOUR

T1 - Visual categorization of social interactions

AU - de la Rosa, Stephan

AU - Choudhery, Rabia N.

AU - Curio, Cristóbal

AU - Ullman, Shimon

AU - Assif, Liav

AU - Bulthoff, Heinrich

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Prominent theories of action recognition suggest that during the recognition of actions the physical patterns of the action is associated with only one action interpretation (e.g., a person waving his arm is recognized as waving). In contrast to this view, studies examining the visual categorization of objects show that objects are recognized in multiple ways (e.g., a VW Beetle can be recognized as a car or a beetle) and that categorization performance is based on the visual and motor movement similarity between objects. Here, we studied whether we find evidence for multiple levels of categorization for social interactions (physical interactions with another person, e.g., handshakes). To do so, we compared visual categorization of objects and social interactions (Experiments 1 and 2) in a grouping task and assessed the usefulness of motor and visual cues (Experiments 3, 4, and 5) for object and social interaction categorization. Additionally, we measured recognition performance associated with recognizing objects and social interactions at different categorization levels (Experiment 6). We found that basic level object categories were associated with a clear recognition advantage compared to subordinate recognition but basic level social interaction categories provided only a little recognition advantage. Moreover, basic level object categories were more strongly associated with similar visual and motor cues than basic level social interaction categories. The results suggest that cognitive categories underlying the recognition of objects and social interactions are associated with different performances. These results are in line with the idea that the same action can be associated with several action interpretations (e.g., a person waving his arm can be recognized as waving or greeting).

AB - Prominent theories of action recognition suggest that during the recognition of actions the physical patterns of the action is associated with only one action interpretation (e.g., a person waving his arm is recognized as waving). In contrast to this view, studies examining the visual categorization of objects show that objects are recognized in multiple ways (e.g., a VW Beetle can be recognized as a car or a beetle) and that categorization performance is based on the visual and motor movement similarity between objects. Here, we studied whether we find evidence for multiple levels of categorization for social interactions (physical interactions with another person, e.g., handshakes). To do so, we compared visual categorization of objects and social interactions (Experiments 1 and 2) in a grouping task and assessed the usefulness of motor and visual cues (Experiments 3, 4, and 5) for object and social interaction categorization. Additionally, we measured recognition performance associated with recognizing objects and social interactions at different categorization levels (Experiment 6). We found that basic level object categories were associated with a clear recognition advantage compared to subordinate recognition but basic level social interaction categories provided only a little recognition advantage. Moreover, basic level object categories were more strongly associated with similar visual and motor cues than basic level social interaction categories. The results suggest that cognitive categories underlying the recognition of objects and social interactions are associated with different performances. These results are in line with the idea that the same action can be associated with several action interpretations (e.g., a person waving his arm can be recognized as waving or greeting).

KW - Basic level

KW - Objects

KW - Social interactions

KW - Sub-ordinate level

KW - Visual categorization

UR - http://www.scopus.com/inward/record.url?scp=84922374631&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84922374631&partnerID=8YFLogxK

U2 - 10.1080/13506285.2014.991368

DO - 10.1080/13506285.2014.991368

M3 - Article

AN - SCOPUS:84922374631

VL - 22

SP - 1233

EP - 1271

JO - Visual Cognition

JF - Visual Cognition

SN - 1350-6285

ER -