How We Act Together

Lauren Lee McCarthy and Kyle McDonald








“The ultimate behavioral materials are the glances, gestures, positionings, and verbal statements that people continuously feed into the situation, whether intended or not. These are the external signs of orientation and involvement—states of mind and body not ordinarily examined with respect to their social organization.”
—Erving Goffman, Interaction Ritual

How We Act Together focuses a lens on the small gestures of social interaction, asking participants to repeat them until exhausted, to a point where the gesture no longer feels natural and its meaning begins to shift. Interrogating a gesture through repetition evokes the discomfort we sometimes encounter in social interactions in the wild. We are becoming increasingly familiar with conversations characterized by divided attention and a loss of connection.

But the gesture is not completely empty, as the participant’s performance triggers a response. For as long as the participant acts, they are able to view a stream of all the previous participants performing the same action back at them. Distributed across a crowd, spread over space and time, an asynchronous interaction takes place that is both awkward and intimate.

The entire interaction is choreographed by the software. Participants act on command from the screen, and their performance does not begin until they conform to the metrics of computer vision algorithms that recognize their gesture. The software validates their human expressions and movements, allowing them access to the crowd of people interacting together.

Project site
hwat.schirn.de

Press
The Simplest Forms of Communication, Joanne McNeil
Meaningful Interactions, Paolo Ruffino

Commissioned by Schirn Kunsthalle Frankfurt, built by Apollo. Special thanks to Fabian Famulok.