Archives for posts with tag: movement

The V&A Museum has an exciting exhibit currently open in the Sackler Centre. ‘Digital Dragons’ makes two Chinese paintings ‘come alive’ through digital projection and a whole body interface supported by Kinect devices. Stepping on the floor influences the projection of the painting: depending on where you step, the landscape painting gains colour and human activity and in the other painting, dragons begin to chase coloured pearls.

WBI V and A

At MODE we’ve been observing children as they interact with the exhibit. In a series of naturalistic observations, we videoed 1-4 year olds interacting with the exhibit with their parents. In the next phase of research, we observed 7-8 year olds from the same school interacting with the exhibit, and then interviewed them afterwards to see how they had made sense of the experience.

Our questions in conducting these observations have been broad. We’re interested in how children make sense of their movements in relation to the projected visual activity; how the involvement of the whole body in this experience might influence the children’s interpretations of the paintings involved in the exhibit; and how social interactions are configured and coordinated in this type of interactive museum space.

In-depth analysis will begin soon. Our preliminary thoughts and ideas have centred on where the students focused their attention. For the first cycle of the interaction with the paintings, many of the children seemed to focus exclusively on the colour and movement they saw on the floor. Over the course of their interaction however, they became increasingly aware that their movements were having an impact on the projected image and began to make sense of exactly what this relationship was. This might suggest that exhibits that make use of two separately located sites of activity (here the floor and the wall) may require sustained interaction if students are to understand how activity in these spaces is connected.

I found jotting down 10 things I know about phenomenology a helpful exercise for consolidating and summarizing knowledge of a central approach in embodiment research. Over the last few weeks, I have repeatedly come across the term ‘Somaesthetics’ in relation to embodiment and have done some preliminary reading on the term. In an effort to make sense of the fledgling understanding I’ve gained, I decided to try the ’10 things I know’ approach again. Without looking at books, notes or papers, I scribbled down the following:

1. Somaesthetics is an emerging discipline primarily proposed by Richard Shusterman, who argues for it to sit within Philosophy, and more specifically the philosophical sub-discipline of Aesthetics.

2. Somaesthetics as a discipline foregrounds the role of bodily experience in aesthetic appreciation. Shusterman argues that it will offer a more substantial and systematic framework for research on the body.

3. Somaesthetics comprises three branches: Analytic somaesthetics; Pragmatic somaesthetics; Practical somaesthetics

Somaesthetics Diagram

4. Analytic somaesthetics comprises interpretive studies of bodily practice. These occur on a theoretical level and would include research linking the body and bodily practices with the organization of society and the individual psyche. Shusterman argues that the work of Foucault, Bourdieu and Merleau-Ponty would all constitute analytic somaesthetics.

5. Pragmatic somaesthetics comprises bodies of thought that suggest ways of training or harnessing bodily experience. Practices such as Tai Chi and the Alexander Technique are accompanied by ideas and theories of the body and these would belong to this branch of pragmatic somaesthetics.

6. Practical somaesthetics consists of the practice itself – the Tai Chi, or the yoga, or the Alexander Technique. It is not entirely clear which bodily practices Shusterman chooses to accept within practical somaesthetics. He seems to place less value on athletics or football, and much more on solitary practices that reference bodily understanding more explicitly.

7. In foregrounding the body in aesthetic experience, Shusterman argues that a distinction needs to be drawn between representational foregrounding and experiential foregrounding. In the former, the body is seen and treated as an external object. In the latter, the body is a fundamental part or vehicle of lived experience.

8. Critiques of somaesthetics include the linking of the discipline to normative approaches to the body. Somaesthetics places a value on the physical cultivation of the body and this is reminiscent of doctrines that treat the body as an object to be molded into a form that conforms to the social ideal.

9. Shusterman’s response to this critique rests on the distinction he makes between representational and experiential foregrounding of the body. Thus, he argues that cultivating the body as it is experienced (rather than as it is represented) does not relate to social norms, but rather to the improvement of individual perception and action.

10. Shusterman advocates that there is a role for somaesthetics in education since it enables us to ‘feel better’ in both senses of the phrase. Cultivating bodily practices heightens our sensations and perceptions of the world around us; they also encourage us to be more in control and more caring of the self.

The combination of theoretical and practical approaches to the body certainly makes the discipline of somaesthetics an interesting prospect, but I am left with questions about the possibility and worth of trying to merge these perspectives. Shusterman’s framework makes such a sharp and convincing distinction between analytic, pragmatic and practical somaesthetics, that it isn’t clear how it draws these together at all. How are Foucault’s theories of the body related to the theory or practice of yoga? How can somaesthetics help us to access this relationship? Is this a relationship that should exist given how different the objectives related to each project are? Certainly, I believe that theorists of the body can learn much from bodily practices and practitioners who work with the body, but what is the benefit of binding them together in a single discipline?

Shusterman, R. (2008) Body consciousness: A philosophy of mindfulness and somaesthetics. Cambridge: Cambridge University Press.

Shusterman, R. (2006) Thinking through the body, educating for the humanities: A plea for somaesthetics. The journal of aesthetic education, 40(1), 1-21.

By Mona Sakr

An overview Loke and Robertson’s ‘Making Strange’ methodology and a discussion of its relevance to embodiment

In Loke and Robertson’s (2008) ‘making strange’ methodology, the way we perceive and feel the moving body is actively unsettled in order to find new perspectives on the body and bodily interaction. The practice of ‘making strange’ builds on the work of dancer Maxine Sheets-Johnstone who explored the phenomenological consequences when individuals disrupted their familiar or habitual movements. In ‘making strange’, our assumptions and habitual understandings about the body are unsettled through explicit inquiries into movement. Loke and Robertson argue that de-familiarising the movements of the body can open up new spaces in the design of artefacts and technologies. It can help us to invent or devise new types of movement; it enables an investigation into the experience of movement; and it encourages us to find new methods for re-enacting or recording movement.

 So how does ‘making strange’ work? Loke and Robertson suggest a range of techniques that can facilitate innovative thinking about the body and movement:

  • Scoring – a simple score might consist of three movements e.g. walking, standing and crouching, but by improvising in terms of the speed, duration, order, focus, or use of space, these movements can be radically altered.
  • Falling – unorthodox movements, like falling, can help us to re-feel and re-negotiate our relationship with the moving body.
  • Somatics – certain practices, like Qi Gong, can help us to become more aware of our felt sensations and to prioritise these over the external perception of movement.
  • Finding Pathways – what part of the body do you lead with when you move, and what would happen if this were changed? Try walking left shoulder-first, or leading with your elbow when you lift your arm.
  • Imagery – the language we use to talk about the body and movement can help us to enact movements differently. Think of the ‘light as a feather, stiff as a board’ game that you may have played when you were younger. Chanting these words as a group while lifting one of your peers changes the experience.

For dancers, these techniques are a way of accessing, inventing and designing new forms of movement. For researchers of the body though, we also need methods for capturing responses to these movement techniques. And as designers, we need to link these responses to, or ‘write’ them into, systems that depend on movement.

Some ideas for recording responses might include:

  • Video to capture the movement
  • Transcriptions of the movement through visual plots e.g. plotting the motion of particular points on the body
  • Photography to capture the moments that define the essential points of the movement e.g. when we raise our hands, the essence of the movement is in the fingers raised towards the sky
  • In situ comments on the phenomenological consequences of the movement
  • Oral or written reflective commentaries

‘Making strange’ is an exciting starting point in the design of embodied interaction. Beyond the techniques it suggests though, we need robust methods for capturing the outcomes of practising these techniques, along with guidelines for implementing them in the design of systems that depend on whole-body interaction. For me, the next step in understanding the ‘making strange’ methodology will be to try the techniques suggested by Loke and Robertson and to capture my responses in the ways I’ve suggested.  Will the outcomes be useful in thinking about and designing for whole-body interaction?

Loke, L. & Robertson, T. (2008) Inventing and devising movement in the design of movement-based interactive systems. OZCHI’08 (81-88).

By Mona Sakr

Exploring the usefulness of the ‘body-thing dialogue’ metaphor for understanding embodied interaction in digital environments

In 2006, Larssen, Robertson & Edwards presented the paper ‘How it feels, not just how it looks: When bodies interact with technology’ at the Australian Computer-Human Interaction conference (OZCHI). In this paper, they suggest that  the embodied nature of interactions with technology can be accessed by thinking about each interaction as a body-thing dialogue. The body-thing dialogue is the bodily interaction that occurs between an individual and an artifact. The body-thing dialogue happens through the mode of movement and makes possible the potential for action that forms the basis of the interaction. Through this metaphor, Larssen et al. hoped to shift the focus towards the bodily nature of interactions with technologies – the extent to which these experiences are physically felt.

I would argue that the body-thing dialogue is a useful metaphor in some ways and a misleading one in other ways.

It is useful because it draws attention to the distinct and temporal nature of each embodied interaction:

  • Every dialogue we engage in is different. Similarly, in human-computer interaction each interaction with technology unfolds in a specific way and in a particular context. Flow diagrams based on a non-existent ‘typical’ user do not help us to access the nature of embodied interaction.
  • Every dialogue unfolds over time and can radically change from moment to moment. Similarly, each embodied interaction takes place over time and is historical – each aspect of the interaction happens in relation to the aspects that have preceded it.

But the metaphor of the body-thing dialogue is also a misleading way to think about embodied interactions in digital environments:

  • Movement is a different mode to speech, with different opportunities and constraints. Is it right to apply the notion of ‘dialogue’ in the context of movement?
  • Can we apply the term ‘dialogue’ to make sense of the way movements unfold between ‘a body’ and ‘a thing’? Certainly, the movements of the body and the movements of an object are not equivalents in the way that the speech of two human participants is.
  • Larssen et al. suggest that the body-thing dialogue is a useful way of looking at ‘how we use our proprioceptive sense and motor skills when incorporating a tool in our bodily space so that it becomes an extension of our bodies’ (p. 2). The notion of dialogue takes us away, however, from the concept of incorporation. In a dialogue, there is self and other – the object responds to us, rather than becoming an extension of us.

So what alternative metaphors or conceptual tools enable us to think about embodied interaction in digital environments? I have yet to come across a theory that helps to frame interactions with artefacts so that the focus is on the body and felt experience, but does not trip into the pitfalls outlined above. We need to conceptualise interactions as physical couplings without using metaphors that draw on other modes of communication.

Larssen, A. T., Robertson, T., & Edwards, J. (2006, November). How it feels, not just how it looks: when bodies interact with technology. In Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments (pp. 329-332). ACM.

By Mona Sakr

In a study by Bianchi-Berthouze et al. (2007), game-playing through a whole-body interface was compared with control through the hands. When participants in the study controlled the game (Guitar Hero) through their whole bodies, they reported more engagement, as well as displaying increased engagement through game-related body movements that were unnecessary for control (e.g. nodding their heads in time to the music).

Why were users more engaged when control of the game involved their whole bodies? Bianchi-Berthouze et al. suggested that the relationship came about as a result of increased affect.

Body Affect Engagement

By involving the body, the affective dimension of the experience increased, and in turn, this impacted upon engagement. Shouse (2005, p. 5) defines affect as a ‘non-conscious experience of intensity; it is a moment of unformed and unstructured potential’. Why does involving the body to a greater extent increase the affective response? And what are the implications of this relationship for the design of technologies and pedagogy?

Bianchi-Berthouze, N., Kim, W. W., & Patel, D. (2007) Does body movement engage you more in digital game play? And Why? Proceedings of the International Conference of Affective Computing and Intelligent Interaction (102-113) 

By Mona Sakr

‘Just as others have argued that it is through our ways of seeing the world that we become viewing subjects (see Crang, 1997), it is through our bodies that we become doing subjects.’ (p. 261)

Jaworski, A. & Thurlow, C. (2011) Gesture and movement in tourist spaces. In C. Jewitt (Ed.) The Routledge Handbook of Multimodal Analysis. Abingdon: Routledge, pp. 253 – 263.