Bridging the Phyical-Digital Divide

motione: Using state of the art, real time motion capture technologies and motion analysis techniques, the movement of the dancers and the structures of the choreography are analyzed in real time. Through novel artificial intelligence and human-computer interaction systems, the results of the analysis informs the creation of digital graphics and sound environments that react to, accompany, enhance and comment on the choreography.

The works investigate future possibilities for interactive art works while exploring the effects of the new digital sensing, processing and creation possibilities on the human condition. They propose integrations paths that will allow these technologies to enhance and promote humanism.
The motione project of the Arts, Media and Engineering (AME) program at ASU, brings together choreographers Trisha Brown and Bill T. Jones; media artists Paul Kaiser, Shelley Eshkar and Marc Downie; composers Roger Reynolds and Curtis Bahn; lighting designer Robert Weirzel with AME artists and engineers for the creation of two ground breaking, interactive multimedia works, new motion analysis systems and interactive technologies. motione premieres on April 9th 2005 at ASU ‘s Galvin Playhouse.

motione is a joint project of the Arts, Media and Engineering Program through the Herberger College of Fine Arts, the Fulton School of Engineering. It is co-presented by ASU Public Events. We are grateful for support from the National Endowment for the Arts, the National Science Foundation, Motion Analysis Corporation, Lincoln Center, Arizona Public Service (APS) and City of Tempe Cultural Services.


The physical-digital divide in art

Today, a large percentage of content that is shaping our society reaches us through digitally enabled media (computers, cell phones, TV, movies). Yet, the majority of the established arts, creation, education and presentation communities concentrate solely on physical art manifestations presented in traditional venues (theaters, concert halls, galleries).

We still struggle to find effective ways to connect new forms of digital content to the maturity and sensitivity of traditional art forms. Addressing this divide by successfully integrating physical and digital art forms could raise the level of digital content and end the marginalization of traditional art.

The physical-digital divide in life

Our civilization is currently undergoing major changes. Traditionally, human beings acquired knowledge through experiential interactions with the physical world. That knowledge allowed them to better adapt to their reality and evolve.

Today, the electronic networked world is rapidly becoming an integral aspect of human reality. Our interactions with almost every element of our lives, from the weather, to our habitat, our bodies, our friends and relatives involve computation and mediated information.

However, as any dictionary would point out, knowledge results from experience. To adapt to this new world, we must bridge the gap between computational information and physical experience. We need unified experiences of the physical and computational forces that are shaping our reality.

Integrating the physical and the digital at multiple levels and dimensions

We experience the world concurrently at many different, interconnected levels, from the level of manifestation, to the level of operational structure and the level of semantics. It follows that a convincing physical-digital experience must be integrated at all those levels. All participating elements must contribute to a structurally, aesthetically and semantically coherent experience.

We also experience the world at multiple levels of time. Real time perception, short term memory, long term memory and social memory contribute to our experience. Our structural, aesthetic and semantic integrations must hold true across the multilayered dimension of time.

Finally, we experience the world in an interactive manner where our actions explore and influence our environment. Integrated physical-digital experiences require interactive digital media that allow for exploration while exhibiting adaptability.

Digital media are based on computation and our current society is deeply intertwined with computational infrastructures. It follows that structural integration of digital media into the physical world would have to rely on computation.

Creating embodied hybrid experiences

The music and visual arts communities have been working for the past two decades on creating hybrid physical digital music compositions, visual art works and installations. However, human experience of the world is embodied and multi-modal. Arts can best investigate and depict our current hybrid reality through multi-modal, interactive works that include movement. The main drawback for such works has been the difficulty of digitizing and analyzing movement.

Sampling, digital analysis and digital synthesis of sound and image are already fairly advanced. Complex processing of sound and image can be realized with good accuracy in real time. User-friendly software for interactive analysis and synthesis of sound and image are readily available.

Some of those packages (i.e. Max/MSP/Jitter) allow for the simultaneous processing of both image and sound. The tools for coherent, digital, sound-image interactive compositions are available and increasingly used in all types of settings–from installations in galleries, to jam sessions in music bars, symphonic concerts, educational settings and biodesign experiments.

Documentation and analysis of motion has until recently relied on 2D video capture that provides limited information on the spatial and kinesthetic aspects of movement and has limited capabilities in real time use.

The development of motion capture technology in the past two decades has opened up many possibilities for advanced digitization and analysis of movement. The motione project is developing techniques for advanced real time capture and analysis of movement. These motion analysis systems are being integrated with real time systems for image and sound analysis and synthesis to create unified platforms for the creation of multimodal physical-digital works. […]

Sep 30, 11:00
Trackback URL

Leave a comment


calls + opps performance livestage exhibition installation networked mobile writings participatory locative media augmented/mixed reality event new media video interactive public net art conference virtual intervention distributed second life sound political technology narrative festival tactical lecture art + science conversation social networks social games history surveillance dance music workshop urban mapping collaboration live upgrade! reblog activist wearable immersive public/private data architecture platform body collective aesthetics environment systems city identity film visualization culture telematic wireless web 2.0 site-specific ecology place webcast open source tool software text research intermedia space community audio radio nature hybrid 3-D avatar e-literature audio/visual responsive presence pyschogeography interdisciplinary media object interview physical global/ization ubiquitous theory theater biotechnology relational play code archive bioart generative news DIY robotic light place-specific hacktivism synthetic p2p cinema remix education agency interface language im/material live cinema algorithmic labor copyright simulation mashup animation perception image free/libre software multimedia artificial motion tracking voice convergence streaming reenactment gift economy machinima emergence webcam cyberreality glitch DJ/VJ tv censorship ARG nonlinear tag transdisciplinary touch recycle asynchronous fabbing semantic web hypermedia chance synesthesia biopolitics tangible app social choreography gesture unconference forking 1
1 3-D activist aesthetics agency algorithmic animation app architecture archive ARG art + science artificial asynchronous audio audio/visual augmented/mixed reality avatar bioart biopolitics biotechnology body calls + opps censorship chance cinema city code collaboration collective community conference convergence conversation copyright culture cyberreality dance data distributed DIY DJ/VJ e-literature ecology education emergence environment event exhibition fabbing festival film forking free/libre software games generative gesture gift economy glitch global/ization hacktivism history hybrid hypermedia identity im/material image immersive installation interactive interdisciplinary interface intermedia intervention interview labor language lecture light live live cinema livestage locative media machinima mapping mashup media mobile motion tracking multimedia music narrative nature net art networked new media news nonlinear object open source p2p participatory perception performance physical place place-specific platform play political presence public public/private pyschogeography radio reblog recycle reenactment relational remix research responsive robotic second life semantic web simulation site-specific social social choreography social networks software sound space streaming surveillance synesthesia synthetic systems tactical tag tangible technology telematic text theater theory tool touch transdisciplinary tv ubiquitous unconference upgrade! urban video virtual visualization voice wearable web 2.0 webcam webcast wireless workshop writings



Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul
Jun | May | Apr | Mar | Feb | Jan


Dec | Nov | Oct | Sep | Aug | Jul

What is this?

Networked Performance (N_P) is a research blog that focuses on emerging network-enabled practice.

RSS feeds

N_P offers several RSS feeds, either for specific tags or for all the posts. Click the top left RSS icon that appears on each page for its respective feed. What is an RSS feed?



New Radio and Performing Arts, Inc.
New American Radio
Upgrade! Boston
Massachusetts Cultural Council
New York State Council on the Arts, a State agency
Thinking Blogger Award

Turbulence Works

These are some of the latest works commissioned by's net art commission program.
[ openspace ] wilderness [] A More Subtle Perplex A Temporary Memorial Project for Jobbers' Canyon Built with ConAgra Products A Travel Guide A.B.S.M.L. Ars Virtua Artist-in-Residence (AVAIR) (2007) Awkward_NYC besides, Bonding Energy Bronx Rhymes Cell Tagging Channel TWo: NY Condition:Used Constellation Over Playas Data Diaries Domain of Mount GreylockVideo Portal Eclipse Empire State Endgame: A Cold War Love Story Flight Lines From the Valley of the Deer FUJI spaces and other places Global Direct Google Variations Gothamberg Grafik Dynamo Grow Old Handheld Histories as Hyper-Monuments html_butoh I am unable to tell you I'm Not Stalking You; I'm Socializing iLib Shakespeare (the perturbed sonnet project) INTERP Invisible Influenced iPak - 10,000 songs, 10,000 images, 10,000 abuses iSkyTV Journal of Journal Performance Studies Killbox L-Carrier Les Belles Infidles look art Lumens My Beating Blog MYPOCKET No Time Machine Nothing Happens: a performance in three acts Nothing You Have Done Deserves Such Praise Oil Standard Panemoticon Peripheral n2: KEYBOARD Playing Duchamp Plazaville Psychographics: Consumer Survey Recollecting Adams School of Perpetual Training Searching for Michelle/SFM Self-Portrait Shadow Play: Tales of Urbanization of China ShiftSpace Commissions Program Social Relay Mail Space Video Spectral Quartet Superfund365, A Site-A-Day text_ocean The Xanadu Hijack This and that thought. Touching Gravity 2/Tilt Tumbarumba Tweet 4 Action Urban Attractors and Private Distractors We Ping Good Things To Life Wikireuse Without A Trace WoodEar Word Market You Don't Know Me
More commissions