Can we stop presenting ideas through text?

Lacey kim
3/1/2010 - 5:15pm

Media

See video
See video
Printer-friendly version

A few Fridays ago, I attended the UNC C.H.A.T. festival along with a friend to check out some cool exhibits and see our professors speak. Unfortunately we got lost on Carolina campus and saw unplanned exhibits anyway, but it was a great experience nevertheless.

The first event we attended was an event called "Festival on the Hill: The Art and Culture of the DJ". We got to hear Prof Mark Butler from Northwestern University Bienen School of Music give a presentation about Jeff Mills, an influential American DJ from Detroit. Mark broke down for us the composition of "Bells (see video below)" as far as the repetition of thematic rhythms, Mills' manipulation of the turntables at slow motion, etc... for someone like me who has a very vague understanding of the art of DJ'ing, it was fascinating.

The second event was called "The Bathysphere: Motion Capture as Art" and was put together by Francesca Talenti (UNC Communication Studies) and Greg Welch (UNC Computer Science). You walked into a room, opera blasting within, an underwater scene projected on 3 sides of the walls. Then you are encouraged to pick up objects like a fishing pole, an umbrella that had motion sensors attached on them to move the corresponding images onto the walls. For example, at 0:12 of the video you see my friend interacting with a little ball to move the octopus image on the wall.

(see video below)

After interacting with the experience, I kept thinking... this was cool, but... what? What am I supposed to take away from the experience of moving projected fish images around with the fishing pole? I realize that the motion sensor technology is NEW and game-changing, and I think the artists were trying to incorporate this new capability into a gaming experience (or such is my assumption). Maybe they wanted me to take away whatever I wanted from it. What if the people interacting with the objects could assign different tones/rhythms to themselves and represent a "part of the opera"?

-----

The common theme that emerged for me out of these experiences was how the two very different presentations toyed with the idea of moving away from TEXT to present information.

By that I mean, in the Bathysphere presentation, instead of having the audience read an article/give a powerpoint lecture about the benefits of merging motion sensor technology and the interactive gaming experience... they made it into a real, physical experience with auditory and tactile stimulation that helped the participants remember the concept and appreciate the potential with multiple sensory memories leaving the arena. I personally thought such approach is most effective in our changing world where we are so used to having multiple senses be stimulated at the same time -- and thought the DJ presentation could have used a little more of it.

What if instead of just talking about Jeff Mills' background and the different musical sequences while standing up on a podium... and inserting YouTube videos here and there in the presentation... you had a turntable that the audience could come and interact with to see the technical complexity involved in the equipment? What if you asked the audience to try to pick up on different sequences and main motifs that Mills manipulate throughout the 3-minute segment... and compare amongst themselves?

With the incredible speed at which multimedia tools are being developed and adapted, I really don't fancy hearing "just another Powerpoint presentation", lest one complete with just text bullets. Let's stimulate the senses! We have 5! (or more, depending on what you believe)

jamesdcalder

Great post!  I've also

Great post!  I've also recently become very interested in how to express information in ways other than through text.  I've come across a few cool examples in art, especially things like the 1960s "Concrete Poetry" movement (which, admittedly does rely somewhat but not exclusively on textual components).   Another great more recent example is Vectors Journal.  The site takes a little while to get used to, but the whole concept of combining text, sound, images, interactive archives, etc. is pretty amazing.  Let me know if you find anything cool.

Cathy Davidson

More Ideas With Sound, Without Text

Hi, Lacey,

 

This terrific post makes me think about a visit we just had from a wonderful scholar of music and technology, Tara Rodgers, who is finishing her Ph.D. in Communication Studies at McGill University in Montreal and is the author of a new book, coming out soon from Duke University Press, Pink Noises, about women and early electronic music.   We had a great conversation about music, sound, and language--and the differences between them, and she sent me this fabulous links and gave me permission to use them here.  Check these out!   Talk about presenting ideas without text!

 

Here is a link to the Italian composer's gibberish English pop song:
http://www.youtube.com/watch?v=RagOFAR0H2I

...and AGF, the Berlin-based electronic music composer who does nice digital deconstructions of language:
<http://www.youtube.com/watch?v=RagOFAR0H2I>http://www.poemproducer.com/freemusic.php

Her album 'head slash bauch' is the one where she reworks HTML code as poetry:
<http://www.poemproducer.com/freemusic.php>http://www.allmusic.com/cg/amg.dll?p=amg&sql=10:hnfixqe0ldje

And here's Tara Rodgers' own intereseting website, including her own electronic music with nature sounds:
<http://www.allmusic.com/cg/amg.dll?p=amg&sql=10:hnfixqe0ldje>