September 2008


lecture content

.My own projects
What I’m working on right now, what I did the last 5 years and why

.Generating art projects
Collaborating across disciplines: challenges and experiences in the creative process
Zach Lieberman (http://www.thesystemis.com/)

.Critical Art Theory
Discuss in little groups quotes by Marshall McLuhan, Slavoj Zizek, Alexander Galloway,
Guy Debord and Donna Haraway, Baudrillard

Critical Art Ensemble

Schleiner
http://www.opensorcery.net/countdown.html

Michel de Certeau

PARASITIC MEDIA
http://subsol.c3.hu/subsol_2/contributors3/martintext.html

.Wearables
Networked Clothing, interactive fashion and circuit jewelry
Projects by Kyveli Vezani, Carolina Pino, Heather Dewey-Hagborg

.Mobile Phones
Art projects using SMS, MMS, mobile cameras, mobile video or phone in-built sensors
Projects in the afternoon lecture

.Big Games
Interactive art projects in public space, urban interventions, temporary autonomous
zones, Video Game Criticism

.Physical Computing
Microcontrollers and Sensors in contemporary art installations
Projects: Mouna Andraos

Personal Power Plant

.Interactivity for change
Humanitarian, assistive and activist application of new Media

.Participatory Media Art projects
Artists working with/in communities, on specific sites, user-generated content

.Computing and architectural form
Art projects that use ubiquitous media in urban infrastructure to alter their function

.Interactive storytelling
Digital Comics and Sequential Narratives, collective/participatory storytelling

.New Interfaces for musical expression
Inventing new instruments for experimental music, circuit bending, performance
Project: Golan Levin “Scrapple”

PRACTICAL WORK DURING AND AFTER THE LECTURE

a. Read the snippets of critical theory and improvise a conversation being one of the theorists

b. Build a prototype of an idea within one hour: limited time, limited material

c. Expand on an idea: play with random thoughts, control your need for control, see what happens

d. Respond to one of the Terms in the “Concise Lexicon of / for the Digital

Commons” with an object, sound, story or performance

Mobile Devices are not only used for one-to-one communication alone, but to consume, produce and exchange rich media.

A phone’s availability and ubiquitousness makes it an attractive tool for creative, social and participatory projects. Innovations like live streaming, geocoding and mobile web have been applied in unorthodox ways by activists, artists and designers.

Users in developing regions have adopted the mobile phone for purposes like money transfers and microcredit systems.

In this workshop we will explore new concepts of media creation on mobile phones by building our own mobile applications. We will look into an open source environment called MOBILE PROCESSING. It is used by students, artists, designers, researchers, and hobbyists to prototype software for mobile phones. Sketches programmed using MOBILE PROCESSING run on Java Powered mobile devices.

After experimenting with what this software can do and how to use it we will try out the new sketches on our own phones. For this workshop no prior experience with mobile media is required.

indian

indian

………………………………………………………………………………………………………………………
1. LINKS TO MOBILE PHONE APPLICATIONS IN DEVELOPING REGIONS
………………………………………………………………………………………………………………………

See who has access to mobile phones world wide on this map

PROJECTS USING SMS

Frontlines
Frontlines is a free software that makes it easier for NGOs or little grassroot organizations to coordinate/communicate among all members

You can find more projects using text messages for humanitarian work here:

TEXTUALLY

USING WEB

Inveneo
Unveneo is huge in Africa. They provide free internet to rural african areas for healthcare (tele-medicine) and microcredit systems.

USING MMS
Cell life
Cell-life works on effective mobile-based solutions for the management of HIV/Aids

Used for:
* Human rights monitoring
* Disaster relief coordination
* Natural resource management
* Election monitoring
* Emergency alerts
* Mobilising task forces
* Field data collection
* Conducting public surveys
* Health care info requests
* Agricultural price updates
* Organizing protests
* Mobile education programs
* Coordinating fundraising efforts
* Providing weather updates
* And more

………………………………………………………………………………………………………………………
2. LINKS TO MOBILE PHONE ACTIVISM
………………………………………………………………………………………………………………………

VIA MMS/Mobile Video

Witness

Video is democratic tool: it is a relatively easy medium to learn and you do not need to be a filmmaker or a journalist to master it. Video advocacy, however, is a time- and labor-intensive process that requires significant commitment of human and other resources. Witness facilitates these processes.

Organizing via mobile phone

Mobile Active
A resource for activists using mobile technology worldwide.

………………………………………………………………………………………………………………………
3. LINKS TO MOBILE PHONE ART PROJECTS
………………………………………………………………………………………………………………………

Really old (2001), but still one I really like:

DIALTONES (A Telesymphony)
(By Golan Levin, Gregory Shakar, Scott Gibbons, Yasmin Sohrawardy, Joris Gruber, Erich Semlak, Gunther Schmidl, and Joerg Lehner)

“..Telesymphony is a large-scale concert performance whose sounds are wholly produced through the carefully choreographed ringing of the audience’s own mobile phones. Before the concert, participants register their mobile phone numbers at a series of web terminals; in exchange, new ringtone melodies are automatically transmitted to their phones, and their seating assignment tickets are generated. During the concert, the audience’s phones are dialed up by live performers..”

telesymphony

telesymphony

Mobile Feelings – Christa Sommerer and Laurent Mignonneau
“Mobile Feelings” is an artistic project that explores the ambivalence of sharing personal information with an anonymous audience. Instead of communication via voice or images to people we know, “Mobile Feelings” lets people communicate with strangers through virtual touch and body sensations including smell and sweat using specially designed mobile phones.

BINKENLIGHTS

The upper eight floors of the building were transformed in to a huge display by arranging 144 lamps behind the building’s front windows. A computer controlled each of the lamps independently to produce a monochrome matrix of 18 times 8 pixels.

During the night, a constantly growing number of animations could be seen. But there was an interactive component as well: you were able to play the old arcade classic Pong on the building using your mobile phone and you could place your own loveletters on the screen as well.

………………………………………………………………………………………………………………………
3. LINKS TO MOBILE PHONE GAMES
………………………………………………………………………………………………………………………

3 friends I know from NY made this little game:

PENULITMATER

Someone received textmessage with a sentence of a story and added another sentence. Only the last sentence was sent to the next person. Only if you went to their website (http://penultimater.com/) you could read the whole weird outcome.

Another game I really liked is by another guy I know from NY called Mushon Zer-Aviv. It is called:

YOU ARE NOT HERE

..”You Are Not Here (.org) is an urban tourism mash-up. It takes place in the streets of one city and invites participants to become meta-tourists of another city. Download a map, take your phone with you and go tour Gaza through the streets of Tel Aviv or Baghdad through the streets of New York.”


BOTANICALLS

“…Botanicalls allows thirsty plants to place phone calls for human help. When humans phone the plants, they orient callers to their habits and characteristics, including how they like to be watered and cared for.
Botanicalls opens a new channel of communication between plants and humans, in an effort to promote successful inter-species cohabitation and understanding…”

Asterisk
Asterisk is an open source telephony platform for free. You can use it as a phone, only a phone that can be connected to a database or a website or any other source of digital input and output. A phone that can be programmed to do certain things at a particular time or behave in a certain pattern.
In “Botanicalls” the plants were not able to dial a number. But a sensor triggered the start of an Asterisk phone call online.

ONLY USING SMS

Friends of mine distributed cards that had a tiny detail of a larger picture on it. They asked people to take a picture with their phone camera and send it via MMS to a mailaddress. From the webaccount the pictures got automatically sent to a website that assembeled all the details to one larger picture.

Textmarks

………………………………………………………………………………………………………………………
………………………………………………………………………………………………………………………
TRYING OUT MOBILE PROCESSING:
………………………………………………………………………………………………………………………
………………………………………………………………………………………………………………………

To get started, you have to do 3 things:


1. Install the latest version of Java on your computer.


2. Download and install a Wireless Toolkit (WTK) for building mobile phone applications. Note the location of the installation.

Windows: Sun Java Wireless Toolkit for CLDC
http://java.sun.com/products/j2mewtoolkit/

Mac OS X: Mpowerplayer SDK
http://www.mpowerplayer.com/products-sdk.php


3. Download and install the Mobile Processing IDE.

You can download it from this website:
http://mobile.processing.org/download/index.php

After that start Mobile Processing. Choose Preferences from the main drop-down menu. In the Preferences dialog box, go to the Mobile tab, and enter the location of the WTK.

………………………………………………………………………………………………………………………
FIRST STEPS
………………………………………………………………………………………………………………………

Mobile Processing is an open source IDE (integrated development environment) and set of libraries for programming in Java.

Instead of programming with straight Java we are developing Java Microedition (Java ME), the flavor of Java that was developed for mobile phones.

When you run mobile processing you will see this window

The empty white space is where we will write our code. Don’t be scared of the word “code”, Mobile Processing’s libraries make it easy for us to use.

The “play” button in the left upper corner of the window let’s you watch the application you wrote (your code) in action: the emulator will automatically open and show you a little screen with some fake mobile phone keys. Now you can check how what you did would look and work on your mobile phone screen.

The next button is a “stop” button, the one right to the stop button creates a new file. The arrow to the right let’s you open a new file, the next one saves your precious file.

The bottom that shows an arrow to the right let’s you EXPORT you file. This means that your code will get compressed and exported in order to store it on your mobile phone.

If you open the folder “Mobile Processing” on your computer and find the folder with the name of your file, you will now see that mobile processing created a folder inside called “midlet”.

It contains the beautiful .jar file, which we were all waiting for, cause this is the actual data we are sending to our mobile phones.

………………………………………………………………………………………………………………………
MY FIRST MOBILE PROCESSING APPLICATION
………………………………………………………………………………………………………………………

Thanks to my best mobile media teacher ever, Shawn Van Every, for all the information, resources and help he provided me with!!!!

I’m using his ITP class wiki for this introduction.

Just try to copy and paste this code into the window:

////////////////////////////////////////////////////////////////////////////////////////////////////////////

import processing.core.*;

public class HelloWorld extends PMIDlet
{

PFont font;
String hi;

void setup()

{
font = loadFont(“Impact-20.mvlw”); //Create this font first + exchange the double quotes
textFont(font);
hi = new String(“Hello World”); //exchange the double quotes here as well
}

void draw()
{
background(232, 185, 223);

text(hi,10,25);

}
}

////////////////////////////////////////////////////////////////////////////////////////////////////////////

Now safe the file as “HelloWorld”.

This application will simply write “Hello World” on your mobile phone screen. But first we have to define the font we are using. We are using “HelveticaNeue-24”. You can import this font by clicking on “Tools” in the menu bar. There you choose “Create Font..”. A window will open that looks something like the window you see here. Search for “HelveticaNeue” in the list of fonts. Write the size of the font “24” into the size field. Check the 3 boxes, to make sure you include all those letters and signs, then press “OK”.

GREAT!

If you press the PLAY button now, you should be able to see your first Mobile Processing Application
in the emulator.

If yes, CONGRATULATIONS!!

You can now click on “File” in the menu bar, choose “Examples” and check out how they work.

IF IT DOES NOT WORK
check if you have defined the path to your Emulator (MPowerPlayer for Mac or Wireless Toolkit for PC you downloaded before) in the preferences. If you are on a Mac you can do that by clicking on “Mobile Processing” in the menu bar, choosing “preferences”, clicking on “Mobile” (next to “General”) and browse your computer for the MPowerPlayer or Wireless Toolkit. If you have found it, press o.k.

Now your “Hello World” application should work.

SENDING YOUR FILE TO YOUR PHONE

The best way is probably to use bluetooth. But you can as well connect your phone via cable to your computer. If you have a rather new phone you might want to use mobile web to send it.

So whatever transfer method you choose, first of all press “Export MIDlet”.
Now you can find your .jar file in the Midlet folder of your project folder.

We called our first application “HelloWorld”, so you will find it in the “HelloWorld” folder within the “mobile processing” folder.

ON YOUR PHONE

In most cases the file will show up in your phone’s “applications” folder. If you click on the file it should open on your phone and say “Hello World”!!!!
SHAPES

////////////////////////////////////////////////////////////////////////////////////////////

background(90,80,1);
noStroke();
fill(226);
triangle(10, 10, 10, 200, 45, 200);
rect(45, 45, 35, 35);
quad(105, 10, 120, 10, 120, 200, 80, 200);
ellipse(140, 80, 40, 40);
triangle(160, 10, 195, 200, 160, 200);
////////////////////////////////////////////////////////////////////////////////////////////

CAPTURE VIDEO

Simple Video Capture and Playback:

import processing.core.*;
import com.mobvcasting.mvideocapture.*;
import com.mobvcasting.mvideoplayback.*;

public class MVideoCaptureTest extends PMIDlet
{
MVideoPlayback vidplay;
MVideoCapture vidcap;
byte[] videoData;

String captureKey = “Capture”;
String stopCaptureKey = “Stop Capture”;
String playKey = “Play Video”;

public void setup()
{
softkey(captureKey);

vidcap = new MVideoCapture((PMIDlet)this);
vidcap.showCamera();

noLoop();
}

public void draw()
{
}

public void softkeyPressed(String label)
{
if (label.equals(captureKey))
{
//vidcap.timedCapture(20);
vidcap.startCapture();
softkey(stopCaptureKey);
}
else if (label.equals(stopCaptureKey))
{
vidcap.stopCapture();
}
else if (label.equals(playKey))
{
vidplay = new MVideoPlayback(this,videoData,”video/3gpp”);
vidplay.showPlayer(0, 0, width, height);
vidplay.playVideo();
}
redraw();
}

public void libraryEvent(Object library, int event, Object data)
{
if (library.getClass().isInstance(vidcap) && event == MVideoCapture.CAPTURE_COMPLETE)
{
videoData = (byte[])data;
vidcap.hideCamera();
vidcap.closeCamera();

softkey(playKey);
redraw();
}
}
}

////////////////////////////////////////////////////////////////////////////////////////////


………………………………………………………………………………………………………………………
Recommended books:
………………………………………………………………………………………………………………………

Processing: A Programming Handbook
for Visual Designers and Artists
Casey Reas and Ben Fry (Foreword by John Maeda).
Published 24 August 2007, MIT Press. 736 pages. Hardcover.

Processing: Creative Coding and Computational Art (Foundation)
Processing: Creative Coding and Computational Art (Foundation)
Ira Greenberg (Foreword by Keith Peters).
Published 28 May 2007, Friends of Ed. 840 pages. Hardcover.

Learning Processing: A Beginner’s Guide to Programming Images, Animation, and Interaction
Daniel Shiffman.
Published August 2008, Morgan Kaufmann. 450 pages. Paperback.

Making Things Talk: Practical Methods for Connecting Physical Objects
Tom Igoe.
Published 28 September 2007, O’Reilly. 428 pages. Paperback.

………………………………………………………………………………………………………………………
………………………………………………………………………………………………………………………
………………………………………………………………………………………………………………………
OTHER (NON OPEN SOURCE) SOFTWARE TO BUILT MOBILE APPLICATIONS WITH
………………………………………………………………………………………………………………………

Flash Lite

Flash Lite is a powerful Adobe Software that is specially attractive since it works on almost every phone and it is of course compatibel with Flash, uses Actionscript and offers much more than Mobile Processing. But it is not free. And every user who wants to open your application has to install the “flash player” first.

“””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””
MY OWN MOBILE PROJECTS
“””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””””

I tried out a couple of things I describe above. If you want to know more about it feel free to visit my blog: www.grenzartikel.com

……………………………………………………………………………………………………….
ADDITIONAL LINKS
……………………………………………………………………………………………………….

1. Knock Collection

2. graffiti research lab

3. Japanese Whispers

4. Nokia exhibition

5. ITP projects 2008 summer semester

6. EYEBEAM

7. ITP = Interactive Telecommunication Program

8. EU media art residencies/scholarships/fellowships/ect..

RESOURCES

1. Learning Processing

2. Shawn Van Every’s mobile media course (Shawn = best TISCH school of the arts teacher 2008)