LECTURE AT HYPER ISLAND. interactive media art

lecture content

.My own projects
What I’m working on right now, what I did the last 5 years and why

.Generating art projects
Collaborating across disciplines: challenges and experiences in the creative process
Zach Lieberman (http://www.thesystemis.com/)

.Critical Art Theory
Discuss in little groups quotes by Marshall McLuhan, Slavoj Zizek, Alexander Galloway,
Guy Debord and Donna Haraway, Baudrillard

Critical Art Ensemble

Schleiner
http://www.opensorcery.net/countdown.html

Michel de Certeau

PARASITIC MEDIA
http://subsol.c3.hu/subsol_2/contributors3/martintext.html

.Wearables
Networked Clothing, interactive fashion and circuit jewelry
Projects by Kyveli Vezani, Carolina Pino, Heather Dewey-Hagborg

.Mobile Phones
Art projects using SMS, MMS, mobile cameras, mobile video or phone in-built sensors
Projects in the afternoon lecture

.Big Games
Interactive art projects in public space, urban interventions, temporary autonomous
zones, Video Game Criticism

.Physical Computing
Microcontrollers and Sensors in contemporary art installations
Projects: Mouna Andraos

Personal Power Plant

.Interactivity for change
Humanitarian, assistive and activist application of new Media

.Participatory Media Art projects
Artists working with/in communities, on specific sites, user-generated content

.Computing and architectural form
Art projects that use ubiquitous media in urban infrastructure to alter their function

.Interactive storytelling
Digital Comics and Sequential Narratives, collective/participatory storytelling

.New Interfaces for musical expression
Inventing new instruments for experimental music, circuit bending, performance
Project: Golan Levin “Scrapple”

PRACTICAL WORK DURING AND AFTER THE LECTURE

a. Read the snippets of critical theory and improvise a conversation being one of the theorists

b. Build a prototype of an idea within one hour: limited time, limited material

c. Expand on an idea: play with random thoughts, control your need for control, see what happens

d. Respond to one of the Terms in the “Concise Lexicon of / for the Digital

Commons” with an object, sound, story or performance

 

PROPOSAL FOR THE FINAL PROJECT

For my final in Mobile Media I want to work in a team with Klara Palotai. But who ever wants to join us is very welcome!

Since we have to offer three different ideas, here they are:

3 FINAL IDEAS

1) Connect four phones via bluetooth and control synchronized video playback.
There are some sources online on how to manage the interaction, e.g.
a NOKIA report on games via bluetooth

We try to implement this hack
as described in the video on youTube.
I will try to build the application as a flash lite swf

HERE IS THE SKETCH

2) Working on Klara’s midterm

3) Working on my midterm (Braddock Art Project)

 

A GUI playing my video

I tried to make an application that leads the user to the video and in the ideal case to specific frames in the video.
download it here

I’m also working on connecting my database with the entry widget for mobile phone providers in order to send users to the right jar file, with their video format.

home

register

login

 

notes in class

jar file is a ziped file of all classes, compiled, the whole code. if you douple click you see what’s inside

in manifesto:

MIDlet-Jar-URL: htto://www.where.com/path/to/MPGUIExample.jar

give link to the jad and give path to jar

can be downloaded from sms or website
objects
slows application down
if we do string blabla
and don’t declare new object but do “blas” equals string it would work faster

other difficulties:
sketch has to have the same name like class

if copy pasting code: go into textwrangler: show invisibles, you have to delete some blank spaces

EXAMPLE:
starting screen
screen with RSS sources
buttons for reading
another page has name of source and articles
articles

Pcontainer for each screen:

elements on screen are in each Pcontainer
PimageLabel
Plabels don’t need a font
Plist (inside PLabel, pbutton)
Textfield

button to go back to last or first screen

make mapping on paper for each GUI application you do first
ONE more Pcontainer (e.g. current screen) this one is different:

current screen equals SPLASH SCREEN /equals what ever screen I want to display
it draws current screen, so you don’t have to do anything in draw, current screen keeps track of where we are in the application

method: calculate bounds (total dimensions of screen) know how big it has to be to be readable.
setBounds(sets relative heights,, widths, etc..)

add components to the appropriate screen (right button to right container)

make a link on button:

2 methods keyPressed and key Released
current container does that
hand it the keyPressed and key Released events
generates a library event when buttom press is detected

current container = e.g. screen one

look through the source

AUDIO encoding
default sample rate is 8000 per sec
each sample 8 bits
pcm: gives raw data, without compression, header, you can analyze, change and influence data
dag digital converter reading from the microphone

1) create class for each object
2) softkey method for softkey (takes a string “capture”)
3) initialize “vidcap” (you could also use one that only captures audio, not video) show camera
4) drawing will slow down so “Loop”
5) if library.getClass() . isInstance (vidcap) && event ==…. ………….so you know the class is done capturing video
6) redraw

 

assignment

o.k, so for this assignment I tried to experiment with two ways to get video to your phone, from a specific place. I need to do that for my thesis and don’t know exactly which path is best.
so I tried on the on hand to install a applet on my cellphone that grabs videos from youtube (i’m sure it would work with blip and a specific show as well). and on the other hand I tried to install shawn’s applet on my cellphone that basically let’s the user capture a video with their cellphone camera, watch this video and then send it to a specific number or email address, from which it can go to a database or whereever you need it to be. the later worked out, the youtube, didn’t work out yet. i could search for a certain phrase and log into the internet, but then it didn’t show me search results.

sending mms

searching for video in you tube

 

test title

test description

http://test.upload/something.3gp

 

MIDTERM

This project is a cooperation with the Braddock Active Arts Collective.
They want to change the awareness about urban space in Braddock, a district of Pittsburg. A number of signs will be distributed all over the area. Each sign has this number on it:

212.796.0729 and the extension 147

listen to the welcome message

each sign has another extension on it

dial:

111
222
333
444

A voice will tell them stories that happened on this particular site, historical events, murals and people are able to record their own stories associated with the place. They have to dial 1234 and press #.

HERE IS THE DIAL PLAN:

[sw1146_default]
exten => s,1,Answer();
exten => s,n,Background(/home/sw1146/asterisk_sounds/midterm/newfile); Enter in unique ID
exten => s,n,WaitExten(15)
exten => s,n,Hangup

exten => _XXX,1,SayDigits(${EXTEN})
exten => _XXX,n,Set(ID=${EXTEN})
exten => _XXX,n,NoOp(${ID})
exten => _XXX,n,Background(/home/sw1146/asterisk_sounds/midterm/${ID});Item description
exten => _XXX,n,Background(/home/sw1146/asterisk_sounds/midterm/menu);Press 1 to repeat
exten => _XXX,n,WaitExten(5)
exten => _XXX,n,Hangup

exten => 1,1,Goto(_XXX,1) ; not sure if this works.

exten => 1234,1,Background(/home/sw1146/asterisk_sounds/midterm/newfile2);To re-record, press 4
exten => 1234,n,WaitExten(5)

exten => 4,1,Background(/home/sw1146/asterisk_sounds/midterm/newfile2);record after the tone, press # when done
exten => 4,n,Record(/home/sw1146/asterisk_sounds/midterm/${ID}:gsm);
exten => 4,n(playback),Background(/home/sw1146/asterisk_sounds/midterm/newfile) ;5 to save, 6 to listen, 7 to re-record
exten => 4,n,WaitExten(10)

exten => 5,1,TrySystem(chmod 775 /home/sw1146/asterisk_sounds/midterm//${ID}.gsm)
exten => 5,n,Background(/home/sw1146/asterisk_sounds/midterm/newfile));thanks!
exten => 5,n,Hangup()

exten => 6,1,Playback(/home/sw1146/asterisk_sounds/midterm/${EXTEN})
exten => 6,n,Goto(s,playback)

exten => 7,1,Goto(4,1)

exten => t,1,Hangup()

exten => i,1,Goto(s,1)

 

emailing back to the user with attachment

sending back MMS after message has been posted on your blog via MMS

Send mail with attachments using PHP

Take ParseMailScript.php and put the code into the place where you send mail

where other functions are

and where “DOING SOMETHING” instead of posting to a blog:
send a message back to the user

exchange part where file goes, that will be sent
$attachment
change attachments array to ‘local_filename’ (instead of filename)

DEBUGGING
PHP

run in Terminal

~ f

put show errors script part into the script

var_dum ($FILES); ==to see information

 

blip TV

I’m trying out the code to upload videos to blip TV.
I made a new textmark “UPLOAD” that leads to
http://itp.nyu.edu/~sw1146/MOBILEMEDIA/daumeline/BLIP/upload_blip.php

at the moment there is nothing there, but I hope it works soon

http://blip.tv/file/683150/

http://itp.nyu.edu/~sw1146/MOBILEMEDIA/daumeline/upload_blog.php

http://itp.nyu.edu/~sw1146/MOBILEMEDIA/daumeline/BLIP/upload_blip2.php

 

code for uploading stuff to database

<? echo “\n”; ?>

body {

font: 10px arial;
color: #6EB222;
background-color: #fff;
padding: 10px;
margin: 200px;

}

THE BRADDOCK SIGN PROJECT

please submit your sound

“3gp”,
“audio/aif”=>”aif”,
“audio/x-wav”=>”wav”,
“video/mp4″=>”mp4″,
“video/3gpp2″=>”3g2″,
“video/mpeg”=>”mpg”,
“video/quicktime”=>”mov”,
“video/x-quicktime”=>”mov”,
“video/x-msvideo”=>”avi”,
“image/jpg”=>”jpg”,
“image/jpeg”=>”jpg”,
“image/png”=>”png”,
“audio/vnd.wave”=>”wav”
);

// Make sure form was submitted
if (isset($_POST['form_submitted']) && $_POST['form_submitted'] == “true”)
{
// Check the mime type
$allowed_types = array_keys($allowed_mime_types);
$allowed = false;
if (isset($_FILES['bytes']['type']))
{
for ($i = 0; $i < sizeof($allowed_types) && !$allowed; $i++)
{
if (strstr($_FILES['bytes']['type'], $allowed_types[$i]))
{
$allowed = true;
}
}

// If the mime type is good, save it..
if ($allowed)
{
$uploadfilename = time() . “_” . rand(1000,9999) . “_” . basename($_FILES['bytes']['name']);
// Make sure apache can write to this folder
$uploaddir = ‘/home/sw1146/public_html/MOBILEMEDIA/php_popper/posts/’;
$uploadfile = $uploaddir . $uploadfilename;
$uploadrelativefile = ‘http://itp.nyu.edu/~sw1146/MOBILEMEDIA/php_popper/posts/’ . $uploadfilename;

if (move_uploaded_file($_FILES['bytes']['tmp_name'], $uploadfile))
{
// Make sure the file isn’t executable and you can delete it if you need
chmod($uploadfile, 0666);

// Put it in the database
/* Database Table:
mobile_me_messages
message_id int(11) auto_increment
attachment varchar(255)
subject varchar(255)
body varchar(255)
from_name varchar(255)
from_domain varchar(255)
*/

$subject = “”;
$message_text = “”;

if (isset($_POST['subject']))
{
$subject = $_POST['subject'];
}

if (isset($_POST['message_text']))
{
$message_text = $_POST['message_text'];
}

// Connect to the database
$mySql = sqlConnect();

// Insert Data
$query = “insert into mobile_me(attachment, subject, body, from_name, from_domain) values (‘” . $uploadfile . “‘, ‘” . $subject . “‘, ‘” . $message_text . “‘, ‘mobile web user’, ‘mobile web user’)”;
$result = mysql_query($query, $mySql);

// Disconnect from the database
mysql_close($mySql);

// Tell the user
echo ”

Success
” . $uploadrelativefile . “

“;
}
else
{
echo ”

Error on upload…!

“;
}
}
}
}
else
{
?>

Title:
Description:

---

Phone (iPhone) doesn’t support file uploads? Email it instead..