Weblog

Here's a video and description of the prototype I whipped up yesterday.

Collaborative creativity using Twitter and Microsoft's Multi-Touch Surface.

This is a one-day prototype exploring the possibilities of connecting the ubiquity of Twitter with the single-location Microsoft Surface.

It's basically collaborative magnetic poetry. Any user can add words to be used by replying to @touchPoetry on Twitter. Users on the Surface drag words around to form poems and encircle them to create an outgoing "tweet" on the touchPoetry twitter account.

UCLA's mobile media series continues tomorrow and through the weekend with some very cool speakers, symposia and workshops. On Thursday 11/12 Area/Code's Kevin Slavin will be speaking at 6:00PM, followed by a day-long symposium on Friday 11/13 organized by Casey Reas featuring luminaries including Slavin, Julian Bleecker, Mark Hansen, Ian Bogost, Robin Hunicke, John Underkoffler, Erkki Huhtamo, Machiko Kusahara and many more! Saturday 11/14 is devoted to a series of low-cost workshops on using Python, Arduino, and the iPhone SDK.

UCLA Design|Media Arts' Mobile Media Lecture Series continues tomorrow at 6:00PM with expanded storyteller and ARG designer Jordan Weisman. From the UCLA website: "Jordan has been the creative force behind a number of entertainment companies, including his newest venture, Smith & Tinker (connected toys), FASA Corporation (roleplaying games), Virtual World Entertainment (networked virtual reality entertainment) acquired by the Disney Family, FASA Interactive (PC games, including the MechWarrior franchise) acquired by Microsoft, WizKids (collectible games) acquired by Topps Inc., and 42 Entertainment (alternate reality gaming). During his career, Jordan has created some of the largest and longest-lasting franchises in the gaming industry, including BattleTech/MechWarrior, Shadowrun and Crimson Skies."

These guys use an an HTC Magic running the built in Google Street View and a box to make themselves a primitive pair of VR goggles....minus the whole 3D part.

Wellness Partners is a collaborative research project about exercise habits and perceived wellness designed by the USC School of Cinematic Arts, Keck School of Medicine, and School of Social Work. The study is coordinated through a partnership with USC's Center for Work & Family Life.

You are invited to help us test a newly developed intervention by participating in very brief activities via the Internet and/or mobile phone over the period of 10 weeks. We will also be taking in-person physical measurements (height and weight) and asking you to answer questions online.

As a token of our appreciation, you may receive up to $45 for participating in the study.

Your participation is voluntary and any information collected during the study will be kept confidential.

Support for this study is provided by a grant from the
Robert Wood Johnson Foundation.

If you have additional questions please read the
Frequently Asked Questions

If you are interested, please email:
WPSTUDY-L@USC.EDU
Phone: 310-933-6648

Lifelogging has been a constant interest for many of us in IMD and there are a few posts around the blog such as here and here. More recently, Professor Mark Bolas did some research with Microsoft on their prototype Sensecam. Here's an update on a new commercial version by UK company Vicon (via New Scientist):

New camera promises to capture your whole life

13:10 16 October 2009 by Kurt Kleiner

A camera you can wear as a pendant to record every moment of your life will soon be launched by a UK-based firm.
Originally invented to help jog the memories of people with Alzheimer's disease, it might one day be used by consumers to create "lifelogs" that archive their entire lives.
Worn on a cord around the neck, the camera takes pictures automatically as often as once every 30 seconds. It also uses an accelerometer and light sensors to snap an image when a person enters a new environment, and an infrared sensor to take one when it detects the body heat of a person in front of the wearer. It can fit 30,000 images onto its 1-gigabyte memory.
The ViconRevue was originally developed as the SenseCam by Microsoft Research Cambridge, UK, for researchers studying Alzheimer's and other dementias. Studies showed that reviewing the events of the day using SenseCam photos could help some people improve long-term recall.

(following Peter Brinson's example, I am shamelessly promoting my class)

Preliminary Syllabus Outline*


draft syllabus

CTIN492L - Experimental Game Topics (TTh 5-6.50pm - with serious coffee break...)
Instructor: Marientina Gotsis

Overview. This course will prepare students for designing interactive media-based health “interventions”, such as sensor-based games on mobile platforms. We will review priority health areas in the US health system, as well as emerging markets and technologies, key topics in public health, behavior, neuroscience and social networks. Students will be mentored through project case studies in focused areas (e.g., obesity, autism, cancer, rehabilitation). Students will be given the opportunity to generate ideas, design and playtest paper and digital prototypes in their area of interest, as well as randomly picked topics during lab exercises. Assignments will be individual and group-based.

Goal. The goal of the course is to increase student awareness of healthcare challenges from individuals to groups and communities, cultivate design empathy from multiple perspectives (consumer, patient, health professional, designer, engineer) and foster a spirit of understanding toward collaborative design. Whereas pure entertainment may focus more on the player experience rather than the message, health interactives require equal consideration to both user/player and message. Students will be challenged to think beyond pure entertainment and understand holistic issues of design that take into account the user/players’ overall mental and physical health, environmental factors, social networks, and scalability issues, as well as the economics that govern healthcare issues. Students will be required to communicate issues based on their diverse perspectives in order to help identify stakeholder interests in health interactives.

Structure. The class will spend the initial part of the semester understanding key concepts, reviewing current literature and evaluating prior art in this area. The class will also cover basic skills in prototyping, playtesting, study design and evaluation. The class will create a series of small prototype exercises from which to draw ideas and experience for individual and group projects. During the final half of the semester, the class will work together in groups to design, playtest, and produce, one or more class projects depending on class size and expertise.

NO PREREQUISITES REQUIRED.
BOTH GRADUATE AND UNDERGRADUATES ELIGIBLE FOR CREDIT.

* The course will be quite different from last year - focused more on hands on design and critique/discussion with an eclectic readings list reviewing special topics in design, health, behavior, technology, and interactive media including games (no book). Many thanks to the students who helped us pilot this class last semester. Suggestions very welcome so long as you're honest but nice :)

Holographic Interface - round interface - Ringo from Ivan Tihienko on Vimeo.

"this short feature demonstrates the simple of the possibilities of having the holographic shadow (?) instead of a pda or a cell phone, or a computer for that matter."

Hey y'all.
It's been awhile and I've missed you.

This spring, I stumbled into the Van Alen Institute, a funded organization in NYC that explores projects on the borders of art and architecture. By the end of the summer, I had ended up as the primary interactive designer of two of the Van Alen's three summer fellowship projects. It was truly great working with architects - highly skilled, educated and creative people - and being able to provide a perspective and skill set that their projects would otherwise not have.

The Projects

The Aurora Project

An amazingly ambitious work of interactive archisculpture wherein every piece was designed in some form of CAD and cut on a laser cutter. Each item is custom, hand made, and based on buoy data from the Arctic. There are 24 IR distance sensors placed around the perimeter of the field, which are tied to LEDs embedded in the base of the sculpture, and cold cathode tubes extruding from its top. As participants approach the sculpture, the LEDs dim and the CCTs brighten, to simulate the experience of the Arctic melting as more humans pay attention to it, releasing greenhouse gases into the atmosphere. I designed and soldered the circuits that power the electronics, and designed the Arduino software that provides the interaction.

Museum of the Phantom City

A walking tour through unbuilt architectural proposals for the "other futures" that could have happened in NYC, had visionary architects gotten their way. There are many documented proposals from big-name architects that were a bit too forward thinking for their time, from a 19th century pneumatic subway to a Bucky dome over all of lower Manhattan. This project, a combination of iPhone app, scavenger hunt and website, is a location-based walking tour through all of these. I did all of the iPhone programming, and much of the user experience design. This project marks my first published iPhone app.

ok!
I hope this is informative to those wondering what IMD students do when they graduate.
<3 U, IMD.
/noha

"Players who install the Viz application on their phone can expect an ambient 'always on' play experience that exists within the flow of their everyday lives. Players engage with Viz when they have spare moments in public spaces..."

Here's the link to my casual mobile augmented reality game treatment:

http://remotedevice.net/projects/viz/

Check this mobile app out, especially if you are in the San Francisco area!
You can currently get on the list for a private beta invite.

Cabulous and Find my Friend Presentation from John Wolpert on Vimeo.

We're looking for pairs ages 25-44 to start! Please forward widely!

Download Advertisement



WP-M wishes you a Happy 4th of July!

Columns work.

Thin, quick,
easy to read,
back and forth,
left and right,
columns.

e-paper,
designed in a nice,
1/4 size newsprint form -
buttons on the back,
maybe sides,
heck maybe a dismissive
accelerometer-sensed shake.
Skimmed with a glance,
while standing
shoulder to shoulder
in a crowded subway.

Not a big kindle, but
a blast from the past .

Referencing: The Sixth Sense

The first thing to notice about the Sixth Sense is that it allows the wearer to use any surface around them to view information and edit media. In the replacing space article, Harrison says “the structure of the space around us moulds and guides our actions and interactions.” This is very true in regards to the Sixth Sense. While using the device, any surface can become part of the device: a wall, a newspaper or, if nothing else is available, even your own hand. Whatever you end up using for the display depends completely on where you are at any given time.

The Sixth Sense is also a great example of ubiquitous computing. With its ability to turn any real-world surface into an interactive space, the person wearing the device can view and edit photos or browse the web on whatever is in front of them.

The Sixth Sense requires a lot of “performance” by the wearer in order to use many of the functions. The most obvious is when the user is taking a picture. In order to take the photo, the user holds up their hands as if to create a “frame” around what they want to save an image of. It is very quick and easy, but passers-by who see this, don’t see someone with a camera, but rather someone who looks like they are pretending to take a picture. With these photos, the user can go up to any wall and use hand gestures to browse through their albums or edit them. The personal keywords that are displayed on the front of someone when you go up and talk to them, is also an example of performance. Thanks to the Sixth sense, these people are now wearing a dynamic costume that can change depending on who they are talking to or even information they have posted on their blog.

The ease of the picture function seems to be exactly what Matt Jones had in mind when he came up with the idea of "bionic noticing”. All someone needs to do is use their fingers to frame a picture and the Sixth Sense takes it. There is no other hardware required. This makes for an easy time of “obsessively recording curious things” around the user. Adding an upload function to the Sixth Sense seems very easy and logical. Every time someone uses their fingers to take a picture, it could be uploaded to a photo site such has Flickr as well as saved on the device to be viewed or edited later.

The Sixth Sense, in a way, makes everything connected to the internet. Any book you pick up, person you look at or item you buy at the store activates the device, which then uses the internet to find more information on them. I really love how looking at a person brings up keywords about them. It seems like a great idea for networking and a fun way to find out interesting and unusual things about people. While the future probably holds a world with every object having access to the internet, this is a nice stepping stone that is probably more cost effective.

PoolLoop
A Mobile Mixing Experience

PoolLoop is an iPhone app that uses material generated or captured by the user/users to create a unique experience of time, space, sound and visuals.

Context

This application is intended for on-the-go creativity and collaboration. Designed to be accessible to all users, it can be operated easily and quickly to channel creativity.

Design

PoolLoop enables an interactive/creative experience between one or more users. It can reshape a moment in time, alter the way of thinking about an audio/visual relationship, and create a virtual place as the user(s) select and manipulate material specific to their own cultural and social contexts.

The virtual musician(s) are given multiple sources of material to choose from. There is the option of uploading your own generated content from your computer. This can include any sound/visual relationship, as well as the freedom to encode an alpha channel. Also, users can sample their own sounds and images from their phone’s camera, or download them from online (ex. youtube), to manipulate into their creative compositions.

In game play between users, the images and sounds are mixed and fused together, generating a true harmony of the elements. When these elements are combined, the result is an artistic mold in time and space that would have otherwise never existed. This allows the users to truly collaborate and combine their ideas, creating a social labyrinth of audio and visual. The results serve to be a representation of merging virtual identities.

Play Experience

Each player has the ability to load two sets of content each (a video/graphic with audio attached). If one is composing alone, they can activate the content with the select screen and manipulate it using the tilt (up and down) of the phone and its rotation (door knob motion) while selecting the clip they want to manipulate.

Sources of content include recording it with your iPhone or downloading from an online site you are browsing. You can use the select screen to activate your clips and tilt and rotate the phone to manipulate the elements. Tilting up and down increases and decreases the speed of the clip while rotating displaces the pixels of video. For example, if you are using more than one video clip, they will be layered, with the most recently loaded image on top. When you rotate the phone, it will use the bottom layer of video to displace the top layer, creating a new video, which is a merging combination of the two visually.

Interactive Play: Two users can interactively create a composition by loading their own elements and using the app’s features to merge and distort their sound and video. In order for the two users to play, one must invite the other to a creative session, and then the two players must upload their content into each others libraries. Once each player has the resources from the other, play can be initiated.

At the end of each session the user has the option to save their composition and can also email it to themselves or post it on the internet. The result is an easy and fun creative venture into the virtual manipulation of a moment and experience.


Collaborators: Steve Day and Diana Reichenbach

PoolLoop PowerPoint

Check out the link to a realization of a dream! And it doesn't require the use of costly and dangerous nuclear weapons!!

http://www.intomobile.com/2007/09/28/palm-phone-jammer-fits-in-your-hand-annoys-everyone-around-you.html

Sorry this took so long... finally was able to access the lab and use the computer. Enjoy!

Bouncing Cranium

University of Southern California and Nokia Announce Extensive Research Collaboration Framework Agreement

First Project to Focus on Advancement of Augmented Reality

LOS ANGELES and Espoo, Finland (April 21, 2009) – The University of Southern California (USC) and Nokia Research Center (NRC) Hollywood today announced a research collaboration framework agreement that centers on advanced mobile user experiences. The umbrella framework agreement allows Nokia and USC to work together on multiple projects in a variety of areas and will streamline the process for commercializing USC inventions.

Speakers: IMD's Mobile and Environmental Media Lab (Fisher, Stein, Watson, Gotsis, Kratky, Preuss, Carter, Yasuda)
Time: Wednesday, April 15, 6-8pm
Location: USC's Robert Zemeckis Center for Digital Arts (RZC),
Room 201 Zemeckis Media Lab (ZML)

Title: “Mobile Storytelling”
Abstract: The overall objective of our Mobile and Environmental Media research program is to design and prototype new capabilities for unique entertainment and out-of-classroom educational opportunities available to anyone, at anytime with the added benefit of being embedded in the rich context of specific “place”. The recent focus has been on content development for location-specific museum, game, and arts installations in which the ‘virtual’ contents are embedded on site and perceived through mobile display or viewing devices. This presentation will describe several of the group's projects ranging from crowd-sourced cinema and mobile advertising to " Ambient Storytelling".

Here is my idea for sketch #5:

Laundry Mat Attack

Laundry Mat Attack is an enacted narrative, where the theme and story of the game unfolds as the character moves through the space. It is designed for players who want to pass the time in the laundry mat specifically. As players are waiting for their loads to wash and dry in real life, they are virtually venting their frustrations through the game world while trying to develop the best strategy for quick and accurate laundry mat protocol.

During the unfolding of the game the player will encounter and overcome many obstacles which happen in real world laundry mats. These include:
-Navigating through overcrowded spaces
-A plan of attack for beating other visitors to open washers and dryers
-Obtaining money (credits) and changing them out for quarters
-Buying laundry detergent and bleach
-Dividing items into lights and darks
-Developing relationships with other users and the owners to help you speed up your laundry process.

Each of these obstacles will be addressed and overcome in a separate game which can be played through a battle of the wills or a physical confrontation. Once you are near another player or a machine you will be given the option of how to address the obstacle at hand, and follow through with a game.

For example, if you and another player reach an open machine at the same time you will be presented with options which you can choose from. 1. Physical confrontation 2. Activate a battle of the wills 3. Challenge them to play a game with you 4. Give up the machine

Another example is earning credits necessary to do laundry. You can do this while laundry is washing or drying, or you must do this before doing laundry at all if you have no credits to begin with. You can choose from a few options of occupations including but not limited to: soliciting for money, folding someone else’s laundry for a few extra tokens, selling newspapers for the stand across the street etc. These tasks bring on a new realm of personal interaction and obstacles that you must overcome when you are presented with them. Your game can be saved, if your real world laundry finishes before virtual world laundry does.

You can play the game with others at a laundry mat who have this application on their phone (and log into the network), or you can play against virtual players (the computer). You can also send instant messages to other players on the network about your observations or frustrations in your current laundry mat condition.

You can win by collecting points from your various tasks. You can continue to try to beat your last score, or the scores of others. You gain points by quickness and accuracy in laundry completion, by winning fights or battles of the wills, by cultivating positive relationships with the owners and other users, etc. For instance, you can sometimes gain more points by giving up a machine than fighting for it, depending on the character that you are up against (ex. Elderly person). However, ultimately the challenge and fun in the game is about the experiences you encounter in the process of doing laundry and how you overcome them.


Here is a quick chart of a tentative laundry mat:



and the .doc file of the game plan:
LaundryMatAttack.doc