Category Archives: Interaction

Sublety and Nuance in Physical Interaction

I had a great conversation during tea time at Adaptive Path this evening with Jesse James Garrett, about the role of subtlety and nuance in physical interaction design. Central to the conversation was Microsoft’s Project Natal, an upcoming system for the Xbox 360 that lets you use your full body to control games.

While large motions, like punching and kicking the air, make for an impressive flourish, it’s interesting to consider what a system like this would look like in a few years, as it becomes increasingly fine-tuned. What if it knows where each one of my fingers is, like a musical instrument? What kind of interactive applications could this have in a non-game environment? Or, as Jesse mused, how can we learn from gaming to bring more game-related themes, from the concept of play to the interactive vocabularies we establish therein, into everyday computer-mediated interactions?

Part of Jesse’s work on the Ajax approach to web development was based on a desire to make web interactions feel more game-like in nature. Before we had instant asynchronous updates, whether backed by XML or not, the web had a distinctly evaluative feel to it. The cost of submitting web input was high, as it resulted in a long pause before I would know whether or not my submission had been accepted. Games typically offer instantaneous feedback and so this delayed, high-cost transaction felt more like taking an exam than playing a game. Thus, the web-two-point-oh-social-media-user-generated-content revolution is not about Ajax or Prototype or Scriptaculous or jQuery or MooTools, but about removing the barriers of time and cost previously associated with contributing to the web.

And so, with sophisticated physical input devices on the horizon, how can we use the most familiar input devices ever, our own bodies, to enhance our computer-mediated experiences? Further, given the fine-grained control we have over our physical selves, how can we draw on the rich human tradition of having a body and allow people to interact with a system in a more subtle and nuanced manner?

Just something I’m pondering.

Fainting Spells

Kate is back from her canoe trip, which proved to be a frigid paddle through the arctic wastes of northern Minnesota. Meanwhile, I’m enjoying the ethereal orange glow of a fogged-in city.

Today was my first day at Adaptive Path, and I’m likin’ what I see so far. There’s a lot of stuff goin’ on in that space, and while we spent most of the day getting settled in with online accounts and paperwork and other necessary features of orientation, I can’t wait to start digging into some work with these fine, talented folk. I’ve been getting caught up on all of the projects going on around me, and tomorrow my own project should finally condense out of the vaporous mists of ambiguity.

Whiteboards and markers, Post-It notes and sharpies, pencil sketches and Photoshop mockups and Keynote presentations, these are all the units of thought at work. Projects take over entire rooms, with ad hoc affinity diagrams and screen printouts for use scenarios covering the walls.

Any sane person would balk at such apparent chaos, but a true interaction designer would no doubt swoon upon entering the AP office. There is indeed a madness to the method, and I can’t wait to completely throw myself into the arms of the process.

Every man has his limits.

My grandiose plans for the day were aborted this morning when I locked myself out of the house. Our flat is on the third floor so squeezing through a window was out of the question, and after hopping our 15-foot gate and squeezing through its greedy wrought iron spikes I discovered that yes, the back door was locked as well. I took the BART into downtown so I could grab my roommate’s keys, and by the time I had sorted myself out of my little predicament it was too late to leave on my prescribed bike ride.

Oh well.

This evening I went to Adaptive Path to learn about Mobile Literacy, a research and design project where they traveled to rural India to understand how illiterate users interact with mobile technology. It’s a fascinating project, with strong currents of cultural sensitivity, social justice, and the role that empathy should play in design. Their blog continues to reveal further details regarding Mobile Literacy, so it’s worth a look if you’re into this sort of thing.

What’s super cool is that Adaptive Path has released all of their primary research under a Creative Commons license. Research findings, interview videos and transcripts, the whole shebang is open for you to study and pick apart, firsthand.

Their process culminated in two proposed devices. One is the MobilGlyph concept, which aims to make data tangible by sharing it through two-dimensional bar codes, similar to Cheng Fan’s wayshowing work last semester. The other is the Steampunk concept, which aims to make the functions of the phone as physical as possible, granting them affordances that invite dismantling and tinkering.

Finally, it’s been nearly five years but it still rings true today. Jeffrey Veen is still larger in life than he is in legend. We are lucky that he is such a kind and gentle soul, because he could very well crush every last one of us. Fortunately, instead of scheming how easily he could mash humanity into a fine paste, he directs his energies into building amazing things like Typekit, which stands to revolutionize how you use typefaces (or “fonts”, for those of you who aren’t an insufferable snob like myself) on the web.

Yes, Jeff is a benevolent giant, but I am a man of small stature and predictable bitterness. Thus I will use these newly found typographical powers only for evil, blanketing the landscape with cruel renderings of Papyrus, Hobo and Copperplate.

But not Comic Sans. No one would dare go that far.

Rounding the Corner

Today was one of the best days I’ve had in months, and I don’t think it can be entirely attributed to my massive caffeine intake.

I spent my entire morning grading assignments, drinking yerba maté, and watching small birds dine at our feeder. We are most frequented by house finches, and at one point we had six of them fluttering about on our deck. The chickadees are rather entertaining, how they grasp sunflower seeds between their feet and noisily peck them open. This morning we were even paid a visit by a male red bellied woodpecker, who was quite enormous considering our bird feeder is no larger than a cigar box.

My love for these birds isn’t universal, however. I hate the sparrows, or as I call them, hobo finches.

As most great stories often end, eventually I had to go to school. Today we were sharing and critiquing proofs for our final typography project, and my “Western U.S. ruggedness meets European luxury via turn-of-the-century railway hotels” concept for an Akzidenz-Grotesk specimen book went over well. I got a lot of really good feedback from my classmates, too, and I’m excited to continue refining my work.

After hearing everyone share horror stories about color printing and registration and all that “recto-verso” jazz, however, I must say I’m a tad apprehensive about this whole “physical materiality” thing. I definitely want to move beyond the intangible nature of digital work, but the hardships of producing a double-sided color print sound akin to sailing the Cape Horn, and leave me wondering how the heck I’m going to pull this thing off. I don’t know what kind (or even size, for that matter) of paper I’m going to use, and I certainly don’t know how I’m going to slap ink on it… let alone more than one color of ink. And sheesh, more than one side? Maybe Kinko’s will save my ass.

However, last night I did put together a couple of book binding prototypes, properly armed with a stapler, stylish paper, this week’s 20%-off coupon from Bed Bath & Beyond, and Super 77:

img_8438

And folks, Super 77 needs to be inducted into the Periodic Table of Awesomements, like, yesterday.

But seriously, I almost shed a tear today when our final typography class came to a close. I’ve learned so much in that class, from history to composition to gestalt to kerning to grids to the innumerable parallels between graphic and interaction design, that it’s hard to believe it’s only been four months since we started. Sheesh, I got to work with printing presses, real mechanical printing presses with heavy gears that will pinch your fingers, and rollers that will tear the hair right off your head. Risking life and limb? that’s what we call design, baby.

Type Cliché Letterpress Project

Type Cliché Letterpress Project

Type Cliché Letterpress Project

Type Cliché Letterpress Project

The day wrapped up with an evening meeting with my experience design team. We’re in the process of prototyping a museum installation where people learn about light by playing with mirrors and prisms.

img_8424

img_8425

img_8426

img_8435

There are some particularly subtle experiences we’re trying to recreate, not the least of which involve producing an immersive environment that suspends time and encourages focused, exploratory behavior. Our installation is designed to be fun, but we’ve described ours as a kind of “PBS fun” rather than “Nickelodeon fun.” Further, we’re introducing a social aspect that allows others to indirectly engage with (or contribute to) the experience, which will involve a separate prototype that we hope to build this weekend.

With flashlights. And Saran Wrap. And Sharpies, toilet paper tubes, duct tape, an iPod on repeat, and a dark, dark room. As our professor so lovingly told us the other day, “You guys are poor graduate students. You’ll build prototypes out of whatever garbage you can get your hands on.”

And so we did. And so we will.

Don’t make me experience prototype your face.

I have at least three projects due in the next week, each of which demands that I know a different piece of Adobe® software, including Illustrator, Premiere Pro, InDesign and After Effects. My love affair with Adobe® is well-documented, as is their software, which features tons of videos put together by kind people who explain things slowly, and in basic terms that I should be able to understand.

Nevertheless, after spending the entire evening trying to learn After Effects, I have thusly concluded that I cannot be taught. For me it will have to be scissors, construction paper and lots of hand-waving, from now until the foreseeable future.

Fame and Fortune

There’s just something kinda cool about being in the ACM Digital Library:

Our CHI paper has found its way into the ACM Digital Library.

If you’re a hopeless nerd, that is.

Summation

Our trip to Boston was great. Our favorite part was the cemeteries.

The CHI Student Design Competition went well. Our poster went through about fifteen revisions until we called it good, but all that hard work definitely paid off:

CHI Poster Revision Animation

Out of twelve finalists who presented posters, our team was one of four chosen to advance to the final round. Thus, we spent the next three days with our faces in our laptops, putting in 17-hour days working on our design presentation. We didn’t get to see a whole lot of CHI as a result, but we pulled down fourth place in the design competition, which is pretty cool considering there were, like, 70 original submissions.

As an aside, I’m not so sure that having the final round be a “competition” between four teams is really the most productive way to advance the state-of-the-art of academic interaction design instruction. Rather, a panel where each team openly shares its design process, discussing any hardships, techniques or insights discovered along the way, would encourage collaboration, and redirect competitive energies towards actually improving design education in the world. Interaction design is far too young a field, and there are still far too few of us in the community, for us to be actively snapping at one another.

So that’s that. Boston rocks. CHI existed. Jon Kolko is awesome.

Meanwhile, I really need a haircut. Fortunately I have been signed up for an extra-swanky one this summer, as I’m going to be working as an intern at Adaptive Path. Yes. Five years ago I slept in my car on my drive from Bend to San Francisco, to attend a series of workshops about redesigning Blogger and building Basecamp. Those workshops, hosted by none other than Adaptive Path, blew my mind wide open in regards to human-centered design, and set me on the path that ultimately led to the HCI/d program at Indiana University.

Yes. Adaptive Path. Needless to say, rollin’ with those homies is an honor beyond my wildest dreams, and I can barely sleep at night out of excitement for what awaits. It’s been a lot of hard work, a ton of thanklessly hard work, to get to this point, but it’s beginning to seem as though it was all worthwhile.

Meanwhile, how about a few samples of some stuff I’ve been cookin’ up, lately? I’m putting together an Akzidenz-Grotesk type specimen book for my typography class, and my theme is “European opulence meets American ruggedness, via turn-of-the-century railway hotels.”

specimen-book-1

specimen-book-2

specimen-book-3

It’s still a work in progress. Notably absent is any usage whatsoever of the typeface Akzidenz-Grotesk.

And finally, this is just plain awesome:

“It doesn’t fit in a Rolodex, because it doesn’t belong in a Rolodex.”

This Ain’t Yo’ Mama’s Press Release

But it is ours. Hooray for fame!

Now if only I could hire someone to help me cash all these giant cardboard checks…

UPDATE: The IU Home Pages newsletter for Indiana University has picked up our story!

Type

Three weeks ago, I packed up my Subaru and left Minneapolis in one heck of a hurry. It was Monday, we had just been socked by a winter storm over the weekend, and another one was forecasted to hit on Tuesday. Thus, making it back to Bloomington in a timely fashion required that I gracefully duck between competing storm systems. Just as when I drove to Minneapolis for winter break. Just as when we drove to Madison for Thanksgiving.

My plans in Bloomington were about as time-sensitive as they were ambitious. As soon as I arrived home I placed myself under house arrest and spent the next two days writing and typing. Indeed, twelve hours a day I did nothing but write, drink green tea, and draw down the already-vanquished stores of our refrigerator.

Today we learned that all our hard work finally paid off. Our extended abstract paper for the CHI 2009 Student Design Competition got accepted, and we will be presenting at the CHI conference in Boston this April. We spent the bulk of last semester working on this project, and after a series of fits and starts and upsets came upon the idea for WattBot, an energy usage feedback monitor for the home. Enormous thank yous and shout outs to everyone who helped make this possible.

Meanwhile, this semester is off to a strong start. In one class we’re working on designing a new wayfinding/wayshowing system for downtown Bloomington, and in another class we’re getting all philosophical about what “experience” actually means in the context of HCI. I’m also taking a typography class in the School of Fine Arts that continues to blow my mind every day. We sketch letter forms and talk about counters and tittles and finials, and bask in the glow of 46 new Gothams. Tomorrow we will start working in the type shop with real mechanical type, and I will probably pee my pants the first time I open a California Job Case.

On the weekend Kate and I have gotten out hiking at McCormick’s Creek State Park and Brown County State Park, and we are duly impressed with the quality of outdoors available in Indiana. There is some beautiful country tucked into this state, and kudos to Indiana for doing such a wonderful job maintaining their parks and trails. Indeed, we will vehemently defend this bluff country from any west coast douche bag who wants to talk smack.

UPDATE: Yup, it is just a coincidence. Our proposed WattBot system is by no means affiliated with Wattbot, a home energy advisor that is available for realz!

Your Darkest Hour, Part III: Shattered and Healed

In January 2004 I started my job as a phone support jockey for a small web software company. Five days a week, eight-or-more hours a day, I went to a regular job and got a regular paycheck. I didn’t want to give up all my privileges at the mountain, however, including good friends, a season pass and bragging rights, so I continued to work as a snowboard instructor on the weekend.

Every Saturday and Sunday I would wake up early, catch the employee bus, and spend my weekend teaching kids how to snowboard. This went on for two months, where I would literally work for thirty days in a row before I happened to get a day off. On a fateful day in March it turned out we had too many instructors scheduled for the afternoon, so I finally got to clock out and go riding.

I was ecstatic. When you’re an instructor you’re on the mountain every day, but you’re always limping around the bunny hill and softly cursing under your breath. The opportunities to ride for fun are few and far between, so my friend and I quickly snatched up this rare gift and went straight for the terrain park. I was blowin’ huge and hitting everything, kickers, rails and the like, and I was lining up to throw down some serious air on the spine.

A spine in a terrain park is a very steep jump, perhaps twelve feet in height, that is sharp at the top like a shark’s fin. The intent is that your forward speed gets converted into upward motion. You ride up the launch side, pop nearly straight up in the air, and ride down the landing side. It’s almost like a half pipe, only you don’t need to spin around for your landing.

I was going hard at the spine, giving myself plenty of speed so I could really get up there this time. I hit the launch, but instead of going up I got shot straight out over the flats. Here I am, fifteen feet in the air over completely flat snow, with no transition for my landing. Shit. I waved my arms to reorient my body, “rolling the windows down” as we call it, shifted my weight onto my back leg so I could land the tail of my snowboard first, and hopefully cushion my impact.

The tail hit hard. I felt a snap in my back leg, and my body hit the snow in a sickening heap. I knew immediately that I had broken something, so I crawled to the edge of the run to avoid getting hit by any other errant, irresponsible riders. My friend rode up, and I told her to go call ski patrol.

I sat and waited for fifteen minutes, feeling like an idiot. The patroller showed up, and he packaged me in a yellow tarp on an orange sled, and dragged my sorry ass off the mountain. At the mountain clinic they x-rayed my leg, and sure enough I had broken my fibula, right at the top of my snowboard boot. The boot acted as a fulcrum, and my leg became a doomed see-saw.

fibula-01

It wasn’t a bad break, but it was enough to put me on crutches for eight weeks. I was done for the season, done at the mountain, and done with anything outdoor-related. The management at the mountain was understanding, and no doubt stoked that I broke myself off the clock so they weren’t financially responsible. They offered to reassign me as a yurt attendant, serving dinosaur-shaped chicken nuggets to four-year-olds. I turned them down, as I already had a job and didn’t need the extra work. I wanted my knuckle-dragging friends. I wanted the free season pass. I wanted the social scene. Without snowboarding, though, all I wanted was to be left alone.

In a matter of moments I had gone from being incredibly busy and active in the outdoors, to being a bored shut-in. My roommate affectionately called me “Gimp”. At least I think it was affectionate. Just a few weeks prior I had bought a new car with a manual transmission. With my cast I sure as hell couldn’t operate a clutch, so every day I limped to work on my crutches. My co-workers bought me a bag of frozen corn. Forcing myself to remain inactive was one of the most difficult things I have ever done, and I knew I needed to find a new activity to stay occupied and keep my mind busy.

dsc02459

I decided to learn web design. All of it. I redesigned my personal website, and then I redesigned it again. And again. This was back during the CSS renaissance, when Doug Bowman, Eric Meyer, Jeffrey Zeldman, Dan Cederholm and Dave Shea were all actively inventing the techniques that we still use today. It was a very exciting, but also very frustrating, time to be a web designer. We still had to support Internet Explorer 5, and there were a few times, especially in regards to whitespace parsing errors, where I nearly jumped out a window as a result of that damn browser. Nevertheless, before long I was rarely answering telephone calls at my job, and instead carving up Photoshop comps into beautiful tableless XHTML/CSS.

I was so irrationally stubborn about working at the mountain that it took something as extreme as bodily injury to make me withdraw from that gambit, and to understand that working myself to the literal breaking point wasn’t a healthy way to live. I realized that if I depended not on my brain, but on this frail little body for my livelihood, that it could all be stolen from me in an instant. I knew I needed to do some intellectual investment in myself, and I used this new free time to refocus my priorities and crawl out of the trenches of phone support.

Indeed. The leg would heal, and it would be a beautiful summer.

dsc02809_2

End Part III. Review Part I or Part II.