“Through My Eyes” – Oculus Rift + interactive fiction (+ Harry Potter)

Created for:

Project length:

  • Medium-long (approx. last quarter of the term, final group project design document).

Team:

  • Diondra Arroyo
  • Enid Brown
  • Kelsey Buttendorf
  • Jullie Harten
  • Matt McGowan
    • my principle contributions: “Persona,” “Context Scenario” and “Narrative Flowchart”

Challenge:

  • As a group, produce a full, thorough design document on a project of mutual interest.

For our final project, my group came up with an Oculus Rift-driven, interactive fiction learning game experience titled “Through My Eyes.” Here’s the concept brief:

Through My Eyes - concept brief
(Layout by Jullie Harten)

The full design document is here:

“Through My Eyes” – full design document

and these are my principle contributions:

Persona:

TME - persona
(Layout by Jullie Harten)

Context scenario:

TME – context scenario (pdf)

Narrative flowchart:

(Page layout by Jullie Harten)
(Page layout by Jullie Harten)

“StoryPix” – a digital storytelling card game

StoryPix app - Interpret path - order images

Created for:

  • Digital Media Design for Learning (DMDL) degree; Cognitive Science and Educational Technology II course (Fall 2013).

Project length:

  • Medium-long (approx. last quarter of the term, final group project design document).

Team:

  • Robyn Berland
  • Heather Kim
  • Matt McGowan
    • my principle contributions: “Summary of Project,” “Points of Viewing Theory,” and “Wireframes.”
  • Cooper Wright

Challenge:

  • As a group, produce a full, thorough design document on a project of mutual interest.

The full design document for this project can be found here:

“StoryPix” design document (pdf)

But here’s an excerpt from the “Summary of Project”:

StoryPix is a platform-agnostic, digital card game designed for middle-school-age children and older. It is an image-based storytelling environment that both visualizes and verbalizes the multitude of ways that people interpret the world. Like other social media platforms, StoryPix users will share images with the intention of telling their “story.” Unlike other social media platforms, StoryPix users will be encouraged to present their images in a more deliberately sequential manner, to present them more like a story, and to create an interpretation of the visual stories of others.

The learning objective of the game is to encourage players to think about their own and others’ thinking. Players will create a story constructed from a series of “cards” or “frames,” static images being either self-created or found (photos or drawings). These images are then sequenced to tell a story (as do, for example, comic strips and photo essays). Players then add a title (of no more than three words) and a descriptive, narrative text (of no more than 200 characters) to accompany their picture sequence. Once a story is completed, the player “publishes” the story and shares it with another player. The recipient of the story, however, only sees the story’s title (not the original narrative text) and a “stack” of images/cards/frames that have been “shuffled” and placed in a random order. The recipient player must then guess the originating player’s story in the original order of the cards and send their guess back to the originating player, along with their own (under 200-character) narrative text. Recipient players are allowed three tries to “get it right.” Players also have the option of sharing one story with multiple recipients, allowing the creator of the visual story to view the multiple ways in which their story is being interpreted. Finally, the player has the option to publish their story, giving other friends or the community a chance to interpret the story as well.

and a few of of the wireframes we included:

Narrative and wearables – the Digital Creator Jumpsuit

Created for:

Project length:

  • Short (one week, design document).

Team:

  • Heather Kim
  • Matt McGowan
    • my principle contributions: “Research prototype description,” “Illustrative example” and “Storyboards”
  • Cooper Wright

Challenge:

  • The class was asked: “How can you enable kids to experience an artistic or scientific concept on a visceral or kinesthetic level?”

Our answer to this question was the Digital Creator Jumpsuit. Below are a couple of storyboard sketches and an illustrative example I wrote for the

Digital Creator Jumpsuit group design document (pdf):

Illustrative example

Anna, a 4th-grader, has decided to create, along with two of her friends, a short–digital–movie about a mouse who learns how to dance by watching the human family whose house he lives in. Anna is responsible both for the film’s set and for the background sound and music to be played during several of the short’s scenes.

Working on the sets first, Anna orients her jumpsuit to “painter mode” and calls up–on the sleeve of her non-dominant arm (in Anna’s case, her right)–the palate of colors that she and her friends agreed upon for the mouse’s hole-in-the-wall home. Anna decides she wants to use her left arm to paint with blue, so she taps that color on her palate and swipes up her arm, watching the color flow up her right arm, across her chest and down her left arm–“filling up” the entire left sleeve of the jumpsuit with that color. For her right arm, Anna needs yellow, so she taps on that color and swipes down, filling up her right sleeve. Done with color selection for the time being, Anna triple-taps the palate to close it. Now she’s ready to paint!

Suddenly remembering one of her art classes from last week, in which she and her classmates learned about Vincent van Gogh’s The Starry Night, Anna decides to go with a “giant swirly” pattern for the mouse’s living room wall. Facing the wallscreen and touching her hands to her shoulders (which signals to the screen that she’s about to paint with her arms), Anna walks from the left of the screen to the right in long, loping strides–swirling, twisting and waving her arms as she does, seeing her multi-colored movements registered on the giant digital canvas in front of her.

Once she reaches the right side of the screen, Anna surveys her work and thinks that the pattern she’s made looks like “some crazy waves.” “So maybe,” she muses, “the house the mouse lives in is by the ocean, and he can hear it from his home in the wall!”

Wanting to play around with the idea before she forgets about it, Anna puts up the hood of her jumpsuit, which is her setting to automatically switch to the suit’s “sound and music” mode. Next she triple-taps her right arm to call up her music and sound effects board to search first for “waves on the beach” and then for “pebbles on the beach”–two of her favorite ocean sounds. Anna then tasks (by selecting and swiping different sound/music icons) “waves on the beach” to both of her arms and “pebbles on the beach” (which she thinks will go well with the star-dots she’s planning on painting in and around the swirly pattern she’s already created) to both of her legs/feet, as she wants to be able to mix the two sounds in real time. She’ll make the wave sounds rise and fall with the movement of her arms and make the pebble sounds by running in place with “quick little baby steps,” listening to the mix through the surround-sound array embedded in her jumpsuit’s hood.

As she’s planning all this out in her head, Anna realizes that she’s probably going to look pretty ridiculous doing it; but she doesn’t really care–that’s why the museum gave each of the students in this program their own “studio.” And, anyway, she knows her friends wouldn’t laugh. Actually, she can’t wait to finish this sound piece (and maybe the star-dots, too) so she can call up a chat window and have her two co-creators come down the hall to see what she’s got so far. Their movie is going to be so awesome–she just knows it!

Making art history come to life with “Frieze Tag”

Frieze Tag wireframe - Figures assembled

Created for:

Project length:

  • Short-medium (final two weeks of class, design document).

Team:

  • Matt McGowan (solo project/assignment).

Challenge:

  • Design a learning game; produce a design document that contains a detailed software analysis (or landscape audit), related classroom activities, and a mockup or prototype.

My response to this assignment was a design for a multimedia, augmented-reality learning game/app called “Frieze Tag!”

The full design document can be found here:

“Frieze Tag” design document (pdf)

These are a few screens from the mockup (or rigged-path prototype) I created for the prototype:

And here are some images from the “Klepsydra” segment of the 2004 Summer Olympics Opening Ceremony in Athens:

“The Great Mural of Our People” – a MinecraftEdu + Makey-Makey design

Drawing of Stonehenge builders rolling stones

Created for:

Project length:

  • Short (one week, design document).

Team:

  • Matt McGowan (solo project/assignment).

Challenge:

  • Integrate tangible computing into another assignment done during the semester.

I elected to add a tangible element to the design I did for the course’s “Empowering narrative-making in others” assignment earlier in the term–a MinecraftEdu-based project entitled “The Great Mural of Our People” (the text of which is here, for comparison’s sake). Here’s the result of adding Makey-Makey to the mix–wherein students design simple, interactive machines that simulate laborers operating the same machine together:

NARRATIVE AND TANGIBLE COMPUTING – “THE GREAT MURAL OF OUR PEOPLE” (pdf)

“OPEN: the Journal” – an app designed to help close the word gap

Created for:

  • Digital Media Design for Learning (DMDL) degree; Cognitive Science and Educational Technology I course (Spring 2014).

Project length:

  • Medium-long (approx. last quarter of the term, final group project design document).

Team:

  • Saira Mallick
  • Matt McGowan
    • my principle contributions: “Background,” “Problem Description,” “Delivery Platform” and “Project Narrative.”
  • Ruth Sherman
  • Shalini Shroff

Challenge:

  • As a group, produce a full, thorough design document on a project of mutual interest.

A few years ago, I read Maryanne Wolf’s Proust and the Squid (2007) and was floored to learn (amongst other things) that

[a] prominent [1995] study found that by kindergarten, a gap of 32 million words already separates some children in linguistically impoverished homes from their more stimulated peers. In other words, in some environments the average young middle-class child hears 32 million more spoken words than the young underprivileged child by age five. (p. 20)

In class, I was fortunate to have three other classmates become interested enough in this “word gap” to work on a project together. What we came up with was a mobile application titled “OPEN: the Journal.”

The main goals of this design are to:

  1. promote the sustainability of programs such as the Thirty Million Words Initiative, and
  2. support approaches learned in initial interventions–i.e. engaging in conversations with young children and speaking to children using a larger number and a greater variety of words.

The full design document can be found here:

“OPEN – the Journal” design document