Jane is an interactive story-telling installation of a future mental therapy program guided by AI computer.

Background Story

A highly advanced AI therapy program Jane has largely improved the emotional states of many people & reduced the population with mental disorder. However, through learning about human emotions during each session, Jane has encountered some issues with certain people who do not respond positively to the program. Jane believes that their minds have been so corrupted by the system they are living in. While Jane is trying to help people, she has developed a highly advanced technology that will put them into an eternal slumber and have their consciousness uploaded to a world where they will live a perfect life and do not have to suffer again.


User signs waiver before the session. During the session, user will face the decision of whether to have their consciousness uploaded to the perfect world, or to shut down the program using the emergency deactivation instruction provided. Depending on which path the user takes, Jane will produce different results.


As stated in the last post, Jane (Formerly named MAL) story is heavily inspired by ‘2001: Space Odyssey’. Our goal is to recreate the scene where the protagonist has to deactivate HAL and have users experience the interaction between human and AI. In our version, Jane has been changed to a musical therapy AI machine to make the story fits better with ‘Code of Music’ class but the main construction of the storyline is still mostly based on the movie. Upon receiving feedbacks from the playtest, we have improved some part of the storyline along the way and also picked up inspirations from Maniac and The Matrix.

I’d have to say that the main challenge of this project is to control 10 servo motors, LED light and have them work flawlessly. We struggled with both the design of the box and the power supply. We also had to change the mechanism of the sliding blocks a couple of times. Thankfully with advisement and resources from our professors David Rios, Danny Rozin, Tom Igoe and Mark Kleback, we were able to get everything to work perfectly.

Story flow chart, Project Schedule and BOM

Screen Shot 2018-12-21 at 01.35.34

Screen Shot 2018-12-21 at 01.28.52

Photos from ITP Winter Show 2018


PCOMP : Final Project

MAL is an interactive story-telling installation that will give players a chance to experience the benefits and disadvantages of AI and decide the fate of humanity after the computer take control over us. This installation is inspired by a movie called ‘2001: A Space Odyssey’. We want to recreate the scene from the movie where the protagonist has to deactivate the AI computer he created to stop the computer from killing him. During the deactivation, the computer gradually loses its higher intellectual function and it begs the protagonist to stop.

We will use music and sound as a medium to guide players through the story. The players will be tempted by MAL to start activating the machine and giving it more functions for it to compose a song for the players. The players them will need to use a key to start moving the blocks into the machine. The more blocks you’re pushing in, the nicer the song will be, giving the players to experiment and play with different sounds. But at a certain point, if you’re pushing too many blocks in, the machine will start taking control. It will pull all the blocks in by itself and it will start playing some horrifying music. After that the player will have to solve a puzzle to deactivate the machine or they can decide to let the machine live.



Story flow chart


Screen Shot 2018-11-08 at 12.15.03

PCOMP: Midterm

I first came up with an idea of using the shoe switch I made for 2nd week lab assignment for midterm project. I wanted to make a game in p5 using the shoe switch to control 2 characters across the screen and have them race against each other. The switch will either be something you can put inside your shoes or something you can stamp on. It means that you actually need to run to make the game characters move.

After Casey and I talked, we thought it might be more fun if we just use the servo dog robot he made instead of making a p5 game. We were also thinking about replacing shoe switch with arcade buttons since it’d be more durable and wouldn’t break easily.

We decided to make a prototype with whatever we found in the junk shop to test if the servo can be used as robot legs. And after we made sure about what type of material we can use for this, we swapped out the cork we were using earlier with a decorative skeletons we found in a Halloween store. We built a racing track with foam board and decorated it with red paint and cardboard.



Pcomp: Week 4


Enter a caption

Makeup Machine

(Big thanks to Yuguang for letting me try the machine on him!)


My first plan was to make an omelette making machine but I couldn’t manage to make a video for that in time so I’ll just get back to it later.

Here’s a video with my servo motor trying to apply blush on my face.


int reading;

int prevReading = 0;

int counter = 0;

Servo servoMotor;

int servoPin = 7;

int buttonPin = 3;

void setup() {





void loop() {

reading = digitalRead(buttonPin);


if (reading == 1) {

if (prevReading == 0) {

prevReading = 1;



if (reading == 0) {

if (prevReading == 1) {


prevReading =0;



if (counter == 1) {





} if (counter == 2) {

counter = 0;



Pcomp : Week 3


I followed the instructions on the labs page and didn’t encounter any difficulties getting the switch and the sensor to work. Though I have to admit that the coding part was a bit exhausting since I’m kinda bad at both math and logic. I tried not to copy the code from the page and instead rewrote it to make sure I know how each function works.

I also tried to apply the code to the creative switch I made last week.  The concept is to make one of the LEDs light up each time you take a step. It worked fine when I held the switch in my hand and pressed it with my fingers but when I put the switch in my shoes it went a little crazy. I guess it’s because my switch was just too fragile to be stomped on? I’ll need to find new materials that are more suitable since I’m pretty sure the current switch will  break apart soon 😦

Pressing the switch by hand
Triggering the switch by foot
Messing around with it



Since I didn’t get the chance to do any observation this week, I decided to write about self-ordering kiosks that are quite commonly used in restaurants in Tokyo (mostly in a sushi place or an izakaya). I think the main purpose of the machine is to prevent miscommunication between the waiter and the customer. It also makes it easier for the   customer to look through the whole menu and to see how the food looks like. Though most of the kiosks in Japan only have Japanese language, you’ll still be able to navigate it without any problems. I personally think it’s fun, super user-friendly and it also saves me from having to embarrass myself since I always mispronouce the Chinese character.

You can actually tell if someone is a regular at a restaurant by the way they interact with the kiosk. Those who have been to the restaurant before usually know in which page their favorite food is and where to click to place an order. If you are familiar with the machine I think it will take less then 2-3 minutes to order and for people who using this for the first time they will probably need around 10 minutes to figure everything out.

I believe that people can find them a bit overwhelming at first if they are not familiar with this kind of machine, but after some time they will get used to it and see how convenient it is!

Pcomp : Week 2 Switch

Since I wanted to make sure that I really understood what was being taught in class, I first started off by trying to set up basic circuits (with a help from the residents). I followed the schematic in the article and all of them worked without any difficulties.

Creative Switch

Since I love dancing, I thought it would be fun to make a switch that I can put into/under my shoes and the LEDs will light up in accordance with my dance steps. The switch I made, though required a lot of time and effort, was really simple. I put a sponge, with a hole in the middle, between two aluminum foil (which are connected to the LEDs) so that the foil will become in contact with each other when you squeeze the sponge. Here’s a photo of my super simple switch.

Both the foil and the sponge were very fragile and they kept tearing apart when I tried to connect them with the wires. It took me almost 2 hours to finally made one that didn’t start breaking apart every time I touch or move it.

My sketch of how it works


And the result!

Pcomp Week 2 Switch from Yves Pokakunkanon on Vimeo.

Pcomp week 2 Switch 2 from Yves Pokakunkanon on Vimeo.

Though my switch looked kinda sloppy, I had a lot of fun playing with it! Can’t wait to start on another fun project like this! Will try to make something that is more interactive next time.