RWET: Assignment 6

 

I had huge writer’s block and couldn’t come up with a good topic for this week assignment. I think one of the reasons is because i still don’t fully understand the concept of word vector and the way it works yet? I decided that for this week I’d try experimenting with new methods and focus on understanding each tools rather than the concept. I decided to go over week 9 and week 10 materials one more time. I followed the tutorials and used week 3 work and Lana Del Rey’s lyrics as source text this time.

I reworked my mashup lyrics from week 3 with synonym lookup. Now the program is rewriting lyrics that have the original words replaced by their synonyms (Which was I wanted to do before but I didn’t know how). I also brought in more lyrics from my favorite artist and used CMU rhyming dictionary to create new poems. For this one, I would have to revisit this piece again and make sure that it wouldn’t pick the same word as a rhyme because most of the results it gave me was two same phrases over and over.

Please see some of the results I like on the top of this post.

Screen Shot 2019-04-18 at 2.35.17 PMScreen Shot 2019-04-18 at 2.38.03 PMScreen Shot 2019-04-18 at 2.38.16 PMScreen Shot 2019-04-18 at 2.38.33 PM

Link to code

Machine Learning : Assignment 3

For this week’s assignment I use an image classifier that can predict the color of an object and then show a list of other objects that can potentially have the same color. I think this can be a fun educational tools for kids to learn about colors and vocabularies.

I trained the model with different shades of Orange, Blue and Green. The result wasn’t as accurate as I hoped it would be. I might have to add more images to make it work more properly.

RWET: Assignment 5

A letter from past me to future you

Screen Shot 2019-04-04 at 3.04.38 AMScreen Shot 2019-04-04 at 3.09.03 AMScreen Shot 2019-04-04 at 3.17.01 AMScreen Shot 2019-04-04 at 3.08.09 AMScreen Shot 2019-04-04 at 3.10.19 AMScreen Shot 2019-04-04 at 1.57.10 PMScreen Shot 2019-04-04 at 1.53.35 PMScreen Shot 2019-04-04 at 1.55.54 PMScreen Shot 2019-04-04 at 1.53.57 PMScreen Shot 2019-04-04 at 1.50.19 PM.png

by Yves Pokakunkanon

I found some old letters from my girlfriend while cleaning the apartment and I thought they would be a suitable source for this week assignment. I chose to use the first one and the last one just because of how contrasting they are to each other. The first letter was dated 01/2017 and the last one was dated 02/2018. She hasn’t sent me any more letter since then. I won’t go into details or post the letters here, but in summary, the first letter was just her telling me about her day and the second was her expressing what she felt about our relationship.

I decided to use Markov model and chose a very simple structure code that we covered in class a week before. My computer decided to die and refused to turn itself back on while I was working on the code and in the end, I did not have enough time to do something complicated. I will try to revisit this week assignment again when I have time.

Screen Shot 2019-04-04 at 3.16.08 AMScreen Shot 2019-04-04 at 3.20.32 AM

I first set state_size to 2 but after it kept giving me results with very little variations I decided to change state_size to 1 and it got way more interesting. Most of the results were more like scribbles than real sentences but once in a while some really funny results also showed up. I picked some of the ones I like the most and rearranged them into a new letter that you can see on the top of this post. I will write them down on paper and send it to my girlfriend later.

Link to code

Final worksheets

New idea for final project

I have finally come to an agreement with myself to accept that creating a perfectly functional bodysuit for performances would be way too ambitious to accomplish in a span of only one month. After trying to look for more inspirations, I’ve talked to Chenhe about his idea about creating music with Ramen. I thought about an idea of visiting various ramen places and collecting sounds of people eating ramen and then we can turn those data into sound-visualization for each ramen place. After a discussion, we both still couldn’t find a strong concept of what we can actually do with Ramen so Chenhe introduced me to Hara Kenya’s ‘Water Pachinko’ and suggested we could do something like that instead. We want to build something that represents waterfall and far-east style instrumental music.

Hara Kenya’s ‘Water Pachinko’

Our idea is to create an installation that consists of a water repellent white canvas with several pins attached to form a pattern. Users will use a dropper to drop colored water from the top of the canvas that would later fall down due to gravity. While the water drops travel through the canvas, they can either change direction, multiply into several drops or combine with other drops each time they hit the pins. This, visually, will result in a water painting-like canvas. 

We will put a bowl under the canvas and install a microphone near it to collect the sound of the water dripping from the canvas and dropping into the bowl below and use that for one of our sound sources. We will also install a camera that can capture the whole canvas and track the position and the pace of water drops, turn the data into values and eventually use those values as inputs for music making software.

Project schedule and goals for final presentation

Link to spreadsheet

Screen Shot 2019-04-03 at 13.39.37Screen Shot 2019-04-03 at 10.34.35Screen Shot 2019-04-03 at 10.33.39

Midterm Documentation

Link to slide

Butoh is a Japanese dance theater that mainly use movement to express emotions and stories. The performers usually paint their body white and exhibit choreography and movement in silence. This kind of performance began to gain popularity in Thailand and now we there are several groups that try to apply this technique into theatre. Though butoh is usually performed without any sounds to music, my friend (a theater actress) and I would like to create a performance that bring sounds and new aspect to a butoh performance.

Screen Shot 2019-04-03 at 13.09.06Screen Shot 2019-04-03 at 13.09.17

We want to create a bodysuit that will turn the performer into a human instrument. While the performer is moving, the audiences can come up and make contacts with each parts of the performer’s body to create sound effects, alter the background music as well as add new sounds. I plan to use various DIY textile sensors for the bodysuit so that it is easier to sew on and would make the suit more light-weighted. The sensors I plan to use is touch pressure sensors and stroke sensors.

For midterm presentation, I made a prototype of the bodysuit with DIY touch pressure sensors attached to a various parts of the suit. I then use Ableton connection kit to map each sensor to each parameters of Ableton Live to control the pitch and apply sound effects to the music.

 

I tested the sensors with Arduino IDE and they all worked perfectly and gave stable values. However, when I connected them to Ableton Live, the mapping were all messed up and in the end I could only control one of them. I think it is because I used Adafruit’s FLORA instead of UNO and the pin numbers are somehow different. I tried to look up id anyone has experienced using FLORA with Ableton but unfortunately I couldn’t find any useful information so I decided to use one sensors to control several sound effects in Ableton instead. I will upload a demo video of how this works like I showed in class soon!

For next steps, I will try to find a way  to fix the mapping and connection between FLORA and Ableton. It I can’t, I will switch to Arduino UNO since there has already been so many projects using it with Ableton so it will be easier to improve and debug the code. I also would love to work on visual improvement and work on how to make the bodysuit look appealing and is also comfortable for the performer to wear and move in.

Intro to Wearables: Week 3

The assignment this week is to create a garment that expresses messages to people around you. I was struggling a bit with the ideation because, once again, I wanted to do something that is practical and doesn’t focus only on the concept but I found it really difficult for that because the ideas I had in mind were mostly really conceptual. I decided to go with the idea I wanted to do the most even if it cannot be used in real life at all. I realized that if I limit myself by caring too much about “making sense” then there’d be no point in doing this since I couldn’t really express my thoughts as I wanted to.

I decided to create a headpiece that protects the wearers from their surroundings. This headpiece looks just like a scarf or a neck accessory in its normal state and, depending on the wearers’ decisions, with the use of muscle wires, it will expand and become a shield-like headpiece that prevent people to interact or get close to the wearers. This head piece is inspired by Winnie Yoe’s ‘Confrontation for Introverts’ workshop where one of the participants created a helmet that prevented people from seeing her face. The head piece I created is for the wearers to send out the message and let people know that they want to be left alone or they don’t want any accompany at the moment.

I tested out Shape Memory wires (4 wires at a time) and they were working perfectly when I connected them with Arduino using male to male wires and conductive tape. I then sewed 8 wires to the fabric and used conductive thread to create the circuit. Unfortunately it didn’t work when I plug the headpiece into the Arduino. There was spark and flame and then my Arduino shut down and I was too afraid to try again. I figured it might be that the 5V was not enough to heat up 8 wires at the same time? I then switched to 11V battery but again it didn’t work. The wires didn’t get hot at all. In the end I needed to use a hair dryer to heat the wires up to get them back in the programmed shape since I didn’t have enough time to look for a more powerful power supply. I also haven’t installed an on-off button/switch for this headpiece too.

This headpiece looks pretty nice in my opinion! My next step is to try to find a way to make this work with battery since I wanted it wireless and I also don’t wanna risk breaking my Arduino again. I will also need to install a switch that will control when the current can pass through the wires.

Intro to Wearable: Week 2

The second assignment is to create new senses trough wearables. At first, I couldn’t really grasp the idea of the the word ‘new sense’ and I was mostly thinking about supernatural thing like ‘seeing a ghost’ and ’reading another person’s feelings’. After I asked around and talked with several people in the class, I finally learned that it can be something as simple as ‘sense of direction’ or ‘sensing the weather’. I then spent a lot of time thinking about how I can make something that would be useful for me in real life and is also not to ambitious for me to finish in a week. 

Since I’ve been having a lot of arguments with my girlfriend lately, I wanted to make something that’d help improving our relationship. One thing that has always been a problem between us is that she thinks I’m always being too loud and I always yell at her every time we’re in a fight (which I beg to differ). I think it’s really hard to tell if you’re being too loud or not when you’re the one speaking? That’s why I thought that a wearable that is able to detect the volume of your voice and let you know if you’re being loud would be a nice fix for my habit.

I decided to create a small device that you can put anywhere (inside a hat, a bra, a pocket, etc.) and it will detect the volume of your voice and vibrate if your voice goes above the threshold. I used Aadfruit Flora, a microphone and a vibration motor for this.

I was trying to use conductive thread since I wanted to practice designing soft circuit diagram but ended up soldering everything together because the transistor and the resistor was difficult to sew. After that I sew Flora on to a piece of fabric to make it look like a small packet. For the code, I had some problems taking readings from microphone at first volume but could make it work in the end with helps from David.

This works perfectly! I had some friends put it in their caps/pockets and started yelling at me. They said they could sense the vibration even it feels subtle sometimes.

For the next step, if I decide to continue working on this, I’d like to attach self-adhesive fabric to one side of the packet so that it’s easier to stick it to your choice of clothing.

Here is the code I used for this.

const int motorPin = 6;
int micVal = 0;

void setup() {
Serial.begin (9600);
pinMode(motorPin, OUTPUT);
}

void loop() {
// Serial.println(micVal);

float micVol = 0;
float micLoudness = 0;
float updateMicVol = 0;
float prevMicVol = 0;
float loud = 0;

for(int i=0; i < 200; i++) {
micVol = analogRead(A9);
loud = abs(prevMicVol – micVol);
micLoudness += loud;
prevMicVol = micVol;
}

updateMicVol = micLoudness / 200;
Serial.println(updateMicVol);

if (updateMicVol > 200) {
digitalWrite(motorPin, HIGH);
delay(200);
digitalWrite(motorPin, HIGH);
}else{
digitalWrite(motorPin, LOW);
}

}