Category: Creative Approaches Through Emerging Media

  • W8. Sensor Value Smoothing Lab

    I lost my video of working circuit, but here is my code:

    By using the averageValue library, I was able to smooth out the LED brightness changes and make them feel more natural. Instead of instantly reacting to each new distance reading from the sensor, I stored the last 10 brightness values and calculated their average. This way, the LED gradually transitions between brightness levels, avoiding sudden jumps. It makes the visual feedback look much more stable and refined, which is especially important when working with real-world sensor data.

  • W10. Slowest Interaction

    Waiting the elevator.

  • W7. Machine that recognizes someone’s presence (Proj #2)

    Reference image sourced online

    The first time I truly felt recognized and alive was during a trip. I was standing by the ocean, feeling the waves crash against the shore, the wind blowing against my face, and the vastness of the sea stretching endlessly in front of me. In that moment, I felt small but also deeply present, as if the ocean itself acknowledged my existence. It was a powerful feeling—like nothing was impossible.

    I wanted to recreate that sensation, to build something that could visually represent the feeling of being recognized and present. My idea was to use a ToF sensor to interact with a dynamic visual, mimicking how the ocean responds to movement.

    Since this was a quick assignment, I found a Touch Designer Tutorial to make a particle simulation and connected the Arduino to create an ocean simulation that interacts with the hand.

    As I moved my hand over the sensor, the waves in the simulation reacted, shifting and changing, just like the real ocean.

    Material

    Hardware: VL53L0X ToF sensor, Arduino, LED output

    Data Flow: Arduino reads distance → Sends it through Serial → TouchDesigner uses it to control the ocean effect

    Interaction: Moving a hand over the sensor changes the waves

    Circuit

    Code

    TouchDesigner

    Testing

    Credits

    TouchDesigner Tutorial: https://www.bilibili.com/video/BV1CM411u7yW/?share_source=copy_web&vd_source=3a95f0657f18702c7cedbe43458b3b4a

    Reference Image: https://images.app.goo.gl/r1aWdhP3vCd6w8QJ8

  • W6. Curating Interactive Space

    I want to create an exhibition themed around “Flowing Life,” a digital art experience that immerses visitors in a world where motion and technology blur the lines between the organic and the artificial. The exhibition, titled Flowing Life, is inspired by works like Sougwen Chung’s Body Machine Meridians and Refik Anadol’s Coral Dreams. These pieces have always struck me as alive—fluid, organic, and almost breathing. At its core, this exhibition aims to transport viewers into a world where digital creatures flow and evolve, challenging the boundaries between technology and life.

    I chose these two projects because they both capture the essence of “flowing life” so perfectly. Sougwen’s work blends human and robotic gestures, creating strokes that feel fluid and meditative, while Refik’s AI-generated coral formations pulse and shift like living, breathing organisms. Though their mediums and techniques differ, they share a common thread—movement, transformation, and a mesmerizing sense of presence.

    The exhibition will take place in a large, immersive space where these works will be projected onto massive LED screens, enveloping the audience in waves of motion and color. Paired with a soft, ambient soundscape, the environment will feel calming, almost meditative. I hope visitors will pause, lose themselves in this flowing world, and perhaps even feel a connection to these digital creatures. Ultimately, it’s an invitation to rethink what life means in a world where technology and art intertwine so seamlessly.

  • Final Project Proposal

    For my final project, I wanted to combine timbre studies with harmonic studies. Continuing with the cat and cat language from the timbre study, I wanted to turn that into a more logical and systematic conversational mini-game.

    Timbre Study
    Harmony Study

    By using the Chatgpt API and the tone. js sampler you can “communicate” with the characters in the game in the form of meows. In addition, since this is a music class, I also wanted to incorporate some musical elements, such as the ability to control our main character, A Cat, to walk around with different musical notes, and the ability to ask the game character if he can write a song for you in the dialog.
    Regarding the timeline of this project, I plan to finish debugging the API and the basic game code (including how to control the main character cat to walk around, how to interact with the game character and then have a conversation) by December 1st, write all the code of the program classes by December 3rd, and then spend the last week to improve the interface and other details.

    Sketched Interface
  • Class 20 | Metaverse: Architecture and Governance

    The piece that struck me the most was how We Feel Fine and Listening Post managed to turn cold, impersonal data into something that felt strangely alive and deeply human. We Feel Fine pulled me into a swirling mass of emotions, each one plucked from the online confessions of strangers—moments of joy, heartbreak, hope, and loneliness, all there for me to explore. At first, it felt like a secret window into the soul of the internet, but as I clicked and scrolled, I started to wonder whether the act of cataloging these feelings stripped away some of their meaning, turning them into nothing more than colorful dots on a screen, something to look at but not quite touch. The connection it offered felt fragile, as if it could dissolve the moment I looked too closely, leaving me questioning whether human emotions really belong in the rigid structures of data.

    Listening Post, on the other hand, didn’t try to offer meaning or connection—it gave me chaos. Standing in front of its glowing screens, watching snippets of live internet chatter flash before my eyes while robotic voices read them aloud, I felt like I was sinking into the noise of the digital world, the same noise that surrounds me every day but made visible, made impossible to ignore. There was no tidy narrative, no promise of understanding; it was just a flood of disjointed, fleeting thoughts, some mundane, some profound, all overlapping in a way that felt overwhelming yet honest. And while I stood there, trying to make sense of it all, I realized that maybe this was the point: to confront the sheer volume of our digital lives, to sit with the mess and accept that not everything is meant to be understood.

    Both works stayed with me long after I left, lingering like questions I couldn’t quite answer. They made me think about the systems we rely on to organize our world, systems that feel so clean and efficient but often hide the messy realities underneath. How much do we give up when we trust data to tell us who we are, and how much of ourselves do we lose when we try to fit into its tidy categories? Maybe it’s not about rejecting data entirely, but about remembering that it’s never the full picture, never the final answer—it’s only what we choose to make of it.

  • Class 14 | Networks

    Avatar created by Ready Player Me

    As a loyal RPG fan, I’ve had countless digital avatars over the years. It’s crazy to think about how fast the trend of digital avatars has grown in the past decades. Now, it feels like every game has some kind of marketplace for character skins or outfits, and despite being nothing more than data, some of these skins sell for anywhere from ten to fifty bucks. If you told someone twenty years ago that they’d be spending $10 just to change how their character looks in a game, they’d probably laugh and think it was ridiculous. But here we are, and more and more people are willing to spend money to make their characters look unique or even stand out from the crowd.

    world of warcraft( Picture found online )

    This phenomenon isn’t just a trend—it’s become a major part of the gaming industry. The roots of this can be traced back to games like World of Warcraft and Final Fantasy, where people started to value not only their characters’ skills and abilities but also how they appeared in the game. Fast forward to today, and we have platforms like VRChat, where entire social interactions revolve around your avatar’s appearance. This surge in digital avatars has opened up whole new industries and business opportunities. Just like in the real world, things that people buy and use in the physical space can be sold again in the virtual world—whether it’s clothing, accessories, or even real estate in some metaverse-like platforms. It’s become a new frontier for people to express themselves, make connections, and even build virtual businesses. 

    Final Fantasy XIV ( Picture found online )

    And I think one of the coolest things about this digital world is that it’s not limited by geography. In VRChat, for example, you can meet people from all over the world who speak all kinds of languages. It’s a space where people can come together without the usual physical boundaries, making it a powerful platform for global interaction, allowing people to break away from their real-world limitations. In these virtual spaces, you can become anything you want. You can choose to represent yourself however you see fit, which can be incredibly liberating for a lot of people. Whether it’s a reflection of your personality or an escape from your everyday life, digital avatars give you the freedom to create your ideal self.

    VR Chat ( Picture found online )

    As for my own digital avatars, I’ve spent plenty of time crafting them over the years. The screenshots below are my digital avatars in the fantasy RPGs I play. I tend to make my avatars as flashy as possible, but I won’t limit my digital gender. I’ve created both male and female avatars, but I find myself having female avatars more often. It feels more fitting for me and aligned with who I am in these worlds. It’s like a reflection of how I see myself in these digital spaces, where I can express a side of me that feels more authentic. But for other people, it might be completely opposite. They would like to make them look completely different from their real-world lives. This evolution of digital avatars has been fascinating to watch, and I’m excited to see where this trend goes next.

    pictures of a chinese rpg game I play and screenshots of my digital avatars

  • Class 13 | The Internet: An Infrastructural Overview

    The most surprising thing I learned from reading this article is that manhole covers aren’t just for sewers and subway access—they also serve as gateways for telecom companies like Verizon and AT&T. I’ve walked around New York countless times without giving a second thought to these manhole covers, but now I realize they’re part of the infrastructure connecting my apartment to the internet. It might be worth paying closer attention to the markings on them next time!

    This article also reminds me of the cables inside my apartment. Before setting up my own network, I’d never dealt with network equipment and just assumed that once I plugged in a router, the internet would magically “show up.” But when I moved out on my own and had to install everything myself, I got my first real look at the maze of cables hidden in the walls. It took me several hours of effort to identify each cable, follow a tutorial, and finally get everything connected properly. It was a lesson in just how much work goes into the things we usually take for granted. Behind every “virtual” experience lies a complex network of physical infrastructure—and a lot of effort to make it all work.