this page is still in the works
Please check back again in a week.
Thank you :)
Thank you :)
Animation by Artemiy on LottieFiles
AI-generated image of the art installation, from a prompt referencing the original exhibition plan.
poetry in motion
Interactive Art Installation
A multisensory fusion of art, tech and language
Background:
Poetry in Motion is an interactive art installation that emerged from the fusion of technology, art, and linguistics. This project creates a dynamic, immersive experience where participants' movements transform into AI-generated poetry, surrounded by a multisensory environment.
01
Challenge:
The primary challenge was "Immerse yourself in the technology; understand its workings, and identify potential applications. Create a realistic scenario where the technology can be applied. Build a demonstration that enables the audiences to engage with the technology." The technology in question was mainly;
- Microcontrollers, sensors, and actuators.
- Digital modeling, simulation, and fabrication tools.
- LLM based AI
Design Process:
The project journey involved extensive experimentation with motion sensors, AI poetry generation, and multisensory integration. Challenges in technology compatibility and implementation were overcome through iterative testing and teamwork, resulting in a cohesive and engaging experience.
02
Idea:
Poetry in Motion combines Particle's Photon 2, Adafruit’s Triple-axis Accelerometer, and OpenAI’s API for real-time poetry generation, and a carefully crafted multisensory environment. Participants interact with the installation using a motion-sensing wand, with their movements generating unique poetic expressions.
Poetry in Motion combines Particle's Photon 2, Adafruit’s Triple-axis Accelerometer, and OpenAI’s API for real-time poetry generation, and a carefully crafted multisensory environment. Participants interact with the installation using a motion-sensing wand, with their movements generating unique poetic expressions.
Exploration into motion sensors, AI-driven poetry creation, and multisensory feedback highlighted the need for precise technology integration. Testing various sensors and AI models was crucial in developing a system that could respond fluidly to participants' movements.
The journey began with an personal idea that blossomed into a collaborative project, during a pin-up idea critique session for our final semester project.
Towards the end, two of my classmates approached me, saying they would love to work together on my project idea. I was definitely taken aback by their unexpected interest.
However, their enthusiasm was both affirming and exhilarating, transforming my solo venture into a promising team project. This phase was filled with excitement and the shared anticipation of what we could create together.
With the team established, we dove into developing the concept, refining the idea, and exploring its potential. Assigning roles was a natural process, as each team member gravitated towards their strengths and interests.
We faced the challenge of integrating our diverse skills and interests into a cohesive development strategy early on, but I tried to work it out rather quickly, ensuring that each contribution was both valued and pivotal to the project's success.
I also enlisted the help of my mentor, Professor Purin Phanichphant, who contributed to the FigJam board in the planning stage.
Acknowledging the spatial constraints at the showcase event, I opted to create a detailed 3D mockup of our installation afterwards. This decision allows me to provide an immersive online experience that conveys the essence of our interactive installation effectively.
The virtual representation was meticulously designed to capture the interactive nuances of the physical installation, ensuring that viewers could experience our work, even if they weren't at the event.
Heading 1
Heading 2
Heading 3
Heading 4
Heading 5
Heading 6
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.
Block quote
Ordered list
- Item 1
- Item 2
- Item 3
Unordered list
- Item A
- Item B
- Item C
Bold text
Emphasis
Superscript
Subscript
03
Research Insights:
Exploration into motion sensors, AI-driven poetry creation, and multisensory feedback highlighted the need for precise technology integration. Testing various sensors and AI models was crucial in developing a system that could respond fluidly to participants' movements.
04
The journey began with an personal idea that blossomed into a collaborative project, during a pin-up idea critique session for our final semester project.
Towards the end, two of my classmates approached me, saying they would love to work together on my project idea. I was definitely taken aback by their unexpected interest.
However, their enthusiasm was both affirming and exhilarating, transforming my solo venture into a promising team project. This phase was filled with excitement and the shared anticipation of what we could create together.
05
With the team established, we dove into developing the concept, refining the idea, and exploring its potential. Assigning roles was a natural process, as each team member gravitated towards their strengths and interests.
We faced the challenge of integrating our diverse skills and interests into a cohesive development strategy early on, but I tried to work it out rather quickly, ensuring that each contribution was both valued and pivotal to the project's success.
I also enlisted the help of my mentor, Professor Purin Phanichphant, who contributed to the FigJam board in the planning stage.
The prototyping phase was pivotal, focusing on the integration of Adafruit’s ADXL326 accelerometer and the OpenAI API for real-time poetry generation. We encountered some significant challenges in calibrating the accelerometer to accurately translate physical movements into digital signals.
Additionally, the shift from ZeroWidth (which we initially planned to use) to OpenAI's API just days before the showcase added pressure, necessitating rapid adaptation and extensive testing to ensure seamless interaction.
Integrating the motion-sensing technology with the AI-generated poetry system was complex. We aimed to create a multi-sensory environment where movement seamlessly translated into poetic expressions.
Challenges included synchronizing the motion data (x y z coordinates) with the poetry output and ensuring the interactive installation was intuitive and engaging.
Refining the user experience involved continuous testing and adjustments, enhancing the installation's responsiveness to movements and its overall aesthetic appeal.
06
Acknowledging the spatial constraints at the showcase event, I opted to create a detailed 3D mockup of our installation afterwards. This decision allows me to provide an immersive online experience that conveys the essence of our interactive installation effectively.
The virtual representation was meticulously designed to capture the interactive nuances of the physical installation, ensuring that viewers could experience our work, even if they weren't at the event.
07
Guiding Principle
“Technology alone is not enough. It’s technology married with liberal arts, married with the humanities, that yields us the result that makes our hearts sing.”
— Steve Jobs