The Map
Yep, Here is the Pulse of Bloom
inside the tree
You don’t need to know music theory to feel something, to express something.
And This is the magic world
how did we get here?
just Show me the cool stuff
Here is a process list :D
Research
Inspiration - Topic
Inspiration - Tech
Desk Top Research
HMW
Prototype
Unity Prototype
Concept
Design Features
Iteration
Iteration - Tech
Iteration - UX
Next Step
Some Decision we made
Of Course we had to make improve in a lots of things
Lets take a look...
Pulse of Bloom
A VR experience where emotions bloom into music.
Start with Some Inspirations
Inspiration
Life is Continuous Light
- Azalea Valley | teamLab
When people pass by or approach the azaleas, the color of the light changes and a new color resonates out. Then, the light of that tree radiates out and is transmitted to nearby azaleas in the valley. The propagated light of the azaleas will again resonate, and the color will continue to resonate to nearby azaleas in the valley.
Mood.mic
- Angela Vujic | MIT media lab
mood.mic is a privacy-preserving tool for monitoring bipolar disorder. It allows users to track their moods by telling a story about an image twice a day for 60 seconds.
how About some music?
Desk Top Research
Art / Music Therapy
Music naturally has the ability to influence emotions, and the same goes for art.
Given the conditions listed, it is clear that the overall effect of music therapy is based on soothing mood
Most people in art therapy are looking for enjoyment
Music often feels like a technical field, something reserved for those who understand theory.
Function Feature - 1
Interaction with Flower
Our idea is that flowers are used as carriers for playing music.
Preview mode: When the player touches a flower, a music clip corresponding to the flower will be played briefly as a guide to help the player identify the "sound personality" of each flower.
Function Feature - 2
Bouquet (Music) Production
The different colors and appearances of the plants represent different musical components.
bass
drum
chors
melody
Official playback mode: When the player puts flowers into the bouquet, the corresponding music will continue to play and join the overall soundtrack combination to form a complete musical atmosphere.
Now this is a fun little minigame
but its not a world
Luckily, we already have one
The Bigger scale
Visual: Scene Setting
A dreamy cave environment
Scene setting:
The background is set as a dream scene that can awaken the vitality of nature. When the objects are placed correctly, the flowers will bloom, the colors will change, and the light will be enhanced, forming a visual "positive feedback".
Whisper of the wood
A multi sensor experience
This is a fantastic forest, where some interesting elves and wonderful plants live. It has its own ecosystem and operating rules.
According to legend, some overly anxious humans will be lucky enough to be brought to this world and healed.
Make your own bouquet of music
We hope to create a garden where each flower has a melody or bass.
Players can freely choose different flowers to compose their own bouquets and music.
Sooooo Its Visual, Its tech....
a Bit Cliche, wasn’t it?
How to pick up and place the plant?
Initial stage: Free Grab
objects can be picked up by the player and placed anywhere.
iteration: Snap placement
we introduced a snap system:
objects will automatically align and "snap" into place when they approach a present point.
Problems encountered:
Players lack of feedback on placement, and don't know whether the music bouquet has been placed.
The placement of the music bouquet seems messy, and
we need to find a better way
to organize the bouquet.
technical implementation:
This stage uses the XR Grab Interactable component in the Unity XR Toolkit, combined with a simple rigidbody physics system.
Add Collider and Rigidbody
Use XR Grab Interactable
Allow objects to move and rotate freely in the scene
technical implementation:
Snap system logic:
Use Trigger Collider to detect objects approaching the target area
Enable position/rotation alignment within the detection range
Play animation sound feedback when alignment is completed
Implementation tools:
Custom SnapManager script
OnTriggerEnter triggers snap operation
Use Transform.Lerp or DoTween for smooth transition
the link between each music pieces
Problems encountered:
Audio playback misalignment
During our testing, we found that due to the inconsistent time points when players put flowers into the bouquet, the playback timeline of each piece of music was also inconsistent, resulting in the overall soundtrack being misaligned and sounding very inconsistent. Especially when players take out flowers and put them back, there will be more serious overlap or lag problems.
iteration: Custom audio synchronization logic
To solve this problem, we wrote a custom audio management script. The script implements the following functions:
Whenever any flower is placed in the bouquet, all tracks will be replayed from the beginning;
Before restarting the playback, the system first detects the list of flowers currently placed, and then starts the corresponding audio uniformly;
Even if the player takes out or reinserts the flower in the middle, the music can be refreshed and aligned immediately, so as to keep the entire audio playing synchronously and ensure the consistency of the music experience.
Visual, Visual, Visual
iteration: Flower model change logic
After each snap is completed, the flower emits a vfx effect to simulate entering a "growth" stage
iteration: Other visual feedback
The environment color transitions from cold to warm colors. Use VFX Graph to create particle effects (such as floating light spots).