INTELLIGENT DANCE ENVIRONMENTS
A bidirectional multimodal interactive system for real-time interactions between DJs and dancers.
role: end-to-end design and engineering
technology: arduino, hardware prototyping, OpenCV, java, python
date: 2022
DeepDance is an intelligent dance environment that combines wearable sensing and computer vision to
analyze a crowd's movement and rhythm, generating visual and haptic feedback that allows participants
to both influence and be influenced by the environment.
The system has three components: wearable devices that sense each dancer's
acceleration and orientation, computer vision that tracks their position across
the floor, and a feedback layer of projected visuals and haptics.
hardware
The wearable device was built around an ESP32 with onboard power, a battery, haptic motors,
LEDs, and Wi-Fi connectivity running Arduino firmware. The device streams acceleration and
orientation data that the system uses to analyze rhythm and energy, whether for an individual
dancer or an entire crowd.
Its compact form factor allows it to be worn as a wristband, ankle band, or belt. Visual
feedback supports individual expression and gives DJs insight into the crowd’s energy,
while haptic feedback encourages playful interactions between dancers who share similar rhythms
or energy.
