📸: Scott Little
The Project
People may be familiar with the use of artificial intelligence (AI) in their encounters with the preference engines that select online music, videos or shopping, but the use of AI as an essential tool in a wide range of creative processes is often invisible.
This interactive installation at the Vancouver Art Gallery serves as an introduction to the exhibition The Imitation Game. It invites the visitors to explore the range of images, objects and ideas that shape the exhibition.
The visitors can start the exploration by using a basic form of AI that combines computer vision, machine learning and neural networks that analyze your hand gestures in real-time and trigger an appropriate response to the interaction. The images and information on the wall are addressed in greater depth throughout the exhibition.
video background soundtrack designed by Patrick Pennefather
The Team
Six graduate students at the Centre for Digital Media worked as a team to design, program and produce this interactive installation in Summer 2020.
Allyson Zhong - Project Manager /UX
Luisa Martinez Riaño - UX / UI
Sooq Won - Video Artist / Producer
Farbod Tabaei - Concept Artist / Developer
Pieteke MacMahon - Software Developer / UX / UI Designer
Larry Bafia – team advisor
Luisa Martinez Riaño - UX / UI
Sooq Won - Video Artist / Producer
Farbod Tabaei - Concept Artist / Developer
Pieteke MacMahon - Software Developer / UX / UI Designer
Larry Bafia – team advisor
I was brought on board to contribute post-production programming support from September 2021 to March 2022.
My CONTRIBUTIONS
📚 Researched gesture control sensors and decided on using Leap Motion Controller to detect hand position
➡️ Implemented the UDP packets receiver in Processing and integrated the Unity UDP client program
👋 Implemented user experience features such as displaying one hand at a time and closing nodes when no hand detected
✨ Modified the layout, colour, and size of the UI element in Processing
🔊 Designed and implemented the sound effect
💡 Updated the database and designed an asset management solution for gallery technician
🔍 Installed and tested the interactive piece to ensure the projection quality
