Retinal Implants: Visual Experience
The “Visual Experience” demonstrates the technology of retinal implants. It is a sandbox tech demo that serves as a learning experience about vision loss. Guests will wear a head-mounted display equipped with a camera; the display will show video from the camera that has been processed in real-time to resemble the low-resolution vision afforded by retinal implants. In this sandbox experience, guests will be able to freely look about the room and at deliberately designed posters and physical objects. This experience encourages guests to experiment with and adapt to their new vision, helping them empathize with those who suffer from vision loss as well as appreciate what can be accomplished even with low-resolution vision.

Cochlear Implants: Audio Experience
The “Audio Experience” demonstrates the technology of cochlear implants. It is a cinematic experience about hearing loss and recovery. Utilizing film and post-processed audio, this experience tells the story of hearing loss and recovery from a first-person perspective. Along the way, interactive social situations involving dialogue trees place guests in virtual social situations that they must navigate with their limited hearing. As they clear each stage, however, they are given the ability to hear through simulations of what more and more modern cochlear implants sound like. This experience compels guests to reflect upon the difficulty of social communication with hearing loss and appreciate hearing implant technology. To experience the interactive cinematic, click on the the image below.

Full Interactive Demo (Opens new window)

Neuroprosthetics: Neuro Experience
The “Neuro Experience” demonstrates the technology of neuroprosthetics. It is a game-like simulation about rehabilitation that will ask guests to re-learn a familiar task. EEG headsets that detect brainwaves will mimic and simulate the interface of a neuroprosthetic limb by gathering the guest’s brainwave activity. Guests will have to try and move a virtual leg by actively controlling their own thoughts. Controlling one’s brainwave activity is inherently less familiar and intuitive than using a mouse or a keyboard, and guests will initially find it awkward and even frustrating; however, as they gradually adapt and succeed, and even if they don’t, the experience will leave them with humble respect for the difficulty that real amputees must go through to rehabilitate – to re-learn things that are often taken for granted but necessary to be self-sufficient in society.

Animation Assets – Main Menu Animation
Tools: Photoshop, Illustrator, After Effects

Loop-able animation made for Project Xense’s interactive museum installations during its idle-state. The graphics were made in Photoshop and Illustrator, and were animated in After Effects.