Typewriter Piano: Multisensory Interaction Design

Project Overview

Typewriter Piano is a multisensory art installation that merges audio, visual, and interactive elements to create an immersive experience. This research project was accepted for presentation at the National Conference on Undergraduate Research (NCUR) 2025.

Key Features

• Interactive musical typewriter that translates typing into piano notes
• Visual feedback system that responds to user input
• Multimodal sensory integration (touch, sound, sight)
• Collaborative interaction design allowing multiple simultaneous users
• Artistic expression through technological interaction

Technical Implementation

The Typewriter Piano installation combines hardware and software components to create a seamless interactive experience:

• Modified Typewriter: A vintage typewriter retrofitted with sensors to detect key presses
• Digital Sound Synthesis: Custom software that maps keystrokes to musical notes and chords
• Visual Projection: Real-time visual elements that respond to the music being created
• Integration Layer: Software that synchronizes all sensory outputs for a cohesive experience

The project explores the intersection of physical computing, sound design, and visual arts to create a meaningful interactive experience that bridges traditional typing with musical creation.

Research Significance

This project investigates how multisensory interaction affects user engagement and creative expression. The research examines:

• The relationship between typing patterns and musical composition
• How visual feedback influences users' typing behavior
• The accessibility of musical creation through familiar interfaces
• Collaborative aspects of shared creative experiences

The findings from this project contribute to our understanding of human-computer interaction design and the potential for everyday objects to be transformed into expressive artistic tools.