Voice and gesture development environment: keyboard free programming
Abstract
Description
Computer interaction is essential for computer science professionals. Traditional input devices, such as a keyboard and mouse, can be difficult obstacles for professionals with pre-existing manual impairments or may develop future manual impairments as a result of extensive computer use. To address the needs of these professionals, we developed the Voice and Gesture Development Environment (VGDE), allowing users to create Java programs through the use of voice and gesture, by using Microsoft Speech for speech recognition engine and the Leap Motion device and Application Program Interface (API) for gesture recognition. This software allows users to dictate Java code naturally through voice commands, as well as edit and navigate the user's code with voice and gestures. The purpose of the VGDE is to reduce the amount of keyboard and mouse usage while programming and interacting with a development environment.
Computing Sciences
College of Science and Engineering
Computing Sciences
College of Science and Engineering