Kinetic Keyboard

A Sign Language Keyboard: converting hand signs to charachters using Leap Motion


In today's world dictation software is becoming commonplace because it is so much faster for us to speak rather than type. However technology is all about universal accessibility and we bring to you the first silent dictation software! Using a leap Motion sensor and a Java application one can use American Sign Language to type. Our demo software recognizes the hand placements for the letters g,i,r,l, and s. The leap motion sensor provides a LOT of placement information about each bone of each finger and finding a way to identify the critical parts characteristic of each hand position took the most conceptual thought. The direction of the distal bone in each key finger is used to determine if each finger is outreached or curled in. Combinations of fingers out and in are then tested to determine which letter to print.

Built with

Try it out