BabelGlove

The Babelglove is a glove, embedded with sensors, that can translate the ASL hand gestures of the wearer to english text, using a computer program. It is lightweight and comfortable for the user to wear. The glove is fitted with flex sensors, a gyroscope and an accelerometer to capture the user’s hand and finger movements. A microcontroller and a bluetooth module are used to communicate between the sensors and the computer and the trained machine learning model take the data and produce an output on a desktop application. The entire system is designed to be user friendly for all learning levels.

The Team

Ann Dang

Ann Dang is a first generation undergraduate Computer Engineering student at the University of Central Florida. In the summer of 2014 she participated in the High School Research & Engineering Apprenticeship Program at UCF’s Center for Research in Computer Vision learning about different projects and papers that applied computer vision. Ann is a current Systems Engineering intern at Lockheed Martin supporting the Digital Sensor Systems team in modeling and simulation. She has been supporting the program since June 2019 starting as a College Work Experience Program student. In this project, Ann was responsible for creating the software for the user interface as well as helping to integrate the hardware and software together. After UCF, Ann will continue working at Lockheed Martin as a Systems Engineer Associate.

Linkedin Github
Andrew Glisson

Andrew Glisson is an computer engineering undergraduate student at the University of Central Florida, majoring in Computer Engineering. He is the co-founder of oSTEM at UCF, an LGBTQ+ professional development organization focusing on STEM majors. Andrew’s focus on the project was building the machine learning algorithm used to translate the user's hand signs to english.

Linkedin Github
Madison Manley

Madison Manley is an electrical engineering undergraduate student at the University of Central Florida. She has done undergraduate research for all four years in nanoelectronics and has been involved in various programs such as the Research and Mentoring Program (RAMP), Girls Excelling in Math and Science (GEMS), and the Student Undergraduate Research Council (SURC). In the summer semesters, Madison had the opportunity to do research at the University of California, Berkeley and Columbia University. Although her background and interests are in nanoelectronics, UCF has given her the knowledge and skills to contribute to the hardware design of the glove. After UCF, Madison will be an incoming electrical engineering Ph.D. student at Georgia Institute of Technology.

Linkedin
Shreya Mistry

Shreya Mistry is an Electrical Engineering student at the University of Central Florida. She has been taking classes at the university for four years under the Electrical and Computer Engineering Department. She is a member of various engineering clubs on campus such as SWE, IEEE, AIAA, and ASME. Shreya was in charge of researching and selecting what sensors to use for this project that would best fit the requirements and specifications.

Linkedin

Documents

Initial Project Description

Our project proposal outlining our initial idea for our project.

SD1 Report

120 page technical paper outlining your research and design for our project.

CDR Presentation

Critical Design Review Presentation Video for our project showing our progress on our project.

Conference Paper

8 page conference paper summarizing our project and for our committee to review.

Final Presentation

Our final presentation video of our complete project outlining the specifics of our project and our design and building process.

Final Demo Presentation

Our final demo presentation video of our complete project showing our working project.

SD2 Report

Final 120 pager technical paper for our project, adapted from our SD1 paper.