Projects / Ideas / Gesture glove for sign language letters

Gesture glove for sign language letters

AdvancedAssistive TechIdeaReviewed
In short

How do you build a gesture glove for sign language letters?

Flex sensors on each finger and an IMU recognise a set of signed letters and speak them aloud. You need ESP32 DevKit V1, Flex sensor 2.2 inch × 5, Resistor 10 kΩ × 5, MPU6050 IMU, DFPlayer Mini MP3 module, Speaker 8 Ω 0.5 W, SanDisk microSD card 32 GB (A1, Class 10) and Li-Po battery 3.7 V 2000 mAh.

Level
Advanced
Time
About 600 min
Parts
8
An idea, not a guided build yet. Goal, parts and steps; no wiring, code or tests. Copy it to My Garage to plan it.
Goal

Classify hand shapes from sensor data.

How to build it

  1. Sew flex sensors along each finger
  2. Read each as a voltage divider
  3. Record samples for each letter
  4. Train a simple classifier
  5. Play the letter's sound

Related projects

Common questions

What parts do I need for the gesture glove for sign language letters?

ESP32 DevKit V1, Flex sensor 2.2 inch × 5, Resistor 10 kΩ × 5, MPU6050 IMU, DFPlayer Mini MP3 module, Speaker 8 Ω 0.5 W, SanDisk microSD card 32 GB (A1, Class 10) and Li-Po battery 3.7 V 2000 mAh.

How long does the gesture glove for sign language letters take to build?

About 600 minutes for a advanced maker.