Sign language to speech glove
Most people do not know Indian Sign Language, so deaf and mute people struggle in shops, offices and hospitals. A glove that recognises a set of signs and speaks them aloud helps bridge that gap.
- Parts
- ₹3,500
- Build
- 14 weeks
- Board
- ESP32
- Objectives
- 5
Block diagram
- Five flex sensorsMeasure each finger's bend
- MPU6050Measures hand tilt and motion
- ESP32Classifies the sign
- DFPlayer and speakerSpeak the word
- OLED displayShows the word
- Phone appShows readings and sends commands over Bluetooth+
Objectives
- To read five finger bends and hand orientation 50 times a second.
- To recognise at least 15 signs (letters and common words).
- To speak each word in English and one Indian language.
- To report accuracy per sign for three users with a confusion matrix.
- To monitor and control the system from a phone over Bluetooth.
Parts and specifications
- ESP32 DevKit V1Dual-core 240 MHz, 520 KB SRAM, Wi-Fi + Bluetooth, 3.3 V logic, 12-bit ADC (use ADC1 pins when Wi-Fi is on)₹450Buy
- MPU6050 accelerometer and gyro3-axis ±2 to ±16 g and ±250 to ±2000 °/s, 16-bit, I²C 0x68, motion interrupt pin₹150Buy
- 47 kΩ resistors and a cotton glove₹150
- TP4056 charger with protection1 A CC/CV Li-ion charging to 4.2 V, DW01 protection cuts at about 2.5 V₹40Buy
Total about ₹3,500 at typical online prices. Tap a part for its pinout and datasheet notes.
Design calculations
Vout = 3.3 × 47k / (47k + Rflex). Flat 25 kΩ → 2.15 V; bent 70 kΩ → 1.33 V: about 1000 ADC counts of range.
Five normalised bends (0 to 1) plus roll, pitch and three acceleration means over 0.5 s = 10 features per sign.
k-nearest neighbours (k = 3) on recorded samples, 30 per sign per user. A small neural network (TinyML) handles signs with motion better.
Pin map
| Signal | Pin or connection |
|---|---|
| Flex sensors (thumb to little) | GPIO 36, 39, 34, 35, 32 with 47 kΩ dividers |
| MPU6050 SDA / SCL | GPIO 21 / 22 |
| OLED | Same I²C bus |
| DFPlayer TX / RX | GPIO 16 / 17 |
Firmware outline
- Calibrate: record each finger flat and fully bent for this user.
- Sample at 50 Hz; normalise; smooth with a moving average.
- When the hand is still for 300 ms, take the features and classify.
- If confidence is high, show the word, play its clip (English or Tamil/Hindi folder), and wait for a new sign.
- Collect training data mode: label and save samples over serial.
Test plan
| Test | Expected result |
|---|---|
| 15 signs × 20 tries by the trained user | Accuracy per sign |
| Two new users | Accuracy before and after their own calibration |
| Similar signs (for example M and N) | Confusion matrix shows mix-ups |
| Time from sign to speech | Under 1 s |
These rows start your results table when you plan the project.
Viva practice
Say your answer out loud first, then check. The first 2 answers are free; Maker opens all 5.
Make it yours
One or two upgrades for a mini project, two to four for a major one.
Datasheets and sources to cite
- Spectra Symbol flex sensor datasheet
- Indian Sign Language Research and Training Centre (ISLRTC) dictionary
- InvenSense MPU-6050 datasheet
About this project
How much does the sign language to speech glove project cost?
About ₹3,500 for the parts in the base list: ESP32 DevKit V1, Flex sensor 2.2 inch × 5, MPU6050 accelerometer and gyro, DFPlayer Mini MP3 module, Speaker 8 Ω 0.5 W, 0.96 inch OLED (SSD1306, I²C), 47 kΩ resistors and a cotton glove, 18650 cell 2600 mAh (branded), TP4056 charger with protection, MT3608 boost converter.
How long does it take?
About 12 weeks for the base project, built on an ESP32. Each upgrade adds time.
Which branches is it suitable for?
Electronics and Communication, Computer Science / IT (IoT, AI), Biomedical, Instrumentation, as a major project.
Which pins and design calculations does it use?
Flex sensors (thumb to little) on GPIO 36, 39, 34, 35, 32 with 47 kΩ dividers; MPU6050 SDA / SCL on GPIO 21 / 22; OLED on Same I²C bus. Worked calculations on this page: flex divider, feature vector, classifier.
How do I test it?
15 signs × 20 tries by the trained user: Accuracy per sign. Two new users: Accuracy before and after their own calibration. Similar signs (for example M and N): Confusion matrix shows mix-ups. Time from sign to speech: Under 1 s.
What are the objectives?
To read five finger bends and hand orientation 50 times a second. To recognise at least 15 signs (letters and common words). To speak each word in English and one Indian language. To report accuracy per sign for three users with a confusion matrix.
