Projects / Ideas / Sign language alphabet reader

Sign language alphabet reader

AdvancedEdge AIIdeaReviewed
In short

How do you build a sign language alphabet reader?

A camera tracks hand landmarks and a classifier turns hand shapes into letters on screen. You need Raspberry Pi 5, SanDisk microSD card 32 GB (A1, Class 10), Raspberry Pi 27 W USB-C power supply, Raspberry Pi Camera Module 3 and Raspberry Pi 7 inch Touch Display 2.

Level
Advanced
Time
About 360 min
Parts
5
An idea, not a guided build yet. Goal, parts and steps; no wiring, code or tests. Copy it to My Garage to plan it.
Goal

Use hand landmarks as features for a classifier.

How to build it

  1. Get 21 hand landmarks per frame
  2. Normalise them for size and position
  3. Record examples of each letter
  4. Train a small classifier
  5. Show letters and build words

Related projects

Common questions

What parts do I need for the sign language alphabet reader?

Raspberry Pi 5, SanDisk microSD card 32 GB (A1, Class 10), Raspberry Pi 27 W USB-C power supply, Raspberry Pi Camera Module 3 and Raspberry Pi 7 inch Touch Display 2.

How long does the sign language alphabet reader take to build?

About 360 minutes for a advanced maker.