ASL Recognizer

A simple app that analyses and recognises the alphabet in sign language using machine learning

Notion link

I trained the model with this dataset of about 80,000 images depicting the american alphabet in sign language. The computer trained the model for about 24h and I got pretty accurate results. Schermata 2022-04-01 alle 16 41 43 Schermata 2022-04-01 alle 16 40 42


Download the model

Once the model had finished training I implemented it in Swift, creating a project that received in UIImage processes it with the model and shows the result on screen. The code is open-source and available on GitHub.

The frameworks I used

I used AVFoundation as the first framework to start recording in real time and receive frames from the camera. After that, the frames I was receiving from the camera were processed using the model created with machine learning and using the vision framework. Then the whole UI is built using SwiftUI.

frameworks 001

Demo of the app



View Github