Augmented reality smart glass for the hearing impaired

2022 COE Engineering Design Project (NMK06)

---

Faculty Lab Coordinator

Naimul Mefraz Khan

Topic Category

Software Systems

Preamble

With the advent of AI, computer vision, and wearable devices, it is possible to create a miniature wearable device (think google glass) that can help hearing impaired people in navigating day-to-day life easily.

Objective

The objective is to create a Google glass-style wearable augmented reality device that can project the type of sound being heard through a microphone onto the display.

Partial Specifications

1. The device should have an on-board microphone to listen to audio in real-time.
3. The wearable computer should be able to perform two tasks: text to speech, and sound categorization.
4. The text-to-speech and categorization output should be shown on the AR Glass display.

Suggested Approach

1. Raspberry pi-based AR display (look for transparent OLED displays for pi)
2. Create a housing to hold the pi, display, and microphone.
3. machine learning/deep learning algorithms for sound categorization (look up "audio classification").
4. For speech-to-text, off-the-shelf solutions can be used.

Group Responsibilities

See below

Student A Responsibilities

study OLED display, configure housing

Student B Responsibilities

sound categorization

Student C Responsibilities

speech-to-text

Student D Responsibilities

integration

Course Co-requisites

To ALL EDP Students

Due to COVID-19 pandemic, in the event University is not open for in-class/in-lab activities during the Winter term, your EDP topic specifications, requirements, implementations, and assessment methods will be adjusted by your FLCs at their discretion.