Ah Yee
A smart device that scans QR codes on medicine prescriptions and translates the information into different dialects. Powered by AWS services and integrated with Alexa via the Echo Dot, it provides clear, voice-based translations to make medical instructions accessible to a wider audience.
Problem
In Singapore, 64.3% of elderly individuals aged 65 and above speak dialects at home, while only 12.3% speak English. Most medicine prescriptions are provided in English, which creates a significant language barrier for the elderly who struggle to understand the instructions. This language gap not only affects their ability to take the correct medication but also leads to confusion and forgetfulness in managing their medication intake, posing a risk to their health and well-being.
Idea
Using AWS, Ah Yee replaces traditional medicine prescriptions with QR codes. It scans the QR code, translates the instructions into dialects, and plays them aloud through an Alexa-enabled speaker. The device also sends alerts to help elderly patients track their medication intake, ensuring they follow prescriptions accurately.
Solution
Amazon Web Services:
-
Lambda
-
S3
-
DynamoDB
-
SNS
-
IoT
-
Polly
-
IoT Button
Open-source Library:
-
SimpleCV
-
OCR Tesseract
Tech:
-
Raspberry Pi Microcontroller
-
Pi Camera
-
Echo Dot
Phase 1 - The Basic Read and Output
The first phase of Ah Yee involves reading or scanning a QR code and outputting the value or string contained within it. By attaching a Raspberry Pi camera module to a Raspberry Pi microcontroller and programming it accordingly, the QR code’s value can be scanned, returned, and displayed in the console. This functionality is achieved using the SimpleCV Python library.
Phase 2 - Cloud Technologies Implementation
Ah Yee is a device that aids users in managing their medication intake through a Raspberry Pi-based system. It uses a camera module to scan QR codes on medication packaging, leveraging the Python SimpleCV library to extract data. Text instructions on the medication are read using the OCR Tesseract engine. These instructions are then translated into various dialects using Amazon Translate and converted into speech via AWS Polly, which allows for text-to-speech conversion.
The system integrates AWS Lambda and S3 for backend processing, tracking when the user last took their medication. If the system detects that the medication has already been taken, it alerts the user by playing a pre-recorded audio message stored in AWS S3. This audio is delivered through the Alexa Skills Kit and Echo Dot, ensuring that the user is reminded effectively.
Ah Yee also includes an AWS IoT button, designed for users to request urgent help, such as in emergencies or when medication needs restocking. When the IoT button is pressed, it connects to AWS IoT, which triggers AWS SNS to send email or SMS notifications to the appropriate recipients, such as medical professionals.
AWS Lambda processes the button press event and updates AWS DynamoDB, where a log of the button presses is maintained. AWS SNS then retrieves user information and particulars from DynamoDB to personalize the notifications. This ensures a fast and reliable alert system that medical professionals can respond to swiftly
Final Outcome
