1 of 6Cover Image

About This Project
Lingual is a mobile-first language learning app that uses real-time object recognition, audio transcription, and gamification for immersive language education. Built with Flask microservices and MongoDB, it supports cross-platform learning via React Native. Features include YOLO-based object detection, Whisper-based audio input, a spaced repetition algorithm, and gamified learning to improve retention and DAUs.
Key Features
- Built cross-platform mobile app with React Native
- Implemented YOLO-World for object detection and Google Translate API
- Used Whisper v3 for multilingual transcription with 92%+ accuracy
Technologies
ExpoFlaskMongoDBYOLO-WorldWhisper v3
Timeline
Jan 2025 - Feb 2025