The Screen Translator
Screen Translator is a mobile tool that enables real-time translation of any on-screen text — from apps, images, games, and websites — directly on your device. Powered by OCR and AI language models, it removes the language barrier by letting users tap any content on their screen and instantly receive an accurate translation in their preferred language.
To help individuals communicate, learn, and navigate digital content in any language — without switching apps, copying text, or losing context.
Target Users
- Travelers navigating foreign-language apps and websites
- Language learners seeking in-context translations
- Gamers playing imported or untranslated titles
- Professionals working with multilingual documents and platforms
Existing translation tools require users to exit their current app, copy text manually, paste it into a translator, and switch back — a workflow that is slow, disruptive, and often fails on non-selectable text like images or game UIs.
- Non-selectable text in images, games, or screenshots can’t be copied and pasted
- Switching between apps constantly breaks focus and flow
- No context-aware translation for UI elements, menus, or dialogs
- Lack of history and saved translations for repeat reference
Screen Translator solves these problems with an always-available overlay that works across any app. Users simply activate the translator, tap any text on screen, and receive an instant translation — no copy-pasting, no app switching, no friction.
OCR-Powered Screen Capture
Instantly reads and extracts text from any on-screen content — including images and game UIs
Real-Time Translation Overlay
Translates directly on top of your screen without leaving the current app
Customizable Bubble Style
Personalize translation bubble colors, sizes, and positions to suit your preference
Translation History
Review, bookmark, and revisit past translations in an organized log
The design process began by mapping how users naturally encounter foreign text on-screen — and reducing the number of steps to get a translation to as few taps as possible.
Concept Exploration
Early concepts centered around three core ideas:
- Always-on floating bubble for zero-friction translation access
- Tap-to-translate on any visible text using OCR capture
- Inline overlay — show translation without replacing original text
The visual design of the app prioritizes clarity and speed — users need to read translated text at a glance. The design language is clean, high-contrast, and accessibility-forward.
Design Principles Used
Style Guide
The app successfully transforms the fragmented experience of translating on-screen content into a seamless, one-tap workflow.
Outcome
- Eliminated copy-paste translation by enabling direct screen capture and OCR
- Centralized translation history, removing the need for external note-taking
- Quick language switching and inline overlays reduce task completion time significantly
- Improved comprehension for non-native speakers navigating foreign apps
Impact
- Users gain faster access to translations without breaking their workflow
- Travelers and expats can navigate foreign apps and websites confidently
- Language learners benefit from in-context translations for faster vocabulary acquisition
- Gamers can enjoy untranslated titles without external lookup tools