Augmented reality glasses that turn languages into subtitles on the fly

Like it? Share it!

Augmented reality glasses that turn languages into subtitles on the fly

It won’t be long that going to a foreign country where you don’t speak the language won’t require fumbling through thick phrase books to try and understand and be understood. In the near future, your glasses or contacts could translate language on the fly and display the translated text in from of your face. It might seem kind of like cheating, but I imagine it’s also a really good way to learn a language.

William Powell returns with his augmented reality glasses, but this time rather than beat Google’s Project Glass at its own game, he’s upped the ante with a headset that can display subtitles of conversations spoken in foreign languages.

Powell’s entire translation setup doesn’t use any fancy state of the art equipment. It’s made from parts you can go out and buy yourself: two Raspberry Pi running Debian Squeeze, Vuzix 1200 Star, Jawbone Mic, headset mic, TV, iPhone, iPad and Asus Transformer. See, nothing special.

The individual using the glasses be wears the Vuzix 1200 Star glasses which are connected to the s-video connector on the first raspberry pi and the Jawbone bluetooth microphone that connects to a device such as smartphone or tablet to provide a clean noise cancelled audio feed. The bluetooth microphone streams across the network of what I say and what it picks up around me. This is then recognised and passed through Microsoft’s translation API with a caching layer to improve performance of regularly used statements. Passing through this API service is the biggest delay in the subtitles. Once translated the server passes back the text and translations that are picked up by the raspberry pi driving the TV and glasses displays. Elizabeth uses a headset mic but could user her own raspberry pi, glasses and jawbone microphone to have the same experience as I do.