Showing posts with label voice. Show all posts
Showing posts with label voice. Show all posts

Saturday, October 24, 2009

Sense Substitution

Two interesting products from the field of neural interfaces.

Both of them leverage the fact that our sensory organs are just transducers which give inputs to a really flexible and remarkable signal processing system called the brain. This makes it possible to use one sensory organ to achieve a similar result to that of another. Sensory substitution.

In a very indirect way, sign-language or braille could be considered as external sense substitutions. But these two instances that I came across thanks to Engadget and Google, a few months ago, are much more direct. Interestingly, this article from HowStuffWorks seems to suggest that folks have been trying this since the 1900s!

The first is called BrainPort (their corporate site talks about a more clinical use of their product).
Essentially, here vision is being substituted by taste!
Do watch the following video:


And heres the second one.
Check out this browser screenshot to know how I came across this ;-)






I think this (seeingwithsound) is a way cooler solution. The interface is much more natural and amenable to daily use. Well, here, vision is being substituted by stereo sound - almost sonar.


In case you want to try what this feels like, just download their free windows software winvoice, plug in your web cam and put on a stereo headset. Definitely has room for improvement, but I like the ease and simplicity it offers (they even have j2me, winmo and android mobile phone app versions!).

The best part - both of them are non-invasive, non-risky and do not cost a lot. I hope this helps a lot of people who really need it now. Certainly good news.

Sunday, March 16, 2008

The future of communications - Neural Interfaces. Presenting Audeo

If you've read some of my older posts, you might realize that the way I see tele-communications developing in the near future is through Neural Interfaces - and I've been trying to follow a few cutting edge developments in this direction.

When we say neural - it does not necessarily have to imply 'implanted' capsules within our brain tissues. In fact, it seems the best way to neurally catch one of our 'senses' is to catch it someplace before it terminates into a sense organ :).

The latest comes from the world of sound (thanks to textually.org for the lead). The company is Ambient Corporation, its innovation is called Audeo and its tagline is 'Speak your mind'. I guess the tagline gives you a fair premonition of where this leads to ;).

What they have to offer is a neckband. Yes - a neckband that sort of eavesdrops on the neural signals sent by the brain to the vocal chords, interprets em and plays out synthesized speech based on its database of neural patterns and words.

And the good part is - you don't really have to even speak - just a careful trained thought that you are speaking something is enough to trigger this thingy. Awesome! A definite help to people who have problems with their vocal chords and just as helpful to people who might want to talk with their girlfriends right in the middle of a busy market.

Check out its demonstration video on YouTube:



Thats one of our five senses tapped digitally, others are well on their way. Soon we will be communicating in all our senses without - moving our lips, opening our eyes, reaching out our hands, sniffing with our noses or opening our mouths. Things are beginning to sound more and more like The Matrix to me!

Thursday, August 23, 2007

Adding Voice to SMS

The telecom revolution is sweeping the world at a scorching pace. Nothing has changed the way people interact and transact as the humble mobile phone has. For the first time, an Information Technology device has become accessible to even the less privileged in developing countries. SMS has today become an integral part of inter-personal communication. Consider this: worldwide, 620 billion SMS messages were exchanged just in Q1 2007!

Unfortunately there is a vast community for whom SMS does not hold relevance- the visually challenged. Trust me, they DO use their mobile phones extensively and it IS a great blessing for them even if it just provides them a means to attend or make calls.

Back in 2003, we at Tinfo Mobile had realized this and did whatever little we could. We made a Java based application for Reliance India Mobile users. Most of the Reliance handsets being very limited B&W ones at that time, we made a lightweight client app that resided on the phone with the bulk of processing handled by on the server-side.

The idea was simple:
a. The client app would retrieve the SMS text and send it to the server.
b. The server would use a TTS (Text to Speech) engine and convert it into an audio stream.
c. The client app would play-back this audio stream.

We were able to create a working prototype which won us a Special Award. We also made a lightweight application that was client only which would read out just the missed / dialed /received calls. This app was named 'Call History' and was launched by them.

A few other softwares are also available:

1. TALKS. The most notable among them is TALKS for Symbian mobiles from Nuance. The only problem is - its limited to a slightly high end mobile phone category - Smartphones running on Symbian OS. Nevertheless its a great piece of software.

2. Mobilespeak. Developed by Code Factory, mobile speak has a braille hardware support option also.

3. Pocket HAL. Developed by Dolphin Computer Accessories, Pocket HAL supports Windows Mobile PDAs.

I wanted to provide more options if I could and thats when a new product idea struck. Most mobile phones (even the relatively cheap ones) support bluetooth, infra-red or cable connectivity. Quite a few visually impaired people (though I admit, only a small percentage) have access to a computer either at home or office and PC IR/ BT dongles and cables are pretty cheap nowadays.

The result is SMS Talkz - an advanced voice enabled SMS management software for plain old PCs supporting most handsets with bluetooth, infra-red or cable. A software that resides completely on the PC requiring nothing to be installed on the phone and still reads out your SMS in voice. (Its also designed to be a good companion to those blessed with a good vision too)

The first Release Candidate is being readied at the moment and we require people to use, test and report bugs. So, those who have a little time to spare, please pitch in by downloading the beta from the SMS Talkz site. Serious bug finders will be rewarded by serious discounts too (do sign up at the forum with valid email address for that) :)

Also, do help spread the word on the product by including any one of the following banner images on your blogs / sites:

Banner Code (copy paste to your page, replace IMAGE_URL):



Box banner 320 x 265:



Leaderboard: 750 x 80



Banner small: 505 x 70



In case you want to provide just a text link, please use the following code:


Thanks! Your help is appreciated.