Voice navigation, capture into notes, audio playback

[rjsamp]

I'm tired of pushing the little buttons......this could be a major strategic push for SLX Mobile 3rd quarter 2012.....the codecs are available.....and through Sencha for sure if not Dojo.....

command navigation by voice including picklists, lookups, button clicks, send email, phone home, hash tags, directions to a customer address.....all voice.

voice capture of your sermon into an SLX Notes field....maybe it's back on the cloud\server but voice to text still gaining ground.

and certainly we can playback text to audio for notes fields etc into headphones, car speaker system....

[wskidmore]

This got me curious so I did some research. But I can't seem to find any web-based api (you mentioned Sencha?) beyond the following:

• Chrome/Android Browser: Text input element with microphone button. Press button and it will record Speech to Text, to the input field (see google.com in Chrome).
• PhoneGap - plugin: An Android-Only plugin for PhoneGap; https://github.com/phonegap/phonegap-plugins/tree/master/Android/SpeechRecognizer
• Microsoft ActiveX - something may be worked out with this, but would be desktop only I believe: http://msdn.microsoft.com/en-us/library/ms722071(v=VS.85).aspx
• Various third-party providers: all require for-pay licenses and are either Flash based, or Java/Java applet based.

Another thing is privacy and who should have access:

• Chrome: Audio sent to Google to translate
• Phonegap/Android: Audio sent to Google to translate
• Microsoft: Uses the speech recognition system designated via Control Panel
• Third-party: Sent to third party server to translate

The only way I could see it working is to hook into the native phone capabilities (if any) and provide a javascript interface to that -- which is what Phonegap does, but they only have Android support currently. Not sure what is stopping from adding support for Apple/Blackberry/WebOS, could be the Adobe buyout (source still available under Apache Callback).

[rjsamp]

Now you know why it's a dream\idea....but you've got to start somewhere. Start with the basics.....

1. Voice capture into an SLX Activity and History record with playback (VCR) buttons capability. This needs to be on the WEB and LAN clients as well as SLX Mobile.
2. Voice Navigation\hands free operation of SLX Mobile...we need to be able to speak to the SLX Mobile app and do searches, page scrolls, button and icon clicks, etc.
3. Voice data entry can come next....start with picklist selections (if you've got button click by voice you certainly can pop a picklist....mabe discern a picklist item based on a sound and scroll'type' ahead to the item..... say "Select" and you'd close the picklist popup with that selected value inserted into the underlying control.