The Vera Community forums have moved!

General => Remote Control => H@L - Voice and Gesture Control (Android) => Topic started by: RichardTSchaefer on April 26, 2013, 11:56:40 am

Title: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 26, 2013, 11:56:40 am
This is the 2nd Generation of HAL ... The Home Automation using Language App.
This version is an Android only app.
You can find a YouTube video at: http://www.youtube.com/watch?v=_PVHOWRUGlA

You can find it on the Google Play store using the keywords: HAL and Vera

HAL uses the Google Voice Recognition Service for translating your request. The reliability of the interpretation is enhanced using the following techniques:
HAL supports commands for all of the following Device Types:

HAL will work on your LAN, remotely through the MCV servers, or remotely through your SSH or VPN tunnels. It will auto-detect the best option.

Hal also supports a request for the Active Status ... HAL will tell you the devices that are considered to be active.

HAL was designed to be localized.  (Made available in a future release.)
The response to a Status command can be  customized. (Made available in future release.)
What is considered active (Boolean logic, using the device's properties can be customized. Made available in a future release.)
HAL was defined to be customized ... change the semantic rules to match your style of speech (Made available in future release.)
HAL was designed so that I can easily extend it to additional device types: (New Devices and Commands Made available in a future release.)
To extend I only need the Device Type, Semantic rules (if not the same as an existing class of devices) and the corresponding device actions.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: hek on April 26, 2013, 12:07:28 pm
Cool Richard,

I am about to put up a couple of android tablets on the walls here for status and voice recognition. I was actually investigating the new Google Voice APIs. Would like to have some kind of continuous voice recognition if possible. 
How does your app handle this?
Is it possible to have it running it in the background (and view other status stuff on the screen)?

I would gladly help translating to Swedish.


Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 26, 2013, 12:22:47 pm
That's on my list .. my first Gen had an Open Mike
I think I can do this with Google ...

If I get the Open Mike to work I will also allow it to be run in the background.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Cor on April 27, 2013, 05:41:28 am
I just installed this app , very nice idea. But in won't handle my dutch accent :-s. I did about 20-ish test, one went through , but only after I changed a light name (from frontdoor to test), that was the only time I succeeded :-(

"turn on frontdoor light"  is recognised as "old florida outdoor life", "old for you life", "doodle form store life" 

I know I have a very strong accent , but there is a difference between light and life :-)

Is there a way to "teach" HAL specific words ?

Thanks,
Cor
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 27, 2013, 08:10:26 am
Yes ... there is a Dictionary page ... where you can enter what Google heard Source to what you said Target.

Does Google Voice Recognition work for you in Dutch for other things ? Google Search ? Google Maps ? .... Do you have to specify another Language ?

I have designed Hal to change the Semantic rules to other languages (localize it) as well as the User Interface ... but I do not have a feeling for how good Google is at voice recognition in other languages.

I will be looking for people to work with to assist me in the localization effort for different languages.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Cor on April 28, 2013, 02:28:39 am
I found the dictionary page, but have no clue what to do with it.
I can add something, i can type in a source andi can type in a target. There is no accept or so button and the programm doesnt' respond anymore, unless i remove what I typed.

Is it possible that the dictionary is in the wrong language?  My phone is bought in Germany, with a german simcard, but native language is dutch, and I prefer to speak english. Can i check/change the google input language somewhere?

Thanks,
Cor

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 28, 2013, 10:20:18 am
Quote
There is no accept or so button

There's a release in the pipeline to fix that ... It was a layout problem on my part ... I did not setup the popup correctly and on some phones the button bar is not displayed.

Quote
can i check/change the google input language somewhere?
When you get to the Google Window where it is listening for you to speak ... there is a Wrench icon on the upper right corner. It has options to change language ... but I have no idea if Google Voice recognition actually works well in other languages.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Cor on April 29, 2013, 07:02:45 am
@RichardTSchaefer:  I see a grey line below the input tables.....that must be the button,when I press it , I see there is now a target and source with the words I typed.

My phone updated just now and after the update , the app does not want to start anymore, I get the message "......unfortunately" stopped... , the report has been send.

Comming back to the  dictionary, I am not sure how it works, obviously I pronounce a word not 
"typically english"   hence it doesn't recognize it. How does typing a source and target word help?   I expect I have to say the word , it is somehow recorded and I have to assign a target to it , or not?

Changing the dicationary of google (wrench right upper corner")  doesn't work in galaxy S3 , no wrench in upper right corner. But I see somewhere written  " .....Uk english", So I expect it is set correctly, since I want my commands in english.
I am looking forward to have this app fully working :-)

Thanks,
Cor

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 29, 2013, 07:49:05 am
If i say light ... Google thinks I said lite.
So I add a word to the dictionary:

Google Translation (Used to be source):   Lite
What I said (Used to be target): Light

Then when I see the word lite in the translation from Google ... I replace it with light ... then I attempt to parse the message.

There should be a HAL directory on your SDCard.
Can you send me the file Dictionary.csv located there.
Then delete it and see if HAL will start.
 
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Cor on April 29, 2013, 12:30:41 pm
I saw the error in the csv file , there was a comma on one line, I must have pushed the button (which wasn't there :-) ) .

I seem to get somewhere now, I am able to activate scenes ... and that's cool !!! :-)
But switching/turning on/off fibaro relais and wallplugs doens't workfor me yet.

What is the correct wording for turning on and of a fibaro relais and wallplugs. For example , I have a fibaro relais called "front door light" , I tried "turn on front door light", "switch on front door light"  but those doesn't work.

Thanks for all the help,
Cor
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 29, 2013, 02:24:02 pm
If they look like binary switches on Vera ... then the simplest commands are:

CMD SWITCH-NAME
or
SWITCH-NAME CMD

Where CMD is one of Status, On, Off, Toggle

Check the Help Menu ... to see which devices it found.

Please send me the csv file ... I need to see what you did to make it bullet proof. If you did it .. some one else will also!
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: hek on April 29, 2013, 03:02:03 pm
Some encoding problem with Swedish characters. Is UTF-8 used?

 
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Cor on April 29, 2013, 04:14:00 pm
@ RichardTSchaefer:

Attached the csv-file , the error I think happened when the "ok,cancel,delete" button was not shown.

HAL still has some issues recognizing words , although the dictionary  get some errors out , one of the problems is 1 word and google recognizes it as 2 words, this can not be inserted in the dictionary. For example when I say "increase" google keeps on recognising as "in case" this cannot be changed/inserted in the dictionary....  any way around it? (don't wanna go back to school again :-) )

*edit ,I cannot upload a csv file :-s I uploaded now screenshot of it.

Will there be a possibility to have HAL active on the background and without touching the device issuing commands?

Cor
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 29, 2013, 06:26:44 pm
Yes, I plan to do the Open Mike ... I had that in my previous version ... before using Google Voice Recognition ...
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: S-F on April 30, 2013, 05:31:04 pm
I can't for the life of me get HAL to control my thermostat. It can tell me the status of the thermostat but not change it's settings. If I say "Set the thermostat to XX" I get an error message even though my speech was detected properly. What is the proper diction to control a thermostat? The wording in the help file wasn't entirely helpful on this point.

For the record, I have the exact same issue with AutHomation. I should probably bring that up in the appropriate location though.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 30, 2013, 06:12:18 pm
Here are some examples ...  You can have more words before, after, or between the pieces.

Thermostat Name Heating 70
Thermostat Name Cooling 70
Thermostat Name Mode Cool
Thermostat Name Fan Mode On
Thermostat Name Occupied
Thermostat Name Status

i.e.
 Hal, Please set the Thermostat Name Heating temperature to 70 degrees.

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: S-F on April 30, 2013, 06:18:55 pm
I see. Since I only use "The Thermostat" for heating could I make a dictionary modification so "The Thermostat" is recognized as "The Thermostat Heating"?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 30, 2013, 06:43:00 pm
Once I get the key features working reliably I will release the semantic definition file.
Then you can create your own rules ...
    Freeze em out        could mean set the heating to 45

At present the dictionary is word at a time ... I have a request to make it phrase at a time.

At that time it will translate one phrase to another.
I will probably include my fuzzy logic match into matching the phrase ... so you do not have to match it exactly to substitute a phrase. You would then be able to do this with just a dictionary entry.

But semantic rules are a lot more flexible than a dictionary of expressions.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: landman2k1 on June 12, 2013, 12:52:38 am
I downloaded and installed HAL while watching your video.  I was local so it had my device and username.  Upon first launch, I get the standard greeting, and then it seems like nothing works after that.  Pressing the talk button does nothing.  I changed the greeting as you had, closed the app and restarted, but no greeting.  Force stopping the app did not help either.  I uninstalled/reinstalled and again, got the standard greeting, but nothing else seems to work for me.  What am I missing?  I the video it looks like you just installed the app and started talking.

Thanks for your help!!
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on June 12, 2013, 07:44:55 am
That's all I do ?

It sounds like it's hung up on something in your configuration.

Try deleting everything in the HAL directory on your phone and restarting.

If this continues ... you may need to turn on all of the debug options and send me the log file.
The log file will be written into the HAL directory.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: landman2k1 on June 12, 2013, 11:05:47 am
Im not saying that's all you do, not at all, just saying that in the video, it looks like the only "steps" you took were to basically install app and start speaking.

Everything in HAL dir deleted.  Restarted, with same result.  I did notice when deleting the files that my dictionary file was 0 bytes.  Turned on all debug options and restarted.  I now have a haltrace.log file.  How would I go about sending that to you?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Christophe G on July 27, 2013, 06:24:41 pm
Hi Richard,

Hal is really a great brick in home automation. If you?re looking for any kind of help to 'teach French' to Hal fell free to get in touch, I'd be glad to help.
I tested Google Talk's capacity (from within your app) against typical automation commands and it works nicely.

Best regards,
Christophe
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on July 28, 2013, 08:12:50 am
cool stuff. i tried using it but somehow it translates my english to dutch language xD
so i guess dutch is a possibility :-D
my s3 understand dutch very well and my english speaking is not translation good. either my pronounciation or its thinking i speak dutch.
how would i go about changing the commands to dutch language ?

edit:  as soon as anything is in the file Dictionary.csv the program crashes.  there was only one line :  om kitchen,on light kitchen
         seems to work when using built-in editor, only if no empty line i.e. comma is there.
         when i add lines with notepad and put it back on my s3 the HAL crashes (attached file renamed to .txt as forum wont take it like .csv ... same for .log )

more edit: ok i got it... in the program HAL itself go to Dictionary.. i set   

Google Translation:       What I Said:
 keuken uit                     light kitchen off
 hoerig                           RGBW red on
 zet koffie                      Coffeemachine on

me like ^^ 
which files do i need to translate ? the ones in JS dir or do i make new files called : names.config  ?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on July 28, 2013, 02:08:51 pm
I have extracted the grammar rules (Commands) into an external file with the intention of localizing this. But I did not know how good the voice recognition is in other languages.

Also there has been very little feedback on HAL so I have not done much with it for a while.

I do plan on doing the open mike feature.

If you are interested in trying to get it to accept Dutch commands I can probably document how you can modify the files on your phone to see how it might work .... There are still a few responses that are hard coded ... but only a few.

I hope you reported the crash ... I will fix it ... The dictionary has had a few bugs ... it was so simple I did it quickly .... and thats  where all my crashes have been.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: timmyg on July 31, 2013, 01:55:40 am
This app is awesome Mr RichardTSchaefer and I did enjoy the youtube tutorial!

It understands my Aussie accent without issue.

Would you consider having pin code protection on the app? I would not like for any of my tech savvy, cheeky friends to download the app and give orders front the front of my house!  ;D

I have the same issue with the sonos app but thats another story!

Tim
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: jay2068 on August 02, 2013, 09:12:51 am
Getting version expired when running application
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on August 02, 2013, 09:54:58 am
I expected to release a new version a couple of weeks ago ... did not finish testing before I had to do some travelling ... I will need to release a new Version today.
 
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: AndyW on August 08, 2013, 01:42:59 pm
This app is brilliant!!

I've had to rename a few devices to make the recognition easier but the new names make more sense anyway. It make controlling my Vera for the more common things a lot quicker and easier than any other normal Vera controllers I have used.

I am very impressed with how this works and surprised it hasn't generated more feedback for you. I think the Open Mike idea is great I would put it on a tablet which is always on my coffee table and could avoid reaching for my phone.

I'd like to use a Bluetooth headset with it so I can say "Open the pod bay doors" and ride my bike straight in, so bluetooth support would be good.

More devices would always be useful, Thermostatic Radiator Valves etc.

I'm sure this is a big ask but integration with the SONOS plug in to either use TTS to broadcast a message to one or more SONOS devices or even recording the speach to send as an MP3 or equivalent would be amazing. 

Also the security as mentioned earlier in this post would be useful.

Thanks for the hard work you have put in to it. I am very interested in any further developments made with this.

 
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: hek on August 08, 2013, 02:15:03 pm
Found this. Sounds promising.

http://www.slashgear.com/open-mic-new-android-phones-will-always-be-listening-15290445/
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Thiemen on August 10, 2013, 02:16:48 pm
First I think that you should receive credits for making this second version of the app much easier compared to the first version!

The app has some problems with me being dutch and recognizing the words i say, but hey this is a start in bringing home automation to the next level.

I think i have to work on my english or try to see what is possible with google voice in dutch language.
But we should try to get a lot people wanting to help to translate this to other languages and or finding ways to get the regocnizing better.

The app crashes or does not respond often at my phone, are more users having this behaviour?




Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Piwtorak on August 16, 2013, 09:37:20 am
Hello Richard,

I am trying something to use in android tablet to try voice commands to my vera.

I can not find the instructions to install Hal on my system, can you help me ?

is this compatible with portuguese language or only english ?

thanks in advance !

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on August 16, 2013, 11:22:54 am
You install HAL from the Google Play store.
Search for HAL and Vera

Voice recognition is in English only now.
It was designed to be localized to other languages for the both the menus and the command grammar. The latter requires that Google voice recognition can recognize your commands in your local language. My next release will make it easy for people to start to localize the grammar for testing purposes.

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Piwtorak on August 16, 2013, 04:05:05 pm
I will try and let you know...
thanks !
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: allmoney.ws on August 23, 2013, 11:13:50 am
Wait locale with open mike too :)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: allmoney.ws on August 24, 2013, 04:57:10 am
Tested HAL with russian language.

1) One time App exit with error. Sent log by Google Service.
2) If I wrote russian phrase in "Google Translation" and english in ''What I Said" all is WORK!
3) If I said similar phrare, for example - "выключить", not "выключи" it's not understand my command :( Fuzzy Match Limit not work in my case.
4) Welcome message not work in russian. Only english letters.
5) I wrote Gesture at Request tab (which added before at Gestures tab) and if it not Recognized - not open Result page (voice/gesture/error clicked)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on August 24, 2013, 08:18:44 am
Thanks I will look into the issues.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: mikee123 on August 31, 2013, 02:45:57 pm
I have just installed HAL. What a great program !!! 2 questions. Actually, 3 questions. I have watched your you tube video, which really helped getting me started, but it did not answer these question.

I have temperature sensors, and would like to know the temperature. One is calles Temp master bedroom. I tried temp master bedroom, temperature master bedroom, status temp master bedroom... nothing. So i am doing something wrong.

Second question, can i (and if how) run scenes ?

Third one... how can i assign a voice command to a device, lets say my device has a long name, and i just want to call it 'test' to turn on/off ?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on August 31, 2013, 04:30:47 pm
1) Temp Master bedroom status
2) Scene Name   
     or
    Run Scene Name
3) Enter  it in the dictionary ... some phrase to some command

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: mikee123 on August 31, 2013, 06:17:56 pm
Ok 1 + 2 working. Although if i say just the scene name, the phrase is recognised correctly, but there is no command associated, but it works if i say run followed by the scene name, so thats fine. Now, I am struggling a little with the dictionary. When I try to get my awning to come in or out, google does not understand me (it does not seem to have that word or be capable to capture that word), so I am trying to use the word shade instead. The device is called 'awning out'. So I have put awning out in google translation, shade out in what I said ( I have tried the other way round too but that did not work either). I then go back to the voice commands, and the command shade out is captured correctly, but there is no recognised (associated) command.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on September 06, 2013, 09:16:55 am
try :
what i said : shade out    google translation: awning out on
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on September 06, 2013, 09:24:23 am
in general you could say the phrase that you want to have recognized and look at the result page what the HAL comes up with as recognized command and put that in the dictionary on the "Google Translation" side and put the english command on the "What I Said" side. (for example: "light kitchen on"
for the temperature i have in dutch at the "Google Translation" side  : buitentemperatuur  and on the "What I Said" side i have : "backdoor temp status" without the "" ofcourse. so when i say : "wat is de buitentemperatuur" the HAL responds with : "backdoor temp is XX degrees"
now all we need is something that exchanges the "backdoor temp is XX degrees" with dutch language :-)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: mikee123 on September 06, 2013, 09:45:53 am
try :
what i said : shade out    google translation: awning out on

This is basically what i did, but i forgot the 'on', i thought i did not need it but i think i do. The device 'awning out' is extending the awning. But i probably need to tell it 'on', otherwise it'll recognise the device but does not know what to do with it. As the device is called awning out i thought the 'out' is like the on command, but this is not the case !
I guess when i try that later it will solve the problem !
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: AP on October 26, 2013, 08:32:09 pm
Hi, I get version error when I start the app, why?


Sent from my iPhone using Tapatalk - now Free (http://tapatalk.com/m?id=1)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on October 26, 2013, 09:24:34 pm
Upgrade the App ... you should be on Version 1.007
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: AP on October 27, 2013, 07:08:27 am

Upgrade the App ... you should be on Version 1.007

I am on that version, even reinstalled it. And I have tested it on two android pads with fresh downloads from google playstore


Sent from my iPhone using Tapatalk - now Free (http://tapatalk.com/m?id=1)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Chimpware on January 02, 2014, 05:15:08 pm
Works great as a proof on concept, very high rate of accuracy for me.  Be nice to have widget to just push on the screen for voice input.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: LightsOn on January 20, 2014, 09:20:13 am
Hi @RichardTSchaefer

Great work on this - thank you.

Out of interest have you considered enabling (if possible?) the integration of a USB microphone to the Vera unit some how and as such then allow for HAL to work directly from Vera?

I ask because I currently use a voice control system for Mcontrol by Shifra Smart Homes that works great - it's such fun and is effective after some suitable setting up.  I have of course now moved to Vera as a primary HA system however and use Mcontrol really only as a means for running some scenes easily with Media centre.  The integration of use and need with HAL is far better than that achievable currently however requires the phone app and a manual push of a button.

If you were able to run this in some way from the Vera unit itself with a microphone plugged in, perhaps a simple 'name' command could gain a "yes" response that then means HAL would listen for the command.  There for the "name" stated would cause Hall" to listen in the same way as pressing the button on the app.

Such a set up would allow for a really new development in voice activated automation in the home.  As I say I currently have this and it all works well - but I see a real effective future in HAL if this was an option?

HAL as it stands is awesome so I hope you don't mind my sharing of thoughts here  :)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on January 20, 2014, 12:18:15 pm
I need to dust off that code .. there are a number of changes I want for my personal use.
I am not sure how reliable the voice recognition would be through an external mike.
I need to do some testing. Using the phone, there is DSP processing to cancel ambient noise from the mike.


HAL 1 worked on a PC and my phone.  It sent the voice from the phone to the PC for recognition.
The phone mike worked much much better than a local mike on the PC.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: LightsOn on January 20, 2014, 01:14:47 pm
Hi Richard,

I use a The Voice Tracker II? Array Microphone:

http://www.acousticmagic.com/voice-tracker-ii-array-microphone-product-details.html

It is indeed pricy but has been worth it.  It can cancel out background noise in the same way you discuss.  of course other cheaper methods are available.

I could introduce you to Haddi @ Shifra Smart Homes as you may be able to share code?  I have worked with him (more he works and I tested and requested..) and got great results but I think his stuff has too stopped development all be it he is still communicative regarding the software - he was very helpful and keen to develop further.

Instead of having to press a button for the "listening" element to happen it is set up so the level of the microphone was low in terms of input.  Once the "trigger" was heard (e.g the equivalent of pressing the button) the mic level was automatically increased done via simple batch but many other easy ways to do this.  The outcome was the system is always listening and has great listening ability when required, but as mic levels are low most of the time mis fires are minimal.  I even implement as solution where by batch files could be run on initiation which meant I could pause TV if I called the tiger and it would resume after command was issued.  this also then worked if a mis fire happened the resume would also see the mic level reduced even further - again enabling smarter use and working of the system.  plus lots of many other simple little tweaks.

All the above is implemented through simple logic but no one has seemed to bundle it all together into one thing that does it all (e.g ability to run local commands and control vera and have the above mentioned flexibility) If you wanted to have a play with this idea some time I would been keen to help in any way I can.

I really love the vocal integration I get with my systems, the ability to call music, radio, tv, turn things on and off etc is just brilliant.  Sadly however I do not have the coding capabilities (other than basic ad onn as mentioned above) myself to add to a development project but being an active user currently of such a solution if you did want my rambling input I would be keen to be involved.

I shall have a play with he PC client a little late I think.

thanks Richard.   :)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on January 20, 2014, 01:17:58 pm
Hal 1 had an open mike ... Always listening.  I need to look at what I can do on android. I wonder if the NSA would share their code;)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: akharsyntiew on January 20, 2014, 01:43:17 pm
HAL does not recognize the "CT50 V1.94" "RTCOA_Wifi_ZoneThermostat". My Vera shows this device and temperature readings. Vera does not control this thermostat. Installed this device using "Radio Thermostat Wi-Fi Plugin". Any ideas why HAl would not recognize this device?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on January 20, 2014, 04:11:57 pm
Rename the device to something that Google can recognize ... like maybe:
    Thermostat
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: akharsyntiew on January 21, 2014, 03:52:19 pm
Hi Richard,
Thanks for getting back to my question. My Device name was "Thermostat". In the post I posted the "Device_file" value from the Plugin. I tried another android app "AutHomationHD" and it recognizes the thermostat.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on January 21, 2014, 03:56:47 pm
I misunderstood your request.
I did notice this is not a thermostat type of device.
I will look into it.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: The-Source on January 23, 2014, 12:10:33 am
Works great as a proof on concept, very high rate of accuracy for me.  Be nice to have widget to just push on the screen for voice input.
Wanted to ask the same but you did it already so I second it ;)
I just started to make a dutch dictionary and it's looking good :D

Also support for urn:schemas-upnp-org:device:Heater:1 would be great its actually a thermostat but the Horstmann HRT4 ZW is being added like this ;)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on January 26, 2014, 11:57:08 am
Works great as a proof on concept, very high rate of accuracy for me.  Be nice to have widget to just push on the screen for voice input.
Wanted to ask the same but you did it already so I second it ;)
I just started to make a dutch dictionary and it's looking good :D

Also support for urn:schemas-upnp-org:device:Heater:1 would be great its actually a thermostat but the Horstmann HRT4 ZW is being added like this ;)
das een goed plan :)
i have problems with running the app in android 4.3 somehow voice-recognition is not functioning ok. authomation same thing. anyone have a solution for that ? gonna try reinstall both see if that helps.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: mickesanda on February 02, 2014, 02:27:50 am
I just downloaded the app from Google Play and it says version expired.
I hope you continue working on this app Richard, after watching your video on Youtube i was sold, looks very promising
/Mike
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Pseudomizer on February 02, 2014, 03:37:41 am
I just downloaded the app from Google Play and it says version expired.
I hope you continue working on this app Richard, after watching your video on Youtube i was sold, looks very promising
/Mike

Strange. I just downloaded it and it works fine other than having issues with my accent ;-)
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Pseudomizer on February 02, 2014, 03:54:04 pm
Hello Rich and team,

I have a very strange problem and a generic question.

Background:
I have a couple of scenes which trigger my lights in my living room like "Lights Bright", "Lights Night", "Lights Movie", etc. Those are the names of the scenes and the work fine when I execute them individually and also when I execute them via AuthomationHD and my new Cooper wired Scene controller.

When I use HAL all 6 scenes get triggered (the 6th is "Lights OFF") but the second scene called "Lights Night" don't work as expected. They should turn on, change to blue and then go down to 40%.

Instead the go through this whole cycle but at the end they change to "Lights Bright" which is 100% no color like when I turn the light switch off and then on. I don't believe it is triggering the scene "Lights Bright" but instead going to the default light setting as outlined above but I have no proof and this is just an assumption at this point.

Issue:
Basically all 5 scenes get triggered, 4 of them correctly, the 6th scene for lights off works fine but just the one which is "Lights Night" goes through the cycle and then goes into default light mode or triggers the "Lights Bright" scene. One or the other is my guess.

This only happens with HAL. How can I trouble shoot that please?

Now my generic question:
It does not recognize my NEST Gen 2 Thermostat. Is there a way to implement that into HAL?

Thanks in advance for all the help guys.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on February 03, 2014, 01:33:37 am
The Fuzzy logic matched many of your lighting scenes.
You can lower the fuzzy logic by 1 number at a time and try.
Or you can try to make the names more different.

The reason the lighting scenes might not be working is that they are getting interference from multiple scenes running at once.
It's hard to schedule that many by hand ... manually.

I will add the nest thermostat .. I will have to do some research to see how that looks.

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Pseudomizer on February 03, 2014, 03:24:01 am
Let me give it a try. Thanks.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: rickboy62 on February 19, 2014, 01:40:06 am
Hi Richard,

I downloaded the app however I can't get it to work. On the Properties tab it says Vera User@cp.mios.com however I used the home.getvera.com website to configure my Vera 3 so I don't have a account at cp.mios.com. I have an account at home.getvera.com but I can't see how to change it on the properties tab. My vera 3 is connected through the WAN to my router however the Help tab hasn't detected my Vera. Can someone please assist as I would really like to get this app working. :(
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: garrettwp on February 19, 2014, 03:04:53 am
It sounds to me you are running UI6. If your firmware is 1.6.XXX, it will not work with your Vera remotely.

- Garrett
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: rickboy62 on February 19, 2014, 08:59:36 am
Hi Garret,

can I get it to work locally then on UI6 or am I better off going back to UI5?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on February 19, 2014, 09:31:19 am
It should work locally on UI6.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: rickboy62 on February 19, 2014, 09:22:46 pm
Hi RIchard,

I have installed/unistalled the app twice however it's not connecting to Vera. I don't know what I'm doing wrong. I'm not sure if my pc firewall is blocking access to the app and if I have to open a port which port number should I use.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on February 20, 2014, 06:58:58 am
For UI6  you have to use the WAN Direct Connect

Use your   XXX.XXX.XXX.XXX:3480

Where XXX.XXX.XXX.XXX is your local IP Address.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: rickboy62 on February 20, 2014, 08:44:57 am
I typed in my local IP and the port number you gave and now I get the Topic and Room buttons showing under the Help menu which I never got before. The properties page doesn't show my Vera ID. I think once I can get Hal to recognise my vera I should be able to make it work. Also when I press the Hal button to talk, I don't get the Google listening screen like you do in your YouTube video. The app doesn't respond.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on February 20, 2014, 12:32:40 pm
I will have to try it on my ui6 test system.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: prim8 on April 11, 2014, 06:24:06 pm
I'm guessing there's no movement on getting programs like these working on UI6 for those of us unfortunate enough to have upgraded to it before we found out it was a mistake?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 11, 2014, 08:21:48 pm
I will get back to this.
I have been waiting for MCV to answer a question for more than a month. I will see if I can get the answer from one of the developers who has managed to get UI6 access working.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: gwp1 on April 11, 2014, 08:35:31 pm
I just installed this on Android 4.2.2 and as soon as the app opens I get "version expired."

Any setting I try to complete or configure, the app crashes.

 :-[
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: timmyg on April 18, 2014, 12:25:21 am

I have had HAL for ages and it just started to report that same Version Expired error on my xoom, mobiles and nexus tablets.

Any ideas Richard? Let me know if you want me to test, delete etc.

Cheers
Tim

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: timmyg on April 20, 2014, 03:19:26 am
 Just installed the update from the Play Store and HAL is now working again. No more Version Expired message.

Thanks RTS

Tim
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Pseudomizer on April 20, 2014, 04:08:05 am
I confirm. Works again on my Tab 2.

Question:
If I want to wall mount my Tab 2 and just use my voice to control my Vera, how would I go about that?

There are a couple of apps out there who recognize voice but you have to push a button or I have to start Google Voice Search and have it running where I have to say "Ok Google".

What I would like is to come home and without any buttons I would like to wake up HAL and then control my Vera e.g. I come home and do things like:
"Buddy, turn on kitchen lights and power on TV"
or in the morning walking by my tablet on the way to the shower say "Buddy, turn on coffee machine".

I know KitKat is close to getting there but Tab 2 10.1 runs Android 4.1.2.

Problem 1) is to wake up the tablet via voice without having to press a button and Problem 2) HAL also requires to push a button to talk.

Any ideas?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 20, 2014, 12:55:22 pm
It's on my list .. I have to get the UI6 stuff working ... Then I have a bunch of queued up changes for HAL ... it's been on the back burner.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on May 05, 2014, 09:03:43 am
i had a few times crash on the app when using the voice button and it turned out i had only the IP of vera filled in. as soon as i changed this too vera-ip:3480 it works ok now with latest version.
also works on local lan on UI6 and UI7 beta using android 4.3 on my samsung S3 using Ivona HQ voices
for remote from WAN to work on UI6 it needs a MMS login with token and for UI7 beta it needs to have other auth servers to connect. they will change to UI6 auth servers when UI7 final comes out according to garrettwp.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 05, 2014, 09:08:59 am
I have an upgrade coming soon ... uses my new library for UI6 remote support ... better switching between local/remote. A few more supported devices, multiple Veras, ...
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on May 05, 2014, 11:05:13 am
oh that is great news :-)
u make this in java ? i could use the code for that to implement in my windows vera remote.. saves me a lot of waiting for mcv to answer mail and figuring out.
i can translate that to .net like ur former java connector thingy. if u want to give this in private its ok too. u know if MMS uses OAuth ?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 05, 2014, 11:07:04 am
I will post my notes today ... I asked permission to do so over a week ago.
If they had a problem they had plenty of time to answer.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on May 05, 2014, 11:09:38 am
great ! looking forward to it.. it is most usefull and we all love u , u know that right ? :D
asking anything from mcv takes ages sometimes ... really annoying.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: garrettwp on May 05, 2014, 11:34:24 am
I will post my notes today ... I asked permission to do so over a week ago.
If they had a problem they had plenty of time to answer.

I made sure I took a lot of notes several months ago when working with the MMS authentication. The documentation at the time when mcv provided it to me was incomplete and helped them with several bugs / issues along the way. Hopefully with our knowledge we can help others smoothly transition and not go through the pains that we had to go through.

- Garrett

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Da_JoJo on May 05, 2014, 11:48:30 am
i admire u guys patience .. really am.. without the both of you our domotica-life would be so much different than it is today. re-inventing the wheel never helped anyone imho
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: JimMac on May 07, 2014, 02:03:54 pm
Hi Richard

Love the concept of the app but unfortunately I can't get it to run it on my Nexus 5 phone.  I can get to the configuration tab but once I select my username the app crashes.  I can clear the app data and try again but it crashes at the same location every time.  Have you experienced any issues with the Nexus 5 or has any one else who has one? I have uninstalled/reinstalled but this didn't fix the problem.  I have sent a couple of crash reports through Google.  I think the app is having a hard time writing data to my phone.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on June 13, 2014, 06:32:30 pm
A major upgrade to HAL has been done.

The new version has the following features:
1) UI5 and UI6 support
    Better local/remote handling
2) Support for multiple Vera. To use multiple Veras you will need to name each Vera.
    To switch to another Vera just say:
     USE  YourVeraName
3) Add support for MultiSwitch devices
    On HAL, each  Switch looks like an individual switch, with the Name of the device being the Button name.
4) Add support for Alarm Partitions.
    You have the ability to save your PIN code ... It's encrypted on Vera if you do!
5) Add the ability to Ignore certain devices using the
    Active Status command.  I have some Power switches that are on ALL the time. I do not want to hear about them!

You will have to specify your UI5/UI6 credentials to get started (I did not try to restore from the previous version).
Then List Vera IDs to validate your credentials. If you have more than one Vera ... then you will also need to name your Veras.

The Help file has been improved. You have a different help page per Vera, with that Vera's devices and rooms.

I have some more changes coming ... but this was a working step ... so I thought I would release it.



 
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: lemrock on June 29, 2014, 03:16:37 am
Are there versions of the Android operating system that HAL does not work with or am I safe to buy any Android device?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on June 29, 2014, 03:42:00 pm
At present HAL is not licensed ... that may change in the future ... I put hooks in place to license .. but have not activated them yet.
Hal will not work with OLDER Android phones.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Cosworth32 on July 02, 2014, 03:20:50 pm
HAL doesn't like my Samsung Note II at all. Vera is detected direct and via UI5 but after that the following issues exist:

- Upon installation it keeps playing the "please configure my options..." until app is force closed and restarted.
- After that restart it starts background monitor but nothing else happens
- After another close/open cycle it shows the push to talk option
- It then consistently force closes after anything spoken and never are rooms or similar shown on the help pages.

Debug log submitted via google.

Edit: exact Same results on ASUS transformer tablet.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: Adam Ingham on July 14, 2014, 02:07:15 pm
The above crash is also happening on my Samsung Note 3 and Samsung Note Pro 12.2  :-[

What I have noticed is that there isn't a HAL folder on the ExtSDCard, could this be the problem Richard? Since updating to Android 4.4.
3, I have found that no third party App can write to the ExtSDCard. There is a HAL folder on the internal RAM card!
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: qwen3579 on August 20, 2014, 08:35:17 am
I can't seem to get the latest version to work.

I go into the credential settings and enter my connection information for UI5. I then List Vera IDs, and my Vera is reported as found, but all I have is an option to Cancel. So I press the cancel button. My Vera ID shows under the Vera Names setting and I have given it a name, but HAL doesn't do anything. It seems like I'm missing something?
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: joer. on August 23, 2014, 09:33:11 pm
I can't seem to get the latest version to work.

I go into the credential settings and enter my connection information for UI5. I then List Vera IDs, and my Vera is reported as found, but all I have is an option to Cancel. So I press the cancel button. My Vera ID shows under the Vera Names setting and I have given it a name, but HAL doesn't do anything. It seems like I'm missing something?

I have the same problem.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: integlikewhoa on August 31, 2014, 06:54:53 pm
Doesn't run right on my note 3 either. 95% of the time I can't get the action screen to even show up to speak to it. Once in a great while when it does I speak and it crashes.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on September 01, 2014, 12:12:03 pm
If the help file does not show all of your current rooms and devices ... then there is a problem communicating with Vera.
In that case ... there is nothing for it to do ... since it has no idea what devices you have.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: integlikewhoa on September 02, 2014, 12:41:15 am
If the help file does not show all of your current rooms and devices ... then there is a problem communicating with Vera.
In that case ... there is nothing for it to do ... since it has no idea what devices you have.

That is correct. I only get a Dictionary and Help option 90% of the time. And the HELP is empty.

I got to credentials and added my User and password more then once with UI5 selected.
I click ok and I can click on List vera ID's it shows both my veras turns green says done.

I have VERA names set for each an each shows.

I have sent you Debug email. Seems like problem with storage directory.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: tregaron on April 02, 2015, 03:42:02 pm
Same happens to me using a Google Nexus 7...
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on April 28, 2015, 10:13:41 am
I have just released a Fix to the Google App (Play) Store.
There was a bug when there were NO defined scenes.
I was able to duplicate when I added my Test system ... which has NO scenes.
 

Also fixed a bug if you have more than one Vera defined.
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 07, 2015, 10:41:38 pm
Hal has been upgraded to support continuous recognition.
In the examples below ... the hilighted words are key to recognition ... the other words are ignored.
In the examples below ... the italicized words are names unique to my configuration. i.e. Vera, Room, Scene, or Device names.

So it now supports:
Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 12, 2015, 10:40:37 pm
I have upgraded the Open Mike to be a service ... so you do not need to have the APP displayed all the time to do continuous speech recognition.
NOTE: In this case you will need to set the Background Time Setting ... so it doesn't stop running for the specified (possibly forever time!)
 
I also change the name from HAL to H@l

I received a cease and desist letter from Home Automation Living ... they make a HomeSeer  like product and have trademarked HAL.

Title: Re: 2nd Genaration HAL - Android Only Voice Recognition for Vera
Post by: integlikewhoa on May 12, 2015, 10:58:42 pm
I also change the name from HAL to H@l

I received a cease and desist letter from Home Automation Living ... they make a HomeSeer  like product and have trademarked HAL.

Thanks, will be sure to spam them as I please.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 12, 2015, 11:01:46 pm
I will likely make the Open Mike a licensed feature.

I plan to add the option for a Wakeup Phrase to the Open Mike (Something like "OK HAL" or "OK Vera").
I have a separate phone in the same room running Vera Alerts ... and it's weird to have HAL respond with "I did not understand that" when Vera Alerts sends a message.
If specified ... you will need to use this Wakeup phrase to get Hal to Start Listening then it will listen for any command for a few minutes before waiting for another Wakeup Phrase.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: Homer on May 15, 2015, 06:05:34 am
I'm going to check this out!

A suggestion tho would be to allow the user to set what the wakeup phrase is. Would this be possible?
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 15, 2015, 07:49:15 am
At present it's always listening ...

When I add the wakeup phrase (as an option) it will be user definable.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: flaquito on May 30, 2015, 05:33:58 pm
Richard,

Thanks for a really great app! I've been looking for something like this for a while, and had resorted to writing my own tasks using tasker, autovoice, and autovera (time consuming to write, and slow to respond to commands).

I do have a couple strange things happening:

On my phone, I changed the notification style to "bell." When I asked it for my thermostat status, it started playing music while it talked. And never stopped. It was probably the most epically dramatic thermostat update ever, but not very useful behavior. I finally had to kill the app to stop the music.

On my tablet, I experimented with continuous listen mode. I left voice notification on, and now it constantly randomly says "I did not understand that." I would like for it to talk to me when it parses a command that it understands, but I really don't want to hear about it whenever it hears something that isn't a command.

It also might be nice to have a widget that would automatically start H@L listening for a set amount of time.

-Brent
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 30, 2015, 08:43:59 pm
OK ... There are a few more things I wanted to do to it this week anyway ...

I will look into the Bell ... what type of notification did you have in the "Properties -> Alert" setting ?
Was it a short notification or a repeating notification ?


Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: flaquito on May 30, 2015, 09:57:06 pm
OK ... There are a few more things I wanted to do to it this week anyway ...

I will look into the Bell ... what type of notification did you have in the "Properties -> Alert" setting ?
Was it a short notification or a repeating notification ?

I didn't even know that setting existed! Turns out it was set to "Silent." I changed it to something else, and it uses the proper alert. When I change it back to silent, I get dramatic music again. No idea why.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on May 31, 2015, 09:41:30 am
I will look into it ...

I am planning to add the option to activate HAL with a user defined phrase like:

OK Vera  or   OK HAL

It will stay active for a user specified amount of time after the last request.
After that you can say OK HAL again to get its attention.

So it will quit trying to interpret things when you are not actively talking to it.

I think I will also add a user specified phase to stop it from listening ... until requested again ...
Something like OK Vera stop listening After that you will have to get its attention again with OK Vera.

So you will have 3 operating modes:
1) Open Mike Off .... 
    OK Vera will listen for one request
2) Open Mike On ... no time out
    Hal will be listening ... can stop it with OK Vera Stop Listening and restart it with OK Vera
3) Open Mike with a timeout
    You will need to say OK Vera to get it's attention.  It will continuously listen for the specified time after the last command.
     Then will require you to get's its attention again.




Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: bucko on June 01, 2015, 02:39:33 am
Hi Richard,

I wanted to give Hal a go but I cannot find it on Google Play Store. I searcherd, Vera, H@L, Hal. Your app does not show up???

Any ideas?

Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: bucko on June 01, 2015, 03:08:29 am
Hi Richard,

I wanted to give Hal a go but I cannot find it on Google Play Store. I searcherd, Vera, H@L, Hal. Your app does not show up???

Any ideas?

I found it. Needed to search "HAL and VERA"


Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: tyfoon on June 14, 2015, 05:04:28 am
I'm running this on a Nexus 7 (1e gen) and after adding some phrases to the dictionary it keeps on crashing (directly after startup). I also changed idle timeout (leaving it empty) so maybe that's what makes it crash. (I have send the bug report).

Some other Q's

As I'm Dutch, my device names have Dutch names. If I leave Androids voice recognition in English it does not understand the devices (which makes sense) when I switch Android to Dutch all the other logic is not understood and I need to build a complete new dictionary basically for every variation that is possible as it will not understand all the wildcards and parameters (for example three dictionary items for light on, light off, light status). Is that correct?

When I'm in always on listening mode it picks up only the first command and will execute it. It will then switch to the status page where it stays. Any other command is not being picked up. Any ideas?
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on June 14, 2015, 08:17:49 am
Please send logs for problems ... I will check.

The dictionary was meant for words ...  Not phrases ...
Please send me your dictionary file.    I will see what I can do.

You may want to try changing the grammar rules for Dutch. Find the H@l directory on your nexus. You will find your dictionary their. There is also a Reference directory.

Take a look at the Semantics.config file.
If you place a modified version of this file in the parent directory ... It will use it. You can replace some of the command name with dutch names. Let me know if you need some help understanding the file.
You can replace lines or just add new lines.
I would suggest modifying one line at a time to start with.

H@l need to restart to see the new file. Keep the background time real short like 1 minute. Then it will quit quickly after closing the app.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: tyfoon on June 14, 2015, 09:32:16 am
Thanks for the fast response! What about the last point (only can issue one command)?
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on June 14, 2015, 10:44:04 am
Send the log
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: tyfoon on June 14, 2015, 01:39:04 pm
Richard, not sure how you want the Android log. It's not something I regularly do. Do you have a preferred way?

I have attached the dictionary (renamed to txt)

On the localisation; It seems that are several ways to approach this;

- If I set the voice reco in Android to Dutch I will need to create a dictionary 'translating' my dutch into english commands. Then H@L will execute the command and the response is a dutch voice trying to speak english[/li][/list]
- Alternatively I leave all in english (in android) and see how english voice picks up my dutch words and use these in the dictionary
- Lastly I could change my device names and rooms to english names (looking like the simplest solution) assuming these changes don't create issues in other scenes/plegs/imperihome

Anny suggestions or am I missing an alternative?
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on June 14, 2015, 06:42:29 pm
From the debug settings there is an option to mail the log file.

The log file is in the H@l directory the same as the dictionary. So you can easily mail it to me directly as well as delete it when you want to start with a new log.

There is another option I described above. H@l was designed to be multi-lingual.
Editing the files as I described above will allow you to define the semantic rules in your native language.

To process the semantics I need to identify each word. When you put a phrase in the dictionary it treats the entire phrase as a single word ... I need to split the words when I extract from the dictionary.

This is a little complicated because the dictionary substitution and the fuzzy logic is in recursive/backtracking algorithm. There are some design issues to allow the number of words to change during the semantic matching logic.

But if I did this you could have your own word macros ...where a single word could be a dictionary defined command ... Kind of what you where trying to do.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: tyfoon on June 15, 2015, 05:10:30 pm
Hi, pls find attached debug log. Issue: with open mike I can issue one command only or if I'm lucky two or three. It stays in the results page but just stops listening.

Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: vosmont on July 03, 2015, 05:26:36 am
Hello RichardTSchaefer,

I already have a remote system with voice recognition installed (S.A.R.A.H : http://blog.encausse.net/s-a-r-a-h/ (http://blog.encausse.net/s-a-r-a-h/)), but I wanted to test another approach, which seems to work without too much configuration concerning the devices of the Vera.

The app installation is OK (from the Google Play Store) and the voice recognition engine is working well in French.
But as H@L seems to be not localized, I can't really use it.

I'm on a Nexus 7 and I tried to find the dictionary files, but without success.

Besides, I've got some questions :
- Is it possible to restrain the devices usable by the tablet ? (for example, just the devices in the kitchen for the tablet in the kitchen)
- Is it possible to do an action on several devices at the same time ? (for example, switch on all the lights of the lounge)
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on July 03, 2015, 09:23:09 am
Quote
But as H@L seems to be not localized, I can't really use it.
It is setup to be localized ... a few hard coded strings remain. But I have not actually localized the config files.
If you are interested in doing the localization I can talk you through the how to make the changes.

Find the files (on your Android) in the directory:
               H@l/Reference

You might try to customize the "SwitchCmd" in the file Semantics.config to see how well it will work.
Any modified file needs to be placed in the  H@l directory.

To Localize the Help file you would need to change:
               H@l/OrigHelp.html


Quote
- Is it possible to restrain the devices usable by the tablet ? (for example, just the devices in the kitchen for the tablet in the kitchen)
I do not support this at this time. It does support the constraint:
             Turn on SomeLight in the kitchen

Quote
- Is it possible to do an action on several devices at the same time ? (for example, switch on all the lights of the lounge)
Yes,
            Turn on all Lights in the lounge
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: vosmont on July 09, 2015, 03:41:26 am
Thanks RichardTSchaefer,

The directory "H@L" was not available under Windows 7 via USB connection (Nexus 7).
With an Android app, I've found it.

I've begun to modify the Reference file, but without success for the moment.
I will report here when I will have more informations.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on July 09, 2015, 09:56:00 am
When you modify the file ... you need to move the modified file to it's parent directory.

Then restart the app ... Quickest way (since it has background processes that can stick around awhile) is to use the Android App manager and do a force stop.

You will start with the Semantics.config file.

I would try something simple like the SwitchCmd
For french you might change:
Code: [Select]
SwitchCmd:<1;on:1|off:0> <0;Switch*|Dimmer*|PLTS*|VirtualSwitch*|MultiSwitch*>
to:
Code: [Select]
SwitchCmd:<1;allumer:1|?teindre:0> <0;Switch*|Dimmer*|PLTS*|VirtualSwitch*|MultiSwitch*>

If people customize the files ... they can send them back to me ... and I will integrate in future releases.

Then you would be able to say:
Code: [Select]
S'il vous pla?t allumez la lumi?re de bureau
allumer would match allumez via fuzzy logic ... the switch name would be   lumi?re de bureau

Sorry about the spelling ... the forum does not like me entering various accented characters.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: vosmont on July 09, 2015, 11:42:04 am
Thanks, I will try this evening (in France  ;D)
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: vosmont on July 09, 2015, 03:05:56 pm
It works. I will send you the files for "fr_FR".
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on July 09, 2015, 03:49:04 pm
You can also customize the other files with the .config extension
Content.config controls the help file generation. You should include your changes for Semantics.config here ... so the help file will be localized correctly as well ... Also the OrigHelp.html would need to be localized ... this is the generic instructions.
Active.,config controls what is considered active.
Status.config  controls what the status message for a device is, and how it is spoken.
Name.config  controls the names of the DEVICE classes.  This is used in wild cards were you  want to issue a command to ALL devices in a class. It is also used in the help file generation.

There are a few things that I am sure I forgot to localize ... let me know what you find.
Of course we can also localize all of the App menu entries ..,. I can send you a file for that as well ... it's not in the reference area.

When an update is made ... it will NOT change your modified files ... so they will survive an update or uninstall/install cycle.
You must manually delete them to get back to stock!

I would appreciate any comments on the overall customization process ... You are the first ...  Bucko ran into some problems,
A question I have is should I add an option to HAL to specify the translation language or default to the phones setting (As done currently) ?
When people use Google recognition in other languages ... do they often speak in different languages for different apps  ?
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: alexlui on July 16, 2016, 11:48:22 am
Richard,


How do I say to Open ( Close ) the curtain, I tried it and it recognised my words but vera just not doing anything?  Right now, I need to setup another scene and run the scene in order to open ( close ) the curtain. But this is not very convenient if I need to open 30% , close 80% of the curtain.
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: paros on November 13, 2016, 02:45:06 pm
Richard - Any plans to integrate with Google Home?
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: RichardTSchaefer on November 13, 2016, 05:27:16 pm
Yep, I have a Google Home, but parts of the API are not available until December.
 
Title: Re: 2nd Genaration H@L - Android Only Voice Recognition for Vera
Post by: stardobas on December 31, 2017, 11:26:28 am
What is the command for the curtain? H@L find the curtain but up/down/open/close don't do nothing.... in http if I use http://192.168.1.205:3480/data_request?id=action&DeviceNum=22&serviceId=urn:upnp-org:serviceId:WindowCovering1&action=Down
the curtain regulary close... please help...