The Vera Community forums have moved!

General => Remote Control => H@L - Voice and Gesture Control (Android) => Topic started by: RichardTSchaefer on February 06, 2012, 12:29:59 am

Title: OLD Generation 1 - HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 06, 2012, 12:29:59 am
Well at least half of the world can! Those that use PCs and Androids.

I have released a PC Application call HAL Server (actually a service) that receives "wav" files of spoken text and convert that into commands to control your Vera. This is two way ... since you can ask for status.
There are two clients that can interface to the Hal Server
This has only been tested on a Vera2 I do not have a Vera3 yet.
It supports Scenes, Binary and Dimmable Switches, Locks, Thermostats, and the status of various sensors.

Luv for you to try it and provide feedback.

Here is the current status:
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 06, 2012, 03:19:05 am
Oops ... I should have tried the installer on a non developer machine. Found and fixed two bugs ... should be good to go now.
The problems were:
If you see either of these problems just download the installer and start again.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: garrettwp on February 06, 2012, 03:34:29 am
Glad you provided this to the community. When I get time, I'll have to give it a go.

Keep up the good work,

- Garrett
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: jwiz on February 06, 2012, 11:14:15 am
Just wondering if this will run ok on windows homeserver v.1.

Thanks
John
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 06, 2012, 01:10:51 pm
I do not know for sure ...  I doubt they configured the Speech Engine into this platform.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: gilles on February 06, 2012, 03:09:44 pm
Hi,

Could you develop on linux ?



Envoyé depuis mon GT-I9000
Title: Re: Re: HAL lelujah --- You can now talk to your vera
Post by: jwiz on February 06, 2012, 03:21:40 pm
Just wondering if this will run ok on windows homeserver v.1.

Thanks
John

Thanks for the reply. I'm gonna try it out on my win 7 desktop to check it out and maybe later i will see if I can get it to run on the homeserver.

Thanks
John
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 06, 2012, 04:57:56 pm
I use the Microsoft Speech Engine ... I evaluated other engines based on Java.
But this was the most reliable. So the HalServer is stuck on a PC platform for now.
The syntax description was very similar to all. Details of interfacing to the semantic content is different ... but this ended up being a small part of the project time. So if another speech engine is available it should not be a big deal to port.

I guess if there was demand I could do an  IOS and WM7 client.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 10, 2012, 08:58:17 pm
Any one talking to their Vera yet ?
I can see there have been downloads ... both PC and Android.
I am looking for feedback before making another investment in time.
 
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: garrettwp on February 10, 2012, 09:00:59 pm
I have not tried yet. I'll get it up and running this weekend and let you know how it works out. Been busy reworking my android app for Vera.

- Garrett
Title: Re: Re: HAL lelujah --- You can now talk to your vera
Post by: jwiz on February 10, 2012, 09:20:03 pm
Any one talking to their Vera yet ?
I can see there have been downloads ... both PC and Android.
I am looking for feedback before making another investment in time.

I did install it on my pc and android. I was getting a comnection error in results on the android client. I tried disabling my firwall and it did not make a difference. I'm gonna try to play with it more this weekend when i have more time.

John
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 11, 2012, 01:28:41 pm
Change the Port on HalServer (PC)  and HAL Remote (Android) from 5050 to 505.
Ports below 1024 are not typically blocked on Windows by the various firewall products.

I will change the defaults in the code and make a release asap.  505 is not reserved by anyone.

 
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Ap15e on February 12, 2012, 11:00:36 am
The Hal Client (PC) doesn't run on my Windows XP Professional SP3: "Try Running as administrator.".
Title: Re: Re: HAL lelujah --- You can now talk to your vera
Post by: jwiz on February 12, 2012, 11:47:12 pm
Change the Port on HalServer (PC)  and HAL Remote (Android) from 5050 to 505.
Ports below 1024 are not typically blocked on Windows by the various firewall products.

I will change the defaults in the code and make a release asap.  505 is not reserved by anyone.

Played around alittle bit more this weekend and still did not have any success. Changed port to 505 and now I keep getting communications error reading in the last results status screen.

Thanks
John
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 14, 2012, 07:37:40 am
Ap15e -- Yep after a day of building an XP machine I have found 2 serious startup bugs on XP. One is fixed ... Hope to get the other later today. So XP is DOA for now.

jwiz -- Are you able to get the PC HAL Client to talk to the HAL Server ? If that does not talk, then the the Android client will not either.

The first time I try to connect from Android after installing on the PC it fails to connect ... but there is a message from my firewall on the PC asking if it is safe to allow the connection. When I say yes forever ... remote connections work from then on.

I have major update ready after successful testing with XP ... More on that later.
One important feature is the Auto discovery for Vera and the Hal Clients ... no more needing to know about IP address (unless you want to poke a hole in your router's firewall).
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: garrettwp on February 14, 2012, 10:41:28 am
Richard,

I should have some time today to test your app. I was going to over the weekend but became busy. I'll let you know how I make out.

- Garrett

Update:

It appears that access to your site is offline.  :(
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: jwiz on February 14, 2012, 08:44:46 pm
I am getting connection error on both the PC and Android Client. Here is what my windows error log show.

Error HRESULT E_FAIL has been returned from a call to a COM component. at System.Speech.Recognition.RecognizerBase.Initialize(SapiRecognizer recognizer, Boolean inproc) at System.Speech.Recognition.SpeechRecognitionEngine.get_RecoBase() at System.Speech.Recognition.SpeechRecognitionEngine.LoadGrammar(Grammar grammar) at HalService.Recognizer..ctor(HalService hs, String FileName) at HalService.HalServer.HalConnection.AudioRequest() at HalService.HalServer.HalConnection.HandleConnection()

Thanks
John
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 14, 2012, 09:13:30 pm
jwiz - There is a file in the Installation area:
c:/Program Files/RTS Services/HalServer/Grammar.gxml
This is the grammar that is specific to your configuration. If you could send it to me I will see If I injected a syntax error. Could be something based on the names in your configuration. You might look over the Help File in that area as well and see if the names match your configuration. Something missing might be a key. Actually even if the voice does not work ... can you check connectivity by clicking the help in both places. This downloads a customized help file.

garrettwp - I moved out to the country side ... much slower links and low reliability. I am on first name basis with my ISP ... its back now ... but wait one  day before downloading anything ... New version out tomorrow.

AP15E ... now I am at the  point where I realized the Speech engine is not installed.
I guess it came with a few apps (like office). Microsoft has instructions for how to build an installer for this ... I am making one ... want to verify the full install on XP before the next release.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: jwiz on February 14, 2012, 09:42:32 pm
jwiz - There is a file in the Installation area:
c:/Program Files/RTS Services/HalServer/Grammar.gxml
This is the grammar that is specific to your configuration. If you could send it to me I will see If I injected a syntax error. Could be something based on the names in your configuration. You might look over the Help File in that area as well and see if the names match your configuration. Something missing might be a key. Actually even if the voice does not work ... can you check connectivity by clicking the help in both places. This downloads a customized help file.

garrettwp - I moved out to the country side ... much slower links and low reliability. I am on first name basis with my ISP ... its back now ... but wait one  day before downloading anything ... New version out tomorrow.

AP15E ... now I am at the  point where I realized the Speech engine is not installed.
I guess it came with a few apps (like office). Microsoft has instructions for how to build an installer for this ... I am making one ... want to verify the full install on XP before the next release.

There is a .grxml file not a .gxml
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 14, 2012, 10:28:14 pm
Yep that's it.  send to schaefer@rts-services.com
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 15, 2012, 05:48:43 pm
AP15E - Well I followed Microsoft's instructions and created an installer for Speech on XP.
  I installed it. When I ran my app it indicated that it did not support a feature I was using.
  I will see if I can upgrade to a newer speech engine.

ALL Here is the current status:
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Ap15e on February 15, 2012, 06:21:28 pm
Please add the current status to your first post in the thread. Thanks!
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 15, 2012, 08:38:11 pm
Microsoft actually responded to my question about their Speech Engine. They support a non XML style description of the grammar that will work with both the old engine (XP) and the new engines (Vista, 7) and that will meet my needs. I will see how hard it will be to convert to the other format. So XP is not dead. They indicated that I should be OK on Vista based on what I told them I was using.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: michaelhinchey on February 16, 2012, 03:01:58 am
OK so  decided to Run this at the wee hours in the morning so I may be missing something here because im tired! 
   I ran the HalServerSetup.  It stops midway and settings come up with port info and find vera etc.  It found the lan config but could not find server.  When I shut this down the server continues to install but then seems to quit midway!  I see it installed the folder but I cannot run this!  When I run service from the folder, it states "cannot start service from command line or a debugger. A window service must first be installed and then started with the serverExplorer, windows Services Admin.  etc etc....." 
    PLease advise?  I am running windows 7 ultimate with a vera 2 machine!
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 16, 2012, 07:11:22 pm
The easiest way to do this is run the Hal Client program which should be in your start menu.
In the Admin menu just click start Hal Server.

The reason the find Hal Server did not find anything is because it was not running yet.
It will not find the Hal Server if you have not started the Hal Server (under the Admin Menu).

The reason it's a service is so that it can be running even if you are not logged in.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: garrettwp on February 17, 2012, 06:13:15 am
Was finally able to test it out. It would not work unless you manually open the port through the software firewall on windows. It does work and takes some getting used to. Had some times where it would not recognize my request. All in all, great job so far!

- Garrett
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 17, 2012, 09:01:55 am
The Android client works best ... because you talk into the phone ... better Signal to noise ratio (SNR). For the PC client you need to setup the microphone properly. If you use Skype you are probably OK. Otherwise check to see how your sound is recorded with  "Sound Recorder", it's usually under the Accessories Start Menu.
The Hal PC client also uses an OPEN mike ... I wrote the algorythm  for detecting speech. I need to work on this for different background noise levels. I plan to add a "Push to Talk" option to work better in a noisy environment.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: garrettwp on February 17, 2012, 09:07:17 am
I was using the android client. But had to make sure that the port on the windows machine was open in the windows firewall to allow communication.

- Garrett
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 17, 2012, 09:13:25 am
Thanks, I will add some notes to the installation page.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 17, 2012, 08:07:23 pm
The installation notes on the website have been expanded to address issues people have encountered.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: HouseBot on February 19, 2012, 02:59:08 pm
Any one talking to their Vera yet ?
I can see there have been downloads ... both PC and Android.
I am looking for feedback before making another investment in time.
Requires MS Dot net 4.0. So I pass (right now at least).
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 22, 2012, 11:56:05 pm
If you think it would make a difference I could move back to 3.5
I will only have to modify a few lines of code.
I decided to use 4.0 since a major oil field service company I contract for is now deploying products (large and numerous) based on it to their very conservative (from an IT perspective) clients (Oil companies). That was adequate vetting for me.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 23, 2012, 09:45:01 pm
I upgraded my HD2 phone to Android 4.0 (Ice Cream Sandwich) and found a serious bug.
They do not allow network connections on the main thread ... So every connection to HalServer fails. Sorry about that it look like it only impacts a few people ... I will get it fixed this weekend.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: garrettwp on February 24, 2012, 06:52:25 am
It was working fine on my HTC evo running ice cream. You should run connections in an async task or a service.

- Garrett
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on February 24, 2012, 03:26:11 pm
I am running Android 4.0.3 on my old HD2 (Custom rom, bleading edge).
This must be a new change.

I had short (3 -5 second timeouts) on my connections so I left them in the main thread.
I have released an update and my connections (HalServer and Locate HalServer) are all in the background.

I have a scene that turns all lights in my house ... About 50 ... Then I asked the active status ... It took to long to say all the names ... So I also made it so that when you cancel the status dialog ... it stops the Text to Speech. Need to fix that on the PC side next.

It's released and available on the market.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Canadian EC on March 08, 2012, 12:46:00 am
"This app is not compatible with your device"

I'm running Android 2.2 on an HTC legend
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 08, 2012, 07:38:24 pm
I needed some newer features for Audio Quality. But then I changed my strategy to just send un-compressed PCM audio ... (The Android'a audio codec's are lacking) ... I will see if I can move it back.
 
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 08, 2012, 07:59:22 pm
pretty cool but it needs a pc running 24/7 right ?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 08, 2012, 08:05:56 pm
Yep ...
I guess I am not that green ... I have quite a few computers running as servers at my house for different things.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 08, 2012, 08:25:48 pm
green... yeah i smoke that a lot  ;D
average use according to eversprings : 2.3kw/h   i abuse the electricity box a lot hehe
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Canadian EC on March 09, 2012, 12:35:21 am
Richard,

What version of the Android OS is needed to get this working on my HTC?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 09, 2012, 07:56:36 am
Richard,

What version of the Android OS is needed to get this working on my HTC?

android 2.1 i think since it uses voice stuff from android
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 09, 2012, 11:24:41 am
Currently I have Hal setup to  require 2.3 ... I should be able to move it back to 2.2
I moved up my HD2 to 4.0.3. It does not have a SIM card ... I only connect to the internet using Wifi ... I use this as my remote control ... it's always sitting in the the living area ... plus I can use my current Cell phone if its close by.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 09, 2012, 11:35:53 am
think most of us are on android 2.3 so why bother as you can spend perfecting the allready working version. the htc does have 2.3 if it dont u need to update it lol 
the below 2.3 you get in all sorts off trouble with the speech engines.. wouldnt go there. we live in 2012 now :-)
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Canadian EC on March 13, 2012, 02:54:56 am
think most of us are on android 2.3 so why bother as you can spend perfecting the allready working version. the htc does have 2.3 if it dont u need to update it lol 
the below 2.3 you get in all sorts off trouble with the speech engines.. wouldnt go there. we live in 2012 now :-)

IIRC you need to root the phone to get the update.  Updating beyond 2.2 doesn't seem available on this phone as is.  I understand jailbreaking for iPhones is fairly worry-free, but is that the case with an Legend running Android?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 13, 2012, 10:12:29 am
yes
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: juamonco on March 15, 2012, 04:27:32 am
Hi first of all, congrats for your work.

Do you think you can port it into Spanish?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 15, 2012, 09:50:14 am
I depend on the Microsoft speech engine ... They currently only support three languages:  English, Japanese, and some simplified Chinese.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 15, 2012, 10:01:13 am
well these can be enhanced with this language stuff from 3th party
u using version 4 or 5 ?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 15, 2012, 10:44:46 am
The speech engine comes with the Windows OS ... I need 5.3 or better ... i.e. Windows Vista has version 5.3  and Windows Seven has 5.4 ... If I move away from the XML syntax definition I can go back to 5.1  which would allow me to go back to Windows XP ... at this time I do not see a motivation to do this.

If you have links to 3rd party language extensions I would like to review them.
To actually make the port I would need some help with the grammar rules for a particular target language.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 15, 2012, 10:59:47 am
http://www.bytecool.com/voices.htm (http://www.bytecool.com/voices.htm)
http://en.wikipedia.org/wiki/Microsoft_Speech_API (http://en.wikipedia.org/wiki/Microsoft_Speech_API)

spanish is do-able i think .. no special grammar just some strange tokens which us-international also has.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 20, 2012, 11:28:24 pm
I stand corrected:  Windows supports the following:
I have only implemented the US English.
It's only a matter of editing an XML file in the installation area to try one of the others. If some one is interested ... and knows what BNF stands for in a computing language ... I can talk then through how to edit and test this in another language ... but sad to say ... after studing french and spanish ... I am not very good at speaking or knowing the grammatical structure of these languages.

I could do the editing if someone would provide me the information in the format I use in the help file.
Title: HAL lelujah --- You can now talk to your vera
Post by: teonebello on March 21, 2012, 04:41:27 am
Nothing similar on Mac OS? Thanks


---
I am here: ?wu05dq
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Da_JoJo on March 21, 2012, 08:31:55 am
sorry spanish and french is not my main language :(
i could fix it in dutch and german but dutch is not available.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: cyanet on April 02, 2012, 03:21:20 pm
I use VERA Lite and Just installed on widows 7 and get the following errors.

1.) During Install the installer stays active until you close HAL Client which automatically opens while Installing HAL
2.) I am able to start HAL server
3.) I am able to finds both VERA Lite and Itself HAl server IP Address
3.) As soon as I click on the eye on the application it crashes.

Event Log
****************************************

Unable to cast object of type 'System.Int32' to type 'System.String'.
   at System.Json.JsonValue.op_Implicit(JsonValue value)
   at HalService.GrammarObjects.RoomGrammar..ctor(JsonObject Data)
   at HalService.GrammarObjects.RoomGrammar.Add(GrammarGenerator gen, JsonObject Data)
   at HalService.GrammarGenerator.Initialize(JsonObject Data)
   at HalService.GrammarGenerator..ctor(HalService hs)
   at HalService.HalService.Run()
******************************************
Application: HalClient.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.ApplicationException
Stack:
   at Microsoft.DirectX.DirectSound.CaptureBuffer..ctor(Microsoft.DirectX.DirectSound.CaptureBufferDescription, Microsoft.DirectX.DirectSound.Capture)
   at HalClient.AudioCapture.Run()
   at System.Threading.ThreadHelper.ThreadStart_Context(System.Object)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
   at System.Threading.ThreadHelper.ThreadStart()

*******************************************
Faulting application name: HalClient.exe, version: 1.0.2.1, time stamp: 0x4f50439b
Faulting module name: KERNELBASE.dll, version: 6.1.7601.17651, time stamp: 0x4e2111c0
Exception code: 0xe0434352
Fault offset: 0x0000d36f
Faulting process id: 0x1fa4
Faulting application start time: 0x01cd0d5e3b942fc1
Faulting application path: C:\Program Files\RTS Services Inc\HalServer\HalClient.exe
Faulting module path: C:\Windows\system32\KERNELBASE.dll

any ideas what might be my issue

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on April 04, 2012, 07:29:59 pm
If you can send me the following files to my email (see website) I can figure this out:

Code: [Select]
c:/Program Files/RTS Services Inc/HalServer/VeraLogFile.txt Program Files x86 for 64 bit OS.



Title: Re: HAL lelujah --- You can now talk to your vera
Post by: guessed on April 09, 2012, 11:07:50 pm
Would you like a sub-board for your [speech-based] HAL Remote?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on April 10, 2012, 01:19:59 pm
That would be greate -- maybe call it:
 
HAL Remote - Windows & Android Voice Control for Vera
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: guessed on April 10, 2012, 01:28:51 pm
Done.  I shortened the name a little, and put the rest into the body/description.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: S-F on April 10, 2012, 09:24:42 pm
This is absolutely incredible. It's obviously going to take a lot of work to get it to where we all want it to be but as it is I'm astounded. I'm also not sure how I've missed it until today when it got it's own forum. I've been using dictation software for years now so I'm pretty comfortable using this. I'll report back with my thoughts once I've had enough time to get to know HAL.
One thing I can suggest right now though is the ability to toggle the sleeping/running status of the client via voice. I want to put microphones in every room. Remember that video of the guy talking to his ceiling and the house told him where the cars were and playing "who let the dogs out"? Oh and also, the ability to make custom responses to events. Like HAL welcomes me when I enter my PIN. Oh and one more thing. Where does the voice come from? Can one choose a third party voice and control things like the speed of the voice? I'm used to TextAloud with Cepstral voices and it would make it much easier to understand if the voice was a little more sophisticated and spoke slower with longer breaks between words.


@ RichardTSchaefer

This is huge. Thank you for all your hard work on making this astounding product. I will happily buy this product if and when it comes with a price tag.

EDIT:

OK, I'm having a really difficult time making this do anything. Occasionally I can get it to turn lights on and off but I can't get it to do things like lock the door or report on the thermostat. I keep getting the Unknown error.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on April 12, 2012, 02:18:02 pm
Thanks for the ideas ...

I have thought about integrating with cameras that have 2-way audio.
But I would need to have a state-full connection that has some pass-phrase for authentication.

On Android ... the speech comes from local Speech to text engine. On windows it comes from
the Window Text to speech engine ... In both environments you can customize the voices etc.

Remember to enunciate and start with something like "Hal" and end with something like "Please".  See the help file. Drop me an email (See my web site) and I will give you my phone number. We can talk.

I am current working on streaming ... Currently I record a file, transmit a file when complete which is detected by about 1/2 second of quite, then send to speech engine when transfer is complete. This should significantly improve response time.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Hisedase on May 04, 2012, 12:43:25 pm
Hi I'm kinda new in the vera scene  :) 

I installed HAL and installation is ok, but when I make a voice command I hear a "ping" en the whole thing crashes...

Here two log files from windows ...

1)
Application: HalClient.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.Net.Sockets.SocketException
Stack:
   at System.Net.Sockets.Socket.EndConnect(System.IAsyncResult)
   at System.Net.Sockets.TcpClient.EndConnect(System.IAsyncResult)
   at HalClient.HalClient+<>c__DisplayClass1.<Connect>b__0(System.IAsyncResult)
   at System.Net.LazyAsyncResult.Complete(IntPtr)
   at System.Net.ContextAwareResult.CompleteCallback(System.Object)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
   at System.Net.ContextAwareResult.Complete(IntPtr)
   at System.Net.LazyAsyncResult.ProtectedInvokeCallback(System.Object, IntPtr)
   at System.Net.LazyAsyncResult.InvokeCallback(System.Object)
   at System.Net.Sockets.Socket.MultipleAddressConnectCallback(System.IAsyncResult)
   at System.Net.LazyAsyncResult.Complete(IntPtr)
   at System.Net.ContextAwareResult.Complete(IntPtr)
   at System.Net.LazyAsyncResult.ProtectedInvokeCallback(System.Object, IntPtr)
   at System.Net.Sockets.Socket.ConnectCallback()
   at System.Net.Sockets.Socket.RegisteredWaitCallback(System.Object, Boolean)
   at System.Threading._ThreadPoolWaitOrTimerCallback.PerformWaitOrTimerCallback(System.Object, Boolean)

2)
Faulting application name: HalClient.exe, version: 1.0.2.1, time stamp: 0x4f50439b
Faulting module name: KERNELBASE.dll, version: 6.1.7601.17651, time stamp: 0x4e211319
Exception code: 0xe0434352
Fault offset: 0x0000b9bc
Faulting process id: 0x20f8
Faulting application start time: 0x01cd2a13d3fc1847
Faulting application path: C:\Program Files (x86)\RTS Services Inc\HalServer\HalClient.exe
Faulting module path: C:\Windows\syswow64\KERNELBASE.dll
Report Id: 24aa3dde-9607-11e1-a5c3-f46d0440cd50

Any suggestions ?

Thanks !
Hise
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: frichter09 on May 07, 2012, 10:30:55 pm
Hi I'm kinda new in the vera scene  :) 

I installed HAL and installation is ok, but when I make a voice command I hear a "ping" en the whole thing crashes...

Here two log files from windows ...

1)
Application: HalClient.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.Net.Sockets.SocketException
Stack:
   at System.Net.Sockets.Socket.EndConnect(System.IAsyncResult)
   at System.Net.Sockets.TcpClient.EndConnect(System.IAsyncResult)
   at HalClient.HalClient+<>c__DisplayClass1.<Connect>b__0(System.IAsyncResult)
   at System.Net.LazyAsyncResult.Complete(IntPtr)
   at System.Net.ContextAwareResult.CompleteCallback(System.Object)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
   at System.Net.ContextAwareResult.Complete(IntPtr)
   at System.Net.LazyAsyncResult.ProtectedInvokeCallback(System.Object, IntPtr)
   at System.Net.LazyAsyncResult.InvokeCallback(System.Object)
   at System.Net.Sockets.Socket.MultipleAddressConnectCallback(System.IAsyncResult)
   at System.Net.LazyAsyncResult.Complete(IntPtr)
   at System.Net.ContextAwareResult.Complete(IntPtr)
   at System.Net.LazyAsyncResult.ProtectedInvokeCallback(System.Object, IntPtr)
   at System.Net.Sockets.Socket.ConnectCallback()
   at System.Net.Sockets.Socket.RegisteredWaitCallback(System.Object, Boolean)
   at System.Threading._ThreadPoolWaitOrTimerCallback.PerformWaitOrTimerCallback(System.Object, Boolean)

2)
Faulting application name: HalClient.exe, version: 1.0.2.1, time stamp: 0x4f50439b
Faulting module name: KERNELBASE.dll, version: 6.1.7601.17651, time stamp: 0x4e211319
Exception code: 0xe0434352
Fault offset: 0x0000b9bc
Faulting process id: 0x20f8
Faulting application start time: 0x01cd2a13d3fc1847
Faulting application path: C:\Program Files (x86)\RTS Services Inc\HalServer\HalClient.exe
Faulting module path: C:\Windows\syswow64\KERNELBASE.dll
Report Id: 24aa3dde-9607-11e1-a5c3-f46d0440cd50

Any suggestions ?

Thanks !
Hise

I do have exactly the same problem. Running windows 7 64bit.
It says HAL Server stopped working.... these are the details:


Problem signature:
  Problem Event Name:   CLR20r3
  Problem Signature 01:   halclient.exe
  Problem Signature 02:   1.0.2.1
  Problem Signature 03:   4f50439b
  Problem Signature 04:   System
  Problem Signature 05:   4.0.0.0
  Problem Signature 06:   4eca03e8
  Problem Signature 07:   2f52
  Problem Signature 08:   157
  Problem Signature 09:   System.Net.Sockets.Socket
  OS Version:   6.1.7601.2.1.0.256.4
  Locale ID:   1033
  Additional Information 1:   0a9e
  Additional Information 2:   0a9e372d3b4ad19135b953a78882e789
  Additional Information 3:   0a9e
  Additional Information 4:   0a9e372d3b4ad19135b953a78882e789

Read our privacy statement online:
  http://go.microsoft.com/fwlink/?linkid=104288&clcid=0x0409

If the online privacy statement is not available, please read our privacy statement offline:
  C:\Windows\system32\en-US\erofflps.txt

Any ideas?
I would love to try this out! Already re-installed MS Framework 4.0 but no luck :(

Flo
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: alimobh on May 09, 2012, 06:13:05 am
I'm getting  same problem here with Windows 7 64-bit and exactly same logs.

Did you get it running by any chance?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: frichter09 on May 09, 2012, 10:20:16 am
I'm getting  same problem here with Windows 7 64-bit and exactly same logs.

Did you get it running by any chance?

Nope :(
Too bad since I really would like to give this a try.
Maybe RichardTSchaefer can help?

Flo
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: alimobh on May 10, 2012, 05:43:14 am
Looking forward to it  :)

I have tried it on a different windows 7 32-bit but whenever I try to run it gives me a message that I should try to run it as administrator while I'm already running it as administrator, not sure why it is still preventing me to run the application.

Also would love to see it working on Android 2.2 to run it on my galaxy tab.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on May 12, 2012, 02:57:09 pm
Sorry ... I have been away from the BB for a while.
I have solved the problem with "Always run as admin" but have yet to release it.
This is typically caused by changing network connections (Between WiFi and LAN).
I can walk people through a fix over the phone. 
As far as the exceptions it looks like a failure of HalClient to connect to HalServer.
Maybe a firewall issue. I may have missed handling a particular connection failure exception.

Folks can call me at 512-923-2755 (Texas Time!)
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: racarter on May 21, 2012, 05:54:15 pm
I'm having the same crash problem.  HAL starts OK, but when I get the 'ping' to say command accepted the program crashes immediately.  I'm running Windows 7 Home Premium.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on June 04, 2012, 11:26:26 am
Release new version with various fixes.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Hisedase on June 04, 2012, 03:16:49 pm
Wauw,

Now it works great, wonderfull program.

Question: is there another client available except android, let's say, ios or windows phone 7 ?

Is there a way to trigger a command, because let's say I install client on my mediacenter pc in the living room, but when u talk to other people u get always ping poing from HAL  :)

Thx,

Hisedase
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on June 05, 2012, 12:07:36 am
I did another fix tonight ... still chasing some installation problems ...

You can disable the "Open Mike" on the HalClient. But then you  have to click it to say something.
I can add an option to disable the NOISE maker!  Then it will only execute what it understands.


I looked into Apple ... but they want to see a revenue stream before I can put on market.
I can look into Windows Mobile ....  I can dual boot my android phone and bring it up in Windows Mobile ... last time I looked I was not sufficiently impressed to use it much.

I actually use an old Android phone as a remote control in the living area. It is not activated ... so I can't use it as a phone ... but I can run lots of Android apps that use my local area network.

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Hisedase on June 05, 2012, 05:45:31 am
Thanks for the quick answer !

I think windows phone (7 or soon 8) will take an reasonable market share as it will do on de tablet market also. (My guess  ;) )

Maybe u should look into it...

If u could disable or put an option to enable or disable the noise I think that this is a very convenient solution already...

Another suggestion, don't know if its possible but, for example if u say (computer light bathroom out ok), and the command is executed, maybe you could let HAL confirm, something like automaticly saying the status of that bathroom light). 

Keep up the good work !

Greetzzz
Hisedase
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on June 05, 2012, 07:50:54 am
The report of the actual status complicates things a bit ... because there is an unknown time delay from the time of sending a Zwave command until the time the device responds.  I could easily report the status of sending a command ... I already send it back to the client ... its on the "Last Result" page.

I can add the following options ...

Voice Capture options:

Acknowledge options:
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Hisedase on June 05, 2012, 09:11:49 am
That would be great !

I'm planning to test HAL in a living room enviroment (have mediacenter PC installed), so client on the mediacenter, server on my homeserver.

Then it would be nice to just say a command instead of pushing buttons or talking to devices  :)

It shows much more "Pro"  ;)

Thanks
Hisedase
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: frichter09 on June 08, 2012, 11:48:14 am
I can confirm that the program does not crash anymore when running on my Windows 7 -64bit system.

Excellent Job Richard!
Thank you so much.

Flo
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: frichter09 on June 08, 2012, 11:50:39 am
I use the Microsoft Speech Engine ... I evaluated other engines based on Java.
But this was the most reliable. So the HalServer is stuck on a PC platform for now.
The syntax description was very similar to all. Details of interfacing to the semantic content is different ... but this ended up being a small part of the project time. So if another speech engine is available it should not be a big deal to port.

I guess if there was demand I could do an  IOS and WM7 client.

Count me in on that IOS client :)
Please let me know if I can help you with anything.
An IOS Client would be awesome!!!

Flo
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: parkerc on June 09, 2012, 05:09:51 pm
+1 for the iOS client/App too ;)
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on June 10, 2012, 08:11:55 am
For the Windows Client I have added the following in response to user requests:
Android client changes will follow.

I also fixed a bug that prevented updates from being downloaded to your PC desktop.

You will have to manually download this patch ... subsequent ones should be automatic.
See http://rts-services.com/HalServer/Installer/ (http://rts-services.com/HalServer/Installer/)

I will also up the priority of the Apple iPhone/Tablet client.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: frichter09 on June 11, 2012, 10:16:28 am
Hi Richard,

If you at one point need some translation to German let me know.
German is my native language....


Flo
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Hisedase on June 15, 2012, 08:02:23 am
Thanks, I'll check it out as soon as I can !
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: woodchild on June 17, 2012, 06:25:56 am
Hi,

 tried to access the URL http://rts-services.com/HalServer/ with no website found return....
any change on the link?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on June 17, 2012, 07:53:11 am
My Internet Provider had a tower down for 12 hours.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: mwbehr on June 17, 2012, 12:14:00 pm
+1 for the iOS client/App too ;)

Only if you get one of the iphone apps ported to android. It's only fair  ;D
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: parkerc on July 15, 2012, 05:27:48 pm
+1 for the iOS client/App too ;)

Only if you get one of the iphone apps ported to android. It's only fair  ;D

I'll see what I can do ;)

It's strange, I was a windows man for so long, but I'm now starting to look for iOS and Linux based apps far more than I ever did before
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: S-F on August 28, 2012, 04:47:17 pm
Some development ideas for you:

TTS functionality. It would be grand if HAL could read off text in response to scenes or events. I really think this functionality is one of the major differences between Vera and the big dogs.
Also the ability to play recorded messages in response to scenes and events would be great. I know this is a tall order but it's really something we need for Vera. I would be happy to pay for this functionality.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on September 16, 2012, 12:28:43 am
 S-F  This might be better to be done as part of Vera Alert ...
by adding TTS messages as part of the notification service.
I have done work on this app as well ... do you use it ?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on September 16, 2012, 10:33:03 pm
I have made a release to the "HAL Server" today.  After moving up from a Vera 2 to Vera 3 I found some changes. I also addressed some instability with recently added devices. Since I started from scratch on my Vera 3 all the Z-Wave devices were NEW ... Also fixed some application exits related to accessing while it is starting up and shutting down.

The new Thermostat Status changes are not backwards compatible to Vera 2/UI4.
I am seeing a 1 hour difference in LastTrigger time by comparing with the windows current time. This might be related to daylight savings time ... I need to investigate ... the system time on vera (via ssh) and my Windows desktop are the same.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: iflyM3 on September 20, 2012, 10:33:46 pm
The .msi installer package doesn't complete or finish on Windows 7 64-bit Operating Systems, I tried it 8 times on two different Windows 7 PC's (firewall turned off and installed as Admin)... no dice.   :/
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on September 21, 2012, 04:04:33 pm
Exit the HAL Client application.
The installer runs the HAL Client during installation ... to do some setup with ADMIN priv. But you have to exit it to let the installer finish.

Title: HAL lelujah --- You can now talk to your vera
Post by: electricessence on September 25, 2012, 02:15:27 am
Hi Richard. I love where this is going.
I set up Hal Server on my server. And then installed it again on my desktop and connected to it via the client (didn't run the service).

After resolving firewall issues. I could not get it to recognize my commands. I went directly to the server and tried it there. In total it may have recognized 1 in 20 and correctly executed. I asked it "Hal, turn on the attic fan please." And it did! But aside from that I had plenty of difficulty. Any ideas?
I even ran the windows speech recognition routines to improve recognition. Of which windows recognizes me perfectly.
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: abbey on January 31, 2013, 08:10:33 am
Hello,

I am pretty new to all this Zwave technology, but I would really like to get Hal working with the few devices that I have. I had been getting a connection problem when I try a voice command. I went into Windows 7 firewall and made an inbound rule to allow certain ports, and I also tried to stop Avast from causing any problem. I don't know if either of these were causing the problem to begin with, but it didn't fix it. I went back to the HAL settings and clicked on the button to "Find HalServer" and I get an error "Could not find a running HalServer!". Also, I am using a router, and I have Vera hooked directly into the router. And, the HalServer software is on the same pc as the HalClient that I am trying to set up, which are all on the same wifi as the Vera.

I have another question, too. Getting this to work for myself is really just the first step in getting my disabled brother set up with voice activated lights, tv, music, etc. He is in a wheelchair and doesn't have use of his hands to press a button or switch to do those tasks. His speech is a bit hard to understand, but he can say words consistently. Can the voice recognition software learn how he pronounces words? I know you can train the software, but to what extent?
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Cor on March 23, 2013, 07:16:23 pm
Hi ,

I installed Hal remote in the last couple of days, but it isn't working, and I am not sure why.

Some issues where with the port forwarding, but when I changed the firewall settings for windows 7 I could see port 6106 to be open when I use "www.canyouseeme.org"   But no luck with port 6107 UDP and 6108 UDP , should this be the same as with port 6106 in TCP, or doesn't this work with "www.canyouseeme.org" ?

Initially I got a "connection" problem untill I changed the firewall settings on windows 7 when I spoke into my phone, but now the error is "communications error reading" , Is this my bloody dutch accent , or is something else going on?

Thanks,
Cor
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Pashak on March 24, 2013, 04:37:41 am
Want to give this a shot. Website is down??
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Cor on March 24, 2013, 07:36:17 am
@Pashak; is that a reply on my question? , which website do you mean?   All "websites" which I nees seem tobe working fine , I just get the error message on my android phone  "communications error reading"    and not quite sure what it means/where i have to find the error.

Thanks,
Cor

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 24, 2013, 07:53:45 am
Step 1:
    Make sure HalServer is talking to Vera!

    Check your windows machine where you are running Hal Server.
    Make sure it is communicating with Vera first.
    Check the Event log ...
    Check the file:
    Open the file with your browser:
           c:/Program Files (x86)/RTS Services Inc/HalServer/Help.html
    This will show the grammar and the names of all of your devices.

Step 2:
    Connect the Android Phone to Hal Server.
    Check the Event Log ...
    Check your firewall settings ...
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Cor on March 24, 2013, 09:09:30 am
hello Richard. Thanks for your answer,   I am currenly about 4000 miles away from home and installed /tested everything remotely..... maybe that's causing some issues. Tonight I am at home and will try again  :)

-I think Hal server is communicating with vera, it did find my vera and hall server is running as well.
-event log: Are you refering to a log from windows or a log I have to get via putty on my vera?
-help.html: I created a very simple scene called "test", should be no issue with my accent :-)
I tried: "Hal test thanks" , "please run test hal"  yesterday with these I got the ""communications error reading".
Today I am on a different network  (slightly closer to home) and my android phone says "connection error"   .....

I have an account with dyndns and inserted on my android:" name.dyndns.org" (where name= my accountname, which works on my router and various webcams). Tonight I will insert the Ip adress of the computer which runs hal server (10.0.0.81)

On the android phone:
-Check the Event Log ... : a windows log or vera log?
-Check your firewall settings ... I think I have it correctly setup, is there a way to test it step by step?

Thanks,
Cor

Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 24, 2013, 09:24:17 am
Event Log is on the Windows Machine.
Nothing interesting to look at on Vera ...

I have started a project to eliminate HalServer and do it all on the phone.
I do not know  when I will finish it ...
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Cor on March 25, 2013, 05:33:30 pm
No luck so far :-s

I installed the programm on my laptop (I am at home now) and the client found the vera.
I included both client and server in the firewall, they are now both in allowed programms and features.

When I speak to hal (on my laptop) , I get the 'ding" but than again a "connection" problem.
In the event log I find this error:
Code: [Select]
C:\Program Files (x86)\RTS Services Inc\HalServer\Grammar.grxml(294,17): error : XML grammar format not valid. Cannot load grammar into XML Document Object Model.
   at System.Speech.Internal.SrgsParser.XmlParser.ThrowSrgsExceptionWithPosition(String filename, XmlReader xmlReader, String sError, Exception innerException)
   at System.Speech.Internal.SrgsParser.XmlParser.Parse()
   at System.Speech.Recognition.SrgsGrammar.SrgsDocument.Load(XmlReader srgsGrammar)
   at System.Speech.Recognition.SrgsGrammar.SrgsDocument..ctor(String path)
   at HalService.Recognizer..ctor(HalService hs, String FileName)
   at HalService.HalServer.HalConnection.AudioRequest()
   at HalService.HalServer.HalConnection.HandleConnection()

What am I doing wrong :-s


Thanks,
Cor
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: RichardTSchaefer on March 25, 2013, 07:49:57 pm
Well that will be a big problem.
Apparently I have a bug in the parser. There's something in your configuration is causing a problem.
Can you zip up the following files and PM me the file. I will see if I can correct the problem.

c:/Program Files (x86)/RTS Services Inc/HalServer/
  The following files:
        Grammar.gxml
        VeraLogFile.txt
        Help.html

     
Title: Re: HAL lelujah --- You can now talk to your vera
Post by: Cor on March 26, 2013, 09:54:38 am
Hi Richard , I don't have an option to send attachments with a PM, I inserted the zip file in this reply.

I installed the programm on my notebook, the plan is to have the programm running on my media centre which runs 7/4, but that one is completely build in with no screen ,microphone, keyboard etc..... But the programm gave the same errors when I tried it a couple of days ago.  The zip file is from the notebook and is the same computer  as the error messages 2 posts ago.

Thanks,
Cor