We have moved at community.getvera.com

Author Topic: New dataMine graphing and logging plugin  (Read 287704 times)

Offline bucko

  • Hero Member
  • *****
  • Posts: 659
  • Karma: +27/-9
Re: New dataMine graphing and logging plugin
« Reply #570 on: February 15, 2013, 12:22:41 am »
I would suggest that you change the dataMine directory back to "/dataMine" - this would avoid any potential problems that may occur with the above uncertainties.

I checked the USB stick and it is logging files there ok. I went ahead and changed the directory to /datamine and redid my channels.

Thank you
Vera 3, 40+ Fibaro relays & dimmers, IPUX cams, Elk M1 Gold, M1XEP, M1SP, XVOR, M1RB, Elk124, Monoprice HDMI matrix & 6 zone amp, Denon AVR, Panasonic A8000, BI DV,On Controls

Offline Aaron

  • Hero Member
  • *****
  • Posts: 1985
  • Karma: +61/-193
Re: New dataMine graphing and logging plugin
« Reply #571 on: February 20, 2013, 10:46:48 am »
Chris,
the updated interface it very nice, very functional - nice work!

2 Questions...

1) dataMine shows my Trane thermostat with ton of channels, many more than the User manual shows is Zwave addressable.  I cannot tell what they are/do. Some seem to have data being sent but I have no way to interpret and since many of the items are named nearly identical it is hard to know what does what.  Is there any way to get more info on what these are?  Here is the manual's info...

Zwave Command Class Comments
COMMAND_CLASS_THERMOSTAT_MODE The operating mode of the TZ43 thermostat
COMMAND_CLASS_THERMOSTAT_OPERATING
_STATE
Returns the operating state of the HVAC system
COMMAND_CLASS_THERMOSTAT_SETPOINT The TZ43 Setpoint (heat or cool)
COMMAND_CLASS_THERMOSTAT_FAN_MODE The Fan Mode
COMMAND_CLASS_THERMOSTAT_FAN_STATE The HVAC system mechanical fan state
COMMAND_CLASS_SENSOR_MULTILEVEL Returns the temperature as displayed by the TZ43. Note this
temperature is the TZ43?s working temperature and includes any
averaging sensors
COMMAND_CLASS_VERSION Returns various Zwave version information
COMMAND_CLASS_CLOCK Used to set the TZ43?s real-time clock
COMMAND_CLASS_MANUFACTURER_SPECIFIC Returns Manufacture and Product information
COMMAND_CLASS_CONFIGURATION Used to read/write internal TZ43 variables. The majority of the
variables are accessable via the on-screen menu, the
CONFIGURATION command class is used to remotely set the
variables. It is recommended that you have a thourough
understanding of the variables before making any changes. See
variable table below
COMMAND_CLASS_LOCK Used to implement the Display Lock, locking the thermostat keys


2) in the old interface we could change a specific channels line display to be status, thus only showing it as absolute on/off. Where is the setting for that? my thermostat 'mode' shows as a ramp, it should only be on or off.

thx

Offline Chris

  • Moderator
  • Hero Member
  • *****
  • Posts: 821
  • Karma: +3/-0
Re: New dataMine graphing and logging plugin
« Reply #572 on: February 20, 2013, 12:27:41 pm »
1) dataMine shows my Trane thermostat with ton of channels, many more than the User manual shows is Zwave addressable.  I cannot tell what they are/do. Some seem to have data being sent but I have no way to interpret and since many of the items are named nearly identical it is hard to know what does what.  Is there any way to get more info on what these are?  Here is the manual's info...
Not that I know of. Also, what dataMine shows are the variables mapped to MCVs UPnP services - that's not necessarily the same as the device classes. MCV have additional variables that define how Vera uses the data, over and above those that are returned from the device...

2) in the old interface we could change a specific channels line display to be status, thus only showing it as absolute on/off. Where is the setting for that? my thermostat 'mode' shows as a ramp, it should only be on or off.
Yes - you can change the graph type. Changing to type 1 will do what you want I think. This is configured in the variable configuration - "GraphType".

Cheers
Chris

Offline Aaron

  • Hero Member
  • *****
  • Posts: 1985
  • Karma: +61/-193
Re: New dataMine graphing and logging plugin
« Reply #573 on: February 23, 2013, 01:05:41 pm »
Chris,
I'm having a new problem, not seen before. I have attached a ZIP of ALL FILES in the dataMine folder... which btw is hidden? When I used WinSCP it does not list it in the tree but if I type it in manually it will enter the folder just fine and see the file fine. Not sure if this is what you intended? The dataMine folder is on the USB and Vera logging is not using USB.

You'll see that dataMine stop showing new data. I did a ZWave heal last night but that did not change anything. My Zwave network has not changed at all and the heal shows the Thermostat with a full 5 stars.


Offline Chris

  • Moderator
  • Hero Member
  • *****
  • Posts: 821
  • Karma: +3/-0
Re: New dataMine graphing and logging plugin
« Reply #574 on: February 23, 2013, 01:47:59 pm »
Hi Aaron,
The dataMine folder shouldn't be hidden - I don't know why that would be... My understanding of Linux is that the only way to make a directory hidden is to put a "." as the first character. Clearly this isn't the case if you can still access the directory, so maybe it's a WinSCP issue?

I don't know why things would have stopped logging and I really need to see the log files to be able to have any idea. The easiest way to get this is to type the following url -:

<vera IP>/port_3480/data_request?id=lr_dmCtrl&control=debug

Cheers
Chris

Offline Aaron

  • Hero Member
  • *****
  • Posts: 1985
  • Karma: +61/-193
Re: New dataMine graphing and logging plugin
« Reply #575 on: February 23, 2013, 01:58:54 pm »
when I use your URL I get a blank screen with this msg... "Handler failed"


Offline Chris

  • Moderator
  • Hero Member
  • *****
  • Posts: 821
  • Karma: +3/-0
Re: New dataMine graphing and logging plugin
« Reply #576 on: February 23, 2013, 02:05:53 pm »
Hmmm - not sure if that's indicative of the other problem... Can you get the logs direct from WinSCP then?

Offline Aaron

  • Hero Member
  • *****
  • Posts: 1985
  • Karma: +61/-193
Re: New dataMine graphing and logging plugin
« Reply #577 on: February 23, 2013, 02:28:06 pm »
What logs - I don't know when you want me to look?

FYI - The attached zip is the entire dataMine folder.

Offline Chris

  • Moderator
  • Hero Member
  • *****
  • Posts: 821
  • Karma: +3/-0
Re: New dataMine graphing and logging plugin
« Reply #578 on: February 23, 2013, 02:31:54 pm »
Ok - sorry, I thought you'd sent me logs in the past...

From WinSCP, click on the TERMINAL button (little black button with HOM on it). Type the following in and hit enter.

cat /var/log/cmh/LuaUPnP.log | grep dataMine

Cheers
Chris

Offline Aaron

  • Hero Member
  • *****
  • Posts: 1985
  • Karma: +61/-193
Re: New dataMine graphing and logging plugin
« Reply #579 on: February 23, 2013, 02:43:01 pm »
Ok - sorry, I thought you'd sent me logs in the past...

From WinSCP, click on the TERMINAL button (little black button with HOM on it). Type the following in and hit enter.

cat /var/log/cmh/LuaUPnP.log | grep dataMine

Cheers
Chris

Out of space? It is a 4GB USB. BTW, dataMine is not hidden.

maybe it is not on the USB?

SetMountPoint & mountLocation = /dev/sda1
SetDataDirectory - /dataMine

Code: [Select]
/dataMine$ cat /var/log/cmh/LuaUPnP.log | grep dataMine
50 02/23/13 12:31:11.842 luup_log:117: dataMine: Logging error logging variable 76::urn:upnp-org:serviceId:TemperatureSensor1::CurrentTemperature <0x2c74f680>
50 02/23/13 12:31:11.842 luup_log:117: dataMine: Unable to open file for write /dataMine/4 Temperature - CurrentTemperature [R2251].txt <0x2c74f680>
50 02/23/13 12:31:11.842 luup_log:117: dataMine: Error: '/dataMine/4 Temperature - CurrentTemperature [R2251].txt: No space left on device' <0x2c74f680>
50 02/23/13 12:31:11.846 luup_log:117: dataMine: Logging error logging variable 79::urn:micasaverde-com:serviceId:HumiditySensor1::CurrentLevel <0x2c74f680>
50 02/23/13 12:31:11.846 luup_log:117: dataMine: Unable to open file for write /dataMine/5 Humidity - CurrentLevel [R2251].txt <0x2c74f680>
50 02/23/13 12:31:11.846 luup_log:117: dataMine: Error: '/dataMine/5 Humidity - CurrentLevel [R2251].txt: No space left on device' <0x2c74f680>
« Last Edit: February 23, 2013, 02:51:09 pm by Aaron »

Offline Chris

  • Moderator
  • Hero Member
  • *****
  • Posts: 821
  • Karma: +3/-0
Re: New dataMine graphing and logging plugin
« Reply #580 on: February 23, 2013, 03:03:02 pm »
I think this came up a week or two back. There's a lot of messages on the web (ie google search) about Linux reporting no space left when it's clearly wrong.

One option is that the root directory is full. You only have about 120 files, so it should be ok. FAT file systems only allow (I think) 512 files in the root directory. Normally though, FAT-32 is used these days, and that doesn't have such a limitation... If you type "mount" into WinSCP terminal, it will tell you what file system is used. vfat is (I believe) FAT32, and this will be ok - if it just says fat, then this might be an issue...

You could try deleting all the .backup files and see if that helps (the next release has a function to do this automatically).  I'll have a bit of a dig on the net...

Chris

Offline Chris

  • Moderator
  • Hero Member
  • *****
  • Posts: 821
  • Karma: +3/-0
Re: New dataMine graphing and logging plugin
« Reply #581 on: February 23, 2013, 03:07:16 pm »
Aaron, can you post a bit more of the logfile (ie earlier) so I can see (hopefully) why the debug link I sent you earlier didn't work. Or run the link again, and the dump the log again...

Thanks
Chris

Offline Aaron

  • Hero Member
  • *****
  • Posts: 1985
  • Karma: +61/-193
Re: New dataMine graphing and logging plugin
« Reply #582 on: February 23, 2013, 03:18:15 pm »
debug link still throws failure

the log file I provided was everything it gave me. I reboot at 4am every day (to ensure stability) so maybe that is why the log is small.

I deleted the backup files - maybe you can make a clean-up function in your code? Have it save X days but delete the rest automatically to save space?

mount shows...
/dev/sda1 on /dataMine type vfat (rw,relatime,fmask=0022,dmask=0022,codepage=cp437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro)

also...
/dataMine$ df
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/root                 4352      4352         0 100% /rom
tmpfs                    63728      6948     56780  11% /tmp
tmpfs                      512         0       512   0% /dev
/dev/mtdblock7           11264      3180      8084  28% /overlay
overlayfs:/overlay       11264      3180      8084  28% /
/dev/mtdblock8            4352      4352         0 100% /mios
/dev/sda1               524640      1040    523600   0% /dataMine


« Last Edit: February 23, 2013, 03:20:51 pm by Aaron »

Offline Chris

  • Moderator
  • Hero Member
  • *****
  • Posts: 821
  • Karma: +3/-0
Re: New dataMine graphing and logging plugin
« Reply #583 on: February 23, 2013, 03:24:33 pm »
Logs get rotated occasionally, so it will only go back a short time. If you run the debug link, then use WinSCP to get the log, that ought to show something (although grep may be case sensitive, so you may also need to try a capital D in dataMine).

Yes- the next version of dataMine (hopefully available in a day or two) has a function that deletes old backups, and just keeps the last 10 files.

Given you seem to have FAT32 (vfat), I don't think that deleting the files will help in this case...  :(

Chris

Offline Aaron

  • Hero Member
  • *****
  • Posts: 1985
  • Karma: +61/-193
Re: New dataMine graphing and logging plugin
« Reply #584 on: February 23, 2013, 03:28:00 pm »
/dataMine$ cat /var/log/cmh/LuaUPnP.log | grep DataMine

Code: [Select]
09 02/23/13 12:49:07.037 JobHandler_LuaUPnP::Run device 117 dataMine graphing and logging room 15 type urn:schemas-cd-jackson-com:device:DataMine:1 id  parent 0/0xcedc60 upnp: 0 <0x2ad49000>
06 02/23/13 12:49:09.565 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: ChannelCnt was: 9 now: 0 #hooks: 0 upnp: 0 v:0xe194d0/NONE duplicate:0 <0x2b67d680>
06 02/23/13 12:49:09.566 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: ChannelRec was: 6 now: 0 #hooks: 0 upnp: 0 v:(nil)/NONE duplicate:0 <0x2b67d680>
06 02/23/13 12:49:09.592 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: mountLocation was: /dev/sda1 now: /dev/sda1 #hooks: 0 upnp: 0 v:(nil)/NONE duplicate:1 <0x2b67d680>
06 02/23/13 12:49:09.592 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: mountType was: vfat now: vfat #hooks: 0 upnp: 0 v:(nil)/NONE duplicate:1 <0x2b67d680>
06 02/23/13 12:49:09.882 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: ChannelCnt was: 0 now: 9 #hooks: 0 upnp: 0 v:0xe194d0/NONE duplicate:0 <0x2b67d680>
06 02/23/13 12:49:09.883 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: ChannelRec was: 0 now: 6 #hooks: 0 upnp: 0 v:(nil)/NONE duplicate:0 <0x2b67d680>
06 02/23/13 12:49:09.911 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: ChannelCnt was: 9 now: 9 #hooks: 0 upnp: 0 v:0xe194d0/NONE duplicate:1 <0x2b67d680>
06 02/23/13 12:49:09.912 Device_Variable::m_szValue_set device: 117 service: urn:cd-jackson-com:serviceId:DataMine1 variable: ChannelRec was: 6 now: 6 #hooks: 0 upnp: 0 v:(nil)/NONE duplicate:1 <0x2b67d680>