dataMine 0.969

Plugins & Plugin Development Unmaintained
1

I hope to have the next version of dataMine available in the next day or two - it should go to the apps store for approval tonight…

This version has a number of significant changes. The main ones are -:

[ul][li]Notifications: dataMine now downloads the full list of events/notifications from the MCV server. This list is updated every minute, and they can be graphed out as icons along the top of graphs. You can either show all notifications, or just those relevant to the current graph (ie notifications from the devices being graphed, and their parents). The attached picture shows what this looks like. This is obviously a new feature, so I’m open to comments on improving this.[/li]
[li]Installation: There’s now a window that pops up when the dataMine GUI starts if the USB stick is not installed. It prompts you to select the USB drive for use with dataMine, so hopefully eases the installation. This uses the UUID feature of USB sticks to ensure the drive is mounted correctly. I’ll update the manual to provide information on this.[/li]
[li]Speed: There’s a major speed enhancement in the time taken for dataMine to return graph data from Vera, to the browser. This allows Vera to return a lot of data - I’ve had 100,000 data entries returned in less than 10 seconds! But… Unfortunately, doing this poses a health warning to your browser - it may not be able to display the data! I’ll look at better ways to reduce data now that speed is increased.[/li][/ul]

The full list of changes is -:

Version 0.969 18-Feb-2013

[ul][li]Fixed bug with blkid UUID and LABEL return[/li]
[li]Fixed bug with incorrect offset being applied to channels[/li]
[li]Fixed bug with incorrect axis being used[/li]
[li]Fixed potential issue handling string values on startup[/li]
[li]Added debug output /port_3480/data_request?id=lr_dmCtrl&control=debug[/li]
[li]Added “easy install” - GUI selection and configuration of USB drive[/li]
[li]Added graph type 4 for status graphs[/li]
[li]Updated CSS to add missing icons[/li]
[li]Added event notification graphing[/li]
[li]Made graph options persistent[/li]
[li]Major improvement in speed of graph data return[/li][/ul]

Cheers
Chris

2

I installed the update manually, micasa still hasn’t fixed the bug which we discovered during the release of one of your last updates :cry:

Are there any special settings I need to make to get the notifications? I had to clear the browser cache to see the flags in the top menu which enable these notifications. But I don’t see any notifications like in your screenshot im my charts. Do I just have to wait until the next notifications appear and then they will show?

Also, a lot of the graphs which where “nice and round / carved” are now very digital and cornery, can this be changed again in a setting (i.e. GraphType)?

Thanks again for this amazing plugin, it is the most important tool on the vera, at least for me.

3

Hi @chixxi,
At the moment, apps is still showing this version as “Pending Approval”, so I guess you’re still running the older version (??) Or, does your UI5 say you’re on 0.969 (which would be interesting as it might reveal a hole in apps which may be useful for beta testing :wink: )…

Once you get 0.969, there shouldn’t be anything special that needs to be configured to show notifications. There is a setting to disable this, but I’m reasonably sure it defaults to on…

Setting GraphType to 0 should give the “spline” graph with the rounded corners. This shouldn’t have changed though, other than the new version adds type 4, which is a “square” area graph which looks quite good for status channels…

Cheers
Chris

4

Thanks for the quick reply. Yes, I am running 0.969, it says this in the UI and also I do have the flags for enabling the notifications in the graphs.

Remember, during one of your updates I found a bug which allows me to install also non approved or even non released versions of plugins (http://bugs.mios.com/view.php?id=2752). This is why I am already running the new version.

But as for the moment non of the notifications are shown in the graphs. I am logged in on the vera to mios.com, so this shouldn’t be the problem. When I activate the red flag, this means that all notifications are shown, so for example also system errors and logins?

What does the following line mean in the log? I get this about every three seconds:

50   02/18/13 11:24:38.965   luup_log:65: dataMine: No Events!!! <0x2d4e9680>

EDIT:
I think there is a bug with the saved graphs. When I save “graph bundles”, only the top 3 seem to work. I can safe more, but when I click them always the graphs/values from the third saved graphs show up. Is this working for you?

5

[quote=“chixxi, post:4, topic:174351”]Thanks for the quick reply. Yes, I am running 0.969, it says this in the UI and also I do have the flags for enabling the notifications in the graphs.

Remember, during one of your updates I found a bug which allows me to install also non approved or even non released versions of plugins (http://bugs.mios.com/view.php?id=2752). This is why I am already running the new version.[/quote]
Yes, I recall you saying this, but I thought that it must have been a timing issue, and you were “mistaken”. I should have known better :-[
It’s an interesting “feature” - I’m not sure if it’s good or bad, but it might be something we can use to our advantage!

Login isn’t necessary since this comes direct from Vera rather than the browser…
Yes, all notifications are shown - I get a log of “CheckLogs” events, and these should all show up with the red flag…

There’s a new config flag - SetEventsEnable - however this should be 1 be default.

[quote=“chixxi, post:4, topic:174351”]What does the following line mean in the log? I get this about every three seconds:

50   02/18/13 11:24:38.965   luup_log:65: dataMine: No Events!!! <0x2d4e9680>

Hmm - not a good sign. It means that no events were returned from the server.

[quote=“chixxi, post:4, topic:174351”]EDIT:
I think there is a bug with the saved graphs. When I save “graph bundles”, only the top 3 seem to work. I can safe more, but when I click them always the graphs/values from the third saved graphs show up. Is this working for you?[/quote]
Sorry - I’m not sure what you mean. Do you mean that only 3 saved graphs can be saved? If so, this works ok for me, so it’s probably not specifically a problem with only 3 graphs…

I see MCV have now approved this version - depending on peoples experience, I may remove it while we resolve some of these issues…

@chixxi - if you don’t mind, can you email me your dataMineConfig.json file? Also, if you don’t mind, I might send you an updated debug version that logs a bit more to help me find the issue with notifications…

Cheers
Chris

6

Concerning the events:
I am not getting any events. The flag is set to one in the advanced tab from dataMine. I also checked that I have events in the “My Alerts” tab from the vera UI. I think it has something to do with the message “No events!!!” in the log. Now, my vera 3 is running on 1.5.459 (beta, since I have aeon labs 4in1 sensors), I hope this is not the problem. Let’s wait for some other users to report, maybe some which run the current public release, before you pull this version. I can also install the debug version and send you the feedback if you provide it to me.

Concerning the “Saved Graphs”:
I use this feature to save bundles/packages of graphs. So for example I would save all the three CPU graphs to one bundle. Then I would create another bundle which shows all the memory data. Then a third with the two graphs Idle and Up time. Now when I click on “Saved Graphs” and then on one of the bundles, the first (CPU) and the second (RAM) show up correctly. But then when I click on the third bundle (Time), the graphs from the second bundle (RAM) are shown. When I create any further bundles and then click it in “Saved Graph”, always the graphs from the third bundle show up. Screenshot after clicking “Time” attached. I sved this multiple times, so I am sure I did no error when saving and choosing the graphs. I hope you understand this, it’s hard to describe.

I will attach the dataMineConfig.json to this post as soon as I am home tonight.

EDIT:
I attached the file. THANKS for your support!

7

[quote=“chixxi, post:6, topic:174351”]Concerning the events:
I think it has something to do with the message “No events!!!” in the log.[/quote]
Yes - this indicates that no events were returned from the server, but it could be for a number of reasons.

I doubt it - unless MCV have changed the way the UI accesses the servers, which I think is unlikely.

I’m confident it’s just something in dataMine, and we can find out what with a bit of debugging. I’ll put together a debug version tonight…

[quote=“chixxi, post:6, topic:174351”]Concerning the “Saved Graphs”:
I use this feature to save bundles/packages of graphs. So for example I would save all the three CPU graphs to one bundle. Then I would create another bundle which shows all the memory data. Then a third with the two graphs Idle and Up time. Now when I click on “Saved Graphs” and then on one of the bundles, the first (CPU) and the second (RAM) show up correctly. But then when I click on the third bundle (Time), the graphs from the second bundle (RAM) are shown. When I create any further bundles and then click it in “Saved Graph”, always the graphs from the third bundle show up. Screenshot after clicking “Time” attached. I sved this multiple times, so I am sure I did no error when saving and choosing the graphs. I hope you understand this, it’s hard to describe.[/quote]
Ok - I think I understand - by “bundle”, you just mean a saved graph? This is pretty much what I do, and I’ve got 8 or 9 graphs saved, each with between 3 and 5 channels. There shouldn’t be any problem with this (in theory)… When I get your config I’ll take a look and maybe try and wrap up a debug version that gives more information to both of the problems… That said, this problem is likely to be a GUI problem, and the events problem is in the plugin…

Cheers
Chris

8

[quote=“chixxi”]EDIT:
I attached the file. THANKS for your support![/quote]
Thanks, sorry I missed this addition - i should have checked…

I’ll take a look at this tonight.

Cheers
Chris

9

sorry, I guess it would have been smarter to add a new post.

no hurry chris! the plugin is running fine, I am in no urgent need for the events. so it doesn’t matter to me if you take some time for this.

10

@chixxi,
No probs - I’ll work through this in the short term - I’ll drop you a PM later this evening as I’d like to send you a debug version… I know @parkerc has this working, so it’s not a general issue…

Regarding the other problem with the 3rd “bundle” - one thing I noticed is the both the 2nd and 3rd graphs are the same - one is called time, and the other memory, but they both have the same 4 memory channels, so this is why they look the same. I can’t see any reason why you couldn’t save more “bundles” though. I will add something that allows users to see what channels are saved, as once you save a graph, there’s currently no way to see what it is defined as…

Cheers
Chris

11

It seems that I do not get the update .969.
So I deleted the .967 to download the newest version, but bit is still the .967 there.
I thougt the update was on.
?
Regards CE

12

Hi,
I’ve temporarily held this back as a couple of people had some issues and I wanted to make sure it wasn’t a major problem before it potentially cause too many people problems. I’m still confirming this at the moment, but I hope to release an update in the next few days (probably after the weekend as MCV won’t approve it anyway over the weekend).

Cheers
Chris

13

Thanks Chris !

I will look forward to it and hope I will find out how to mount the stick corectly.
It is a great job you are doing !!!
Regards
CE

14

[quote=“chixxi, post:9, topic:174351”]sorry, I guess it would have been smarter to add a new post.

no hurry chris! the plugin is running fine, I am in no urgent need for the events. so it doesn’t matter to me if you take some time for this.[/quote]
Hi Chixxi,
I’m just trying to tie up loose ends at the moment and was wondering if the latest update made any difference to the events? If not, I added some more logging, so grabbing the log would be good…

Thanks
Chris