dataMine update - beta release

I have a new version of dataMine (nearly) ready for testing. I’ll try and upload it here tomorrow - I intend to release it as a “beta” for more experienced/adventurous users before I put it on to apps. There’s a couple of reasons for this - it’s quite a big update (change in java libraries and Lua code) and it’s also got a few quirks still which I need to iron out, but I’d like to get some feedback.

This version has a slightly different UI as I’ve changed the java libs. I’m confident that this library will allow me to add the features I want without falling over, although it’s a bit more complicated, and has its own “issues”! The main screen looks largely the same as the current version of dataMine, with a few exceptions -:

[ul][li]The channel list is sortable, and you can add/remove different columns of data. It also categorises variables - currently this is an automatic thing, but the intention is to make this configurable.[/li]
[li]Currently, you can’t select the axis a channel is graphed on. I had trouble implementing this, so currently it puts different data types onto different axis automatically. This works fine for things like humidity or temperature where data is the same, but in some cases data types get grouped (eg weather variables) and they aren’t necessarily compatible when graphed[/li]
[li]There’s now a feature to save graphs. Just select the channels and click the save button. You’ll be asked for a name which appears in the list, and a reference. The reference is not currently used, but will be used to bring up a separate page with just this graph on it. Currently, if you save a graph with an existing name, it will not save - I’ll change this at some point to update the channels. Also, you can’t currently delete saved graphs…[/li]
[li]To recall a saved graph, click on the saved graphs header and then double click on the graph name.[/li][/ul]

In addition, you can now set up channels in a new “Configuration” tab. This is still work in progress, but currently allows you to enable/disable logging, configure the displayed name for the variable, and set a unit name. There may (likely!) be some quirks when saving channels, so if you change the configuration, you are advised to refresh dataMine after your done (for example, channels won’t immediately be available for graphing until you refresh). There is an area to display “ghost” variables (these are variables that still exist in the dataMine configuration, but the devices have previously been deleted) - this currently doesn’t do anything. I’ve attached a picture of the config screen.

I’ll upload this new version tomorrow night. It will need to be loaded manually, and I suggest that only users who are confident in using WinSCP and loading Lua files manually “upgrade” to this version. It won’t (or shouldn’t!) change your current configuration, so any channels currently being logged will continue to be logged. However, you can’t mix the new GUI with the old plugin as I’ve had to change the plugin to support the extra features.

Chris

Congrats on the new version. Looking forward to giving it a try.

  • Garrett

Chris… That is some very good additions. Looking forward to getting it up and going.

The new dataMine beta is ready. It needs to be manually installed, and it’s probably best if this is only done by ‘experienced’ users - if you’re not confident, then it’s probably best to wait a week or so until it is loaded onto the app store.

You should start with the existing version of dataMine installed. Upload the Lua file in the normal way (from UI5, go to Apps, Develop Apps, Vera Files). Then, using WinSCP, load the dataMineWeb.tar.gz file to the /www/dm directory. It’s probably best to delete all files/directories from this directory.

Since the GUI file is slightly too large to put here, I’ve uploaded it to code.mios.com at [url=http://code.mios.com/trac/mios_datamine/attachment/wiki/WikiStart/dataMineWeb.tar.gz]http://code.mios.com/trac/mios_datamine/attachment/wiki/WikiStart/dataMineWeb.tar.gz[/url]. The LUA file is attached below.

If you have any problems, you should be able to revert back to the current version on apps.mios.com, but I hope that’s not necessary :slight_smile:

Please feel free to post any comments here…

Chris

Loaded up the beta of datamine, it looks like I can not change the logging enabled of a device. I change the value from false to true and it keeps reseting to false.

  • Garrett

Thanks Garrett,
I’ve attached an updated Lua file here - see if that helps. I’ve found one issue that could cause the problem - if not, can you take a look at the logs and send me anything of interest?

Cheers
Chris

The fix does work. I am now running into another issue with trying to select the temperature value for the weather underground plugin. It looks like it does not like the child device it creates (temperature device). It might be due to the fact that the child device has an device id of [0]. Screen shot attached:

  • Garrett

Thanks for the test - I’m pleased that we’ve at least got the basics working. :wink: This will be a GUI issue rather than the Lua part of the plugin. There have been quite a few changes and I suspect that this is resolved in the version I’m working with here, and if not, at the very least your version is old and it would be easier to debug if we we more in sync.

I think what I’ll do is compile up a update / release candidate with the latest GUI - I’ll install this fresh onto my Vera2 to make sure that’s all ok, and I’ll drop you a PM with a pointer to it (it’ll be later this evening).

Cheers
Chris

When the new version will be available in the apps portal?
Regards,
Viorel

Hopefully in the next day or so. I’m just finalising everything at the moment. My only concern is that I will be away next week, so if there are any problems, I won’t be able to resolve it. If I can get everything tested tomorrow, I’ll release it, otherwise it may need to wait another week :(.

Chris

Thanks a lot. Very useful plugin. Can’t wait to upgrade.
Viorel

I’ve now released the update for MCVs approval in the app store. I’ve tested this as a fresh install on my old Vera2, and @garrettwp has kindly tested it as well, so hopefully it will be ok.

This version should upgrade fine from previous versions or as a new install. It looks largely the same as the previous version, and hopefully it’s reasonably self explanatory as to how it works. I’ll update the user manual as soon as I can…

I’ve removed the auto update in app store (if this works!). I will be going on holiday from Sunday, so if there are any problems, I’ll try and resolve them then, otherwise it will be the following week.

Any problems - just yell…

Cheers
Chris

FYI… the autoupdate does not work from the beta version I was using… and the Vera store did not even show dataMine when I searched for it, until I removed the beta version. I’ve seen this before… there must be something wrong with the way Vera tracks installs - no huge surprise though given the low quality of all their UI interworkings :wink:

I believe that this is a feature. It prevents the plugin to be auto updated if files were modified. This makes it so that the changes you made to the files are not removed.

  • Garrett