dataMine 0.978

Plugins & Plugin Development Unmaintained
1

dataMine 0.978 will go on apps tonight I hope. This version has a major change in the data structure (see other posts on this). This has been tested by a few people and should work ok. However, when dataMine first runs after the upgrade, you may notice that it’s a bit slower than normal to produce graphs (you probably won’t notice!). This will only be the case for an hour or two after the upgrade while data is migrated to the new format - it depends on the number of channels being monitored, and the length of time you’ve been running dataMine as to how long it will take.

There are also a couple of other significant mods - Y axis data labels, and additional options for saving graphs. I’d recommend downloading the latest manual (see the sticky topic in the dataMine forum) to see how all this works. It’s also now possible to embed graphs into devices using just a URL - this is also discussed in the manual, but it has limited functionality and is designed for simplicity.

If you have any problems, please let me know.

Cheers
Chris

Version 0.978

Added flag to avoid multiple calls to variable_watch
Modified umount call when duplicate mount detected
Migrate database to new structure
Changed “type(Lookup)” check to be not specific to Alpha
Added check - if Lookup not table, then remove from config
Added day/night shading option into saved graph
Added quick reference option back into saved graph
Fixed bug saving graph axis number
Made lookup table editable - extra tab in variable config screen
Added quick graph page for embedded links (/dm/graph.html)
Added out-of-limits filter (GUI filter)

2

Oh no! I seem to have lost all my data over a week old in the upgrade to 0.978.
(at least, it doesn’t plot)

Anyone else?

[Edit: is this just the database update in progress? - perhaps I should just wait…]

3

Hmmm… I’ll answer your edit first. During the update some channels may not be available.

If worst does happen and your data doesn’t reappear, then we can recover (with some manual handling). There is a variable in the config that could be reset to restart the transfer…

Let me know the result and we can take it from there.

Chris

4

Just updated at everything seems to have gone all-ok for me.

Tested the new filter on my temperature-readings and and it works great! Thanks Chris!

Only “unaccounted load configuration” left and dataMine is finished :slight_smile:

5

I really like the y axis function. But there seems to be a problem. It saves the Y axis table but after re-entering dataMine again, the tables are missing. This has happened everytime I have tried to.

6

I’ll take a look at this in the weekend (I’m away from home at the moment). Can you attach, or email, the output from the debug link - this might be helpful.

Thanks
Chris

7

Sadly, data older than a week is still missing after the upgrade. Looks like I’ll need some instructions to tweak the config? I think that Vera reloaded several times shortly after the upgrade and that may have disturbed the migration progress. Guidance appreciated. Thanks.

(did anyone ever tell you this was a great app?)

8

-1-===========================================================================
06 05/23/13 18:57:46.141 Device_Variable::m_szValue_set device: 64 service: urn:cd-jackson-com:serviceId:DataMine1 variable: e[35;1mChannelCnte[0m was: 12 now: 12 #hooks: 0 upnp: 0 v:0xd14390/NONE duplicate:1 <0x2dba1680>
06 05/23/13 18:57:46.142 Device_Variable::m_szValue_set device: 64 service: urn:cd-jackson-com:serviceId:DataMine1 variable: e[35;1mChannelRece[0m was: 12 now: 12 #hooks: 0 upnp: 0 v:(nil)/NONE duplicate:1 <0x2dba1680>
-2-===========================================================================
/dev/sda1: LABEL=“DATAMINE” UUID=“464B-4876”
-3-===========================================================================
rootfs on / type rootfs (rw)
/dev/root on /rom type squashfs (ro,relatime)
proc on /proc type proc (rw,noatime)
sysfs on /sys type sysfs (rw,noatime)
tmpfs on /tmp type tmpfs (rw,nosuid,nodev,noatime)
tmpfs on /dev type tmpfs (rw,noatime,size=512k,mode=755)
devpts on /dev/pts type devpts (rw,noatime,mode=600)
/dev/mtdblock7 on /overlay type jffs2 (rw,noatime)
overlayfs:/overlay on / type overlayfs (rw,noatime,lowerdir=/,upperdir=/overlay)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
/dev/mtdblock8 on /mios type squashfs (ro,relatime)
none on /proc/bus/usb type usbfs (rw,relatime)
/dev/sda1 on /dataMine type vfat (rw,relatime,fmask=0022,dmask=0022,codepage=cp437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro)
-4-===========================================================================

Disk /dev/mtdblock0: 0 MB, 524288 bytes
255 heads, 63 sectors/track, 0 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/mtdblock0 doesn’t contain a valid partition table

Disk /dev/sda: 2013 MB, 2013265920 bytes
64 heads, 46 sectors/track, 1335 cylinders
Units = cylinders of 2944 * 512 = 1507328 bytes

Device Boot Start End Blocks Id System
/dev/sda1 * 1 1336 1966064 6 FAT16
-5-===========================================================================
SetDataDirectory-/dataMine/
SetMountUUID -464B-4876
SetMountPoint -
SetManualMount -0
-6-===========================================================================
{“Events”:{“count”:791,“last”:1369328245},“dbVersion”:1,“Version”:“0.978”,“LastWrite”:1369328266,“Variables”:[{“Ghost”:false,“Service”:“urn:micasaverde-com:serviceId:EnergyMetering1”,“LastRec”:1369319315,“DrowsyError”:0,“DataType”:5,“Archive”:“1 Lavadora - Watts”,“EnergyCat”:5,“Type”:4,“Logging”:1,“LastVal”:0,“Device”:9,“LastHistory”:1104516000,“DrowsyWarning”:0,“Units”:“watt”,“Id”:1,“DataOffset”:0,“Name”:“Lavadora (watt)”,“FilterEnable”:0,“FirstRec”:0,“Variable”:“Watts”,“historyState”:0},{“Ghost”:false,“Service”:“urn:micasaverde-com:serviceId:EnergyMetering1”,“DrowsyError”:0,“LastRec”:1369304086,“DrowsyWarning”:0,“Type”:4,“Archive”:“2 Lavadora - KWH”,“Logging”:1,“Device”:9,“DataType”:0,“Units”:“kw/h”,“LastHistory”:1104516000,“Id”:2,“DataOffset”:0,“Name”:“Lavadora (kw/h)”,“LastVal”:2.8,“FirstRec”:0,“Variable”:“KWH”,“historyState”:0},{“Ghost”:false,“Service”:“urn:micasaverde-com:serviceId:EnergyMetering1”,“DrowsyError”:0,“LastRec”:1369309186,“DataType”:5,“EnergyCat”:0,“Type”:4,“Archive”:“3 Secadora - Watts”,“Logging”:1,“Device”:17,“Units”:“watt”,“DrowsyWarning”:0,“LastHistory”:1104516000,“Id”:3,“DataOffset”:0,“Name”:“Secadora (watt)”,“LastVal”:0,“FirstRec”:0,“Variable”:“Watts”,“historyState”:0},{“Ghost”:false,“Service”:“urn:micasaverde-com:serviceId:EnergyMetering1”,“DrowsyError”:0,“LastRec”:1369306945,“DrowsyWarning”:0,“Type”:0,“Archive”:“4 Secadora - KWH”,“Logging”:1,“Device”:17,“DataType”:0,“Units”:“kw/h”,“LastHistory”:1104516000,“Id”:4,“DataOffset”:0,“Name”:“Secadora (kw/h)”,“LastVal”:8.1,“FirstRec”:0,“Variable”:“KWH”,“historyState”:0},{“Ghost”:false,“Service”:“urn:micasaverde-com:serviceId:EnergyMetering1”,“DrowsyError”:0,“FilterEnable”:0,“LastRec”:1369334516,“DataType”:5,“EnergyCat”:6,“Type”:0,“Archive”:“14 Router - Watts”,“Logging”:1,“Device”:51,“Units”:“watt”,“DrowsyWarning”:0,“LastHistory”:1104516000,“Id”:14,“DataOffset”:0,“Name”:“Router (w)”,“LastVal”:88,“FirstRec”:0,“Variable”:“Watts”,“historyState”:0},{“Ghost”:false,“Service”:“urn:upnp-org:serviceId:WindSensor1”,“LastRec”:1369332273,“DrowsyError”:0,“LastHistory”:1104516000,“Device”:72,“FilterMaximum”:0,“Logging”:1,“Type”:3,“FilterEnable”:0,“DrowsyWarning”:0,“Id”:15,“FilterMinimum”:0,“Alpha”:1,“DataType”:0,“Units”:“0”,“DataOffset”:0,“Name”:“Viento (dirección)”,“LastVal”:“NNW”,“FirstRec”:0,“Variable”:“Direction”,“historyState”:0,“Lookup”:{“WSW”:8,“ESE”:11,“S”:16,“NNE”:1,“E”:14,“WNW”:5,“NW”:9,“SSW”:15,“NE”:7,“W”:13,“SE”:12,“SSE”:10,“ENE”:4,“SW”:6,“NNW”:3,“N”:2}},{“Ghost”:false,“Service”:“urn:upnp-org:serviceId:RainSensor1”,“LastRec”:0,“DrowsyError”:0,“DataType”:0,“FilterMaximum”:0,“DrowsyWarning”:0,“Type”:0,“Logging”:1,“FilterEnable”:0,“Device”:73,“FilterMinimum”:0,“Units”:“mm”,“LastHistory”:1104516000,“Id”:16,“DataOffset”:0,“Name”:“Lluvia (diaria)”,“LastVal”:0,“FirstRec”:0,“Variable”:“DailyRain”,“historyState”:0},{“Ghost”:false,“Service”:“urn:upnp-org:serviceId:UvSensor1”,“LastRec”:1369328332,“DrowsyError”:0,“DrowsyWarning”:0,“FilterMaximum”:0,“LastHistory”:1104516000,“Type”:0,“FirstRec”:0,“LastVal”:0,“Id”:17,“FilterMinimum”:0,“Device”:74,“Units”:“UVI”,“DataType”:0,“DataOffset”:0,“Name”:“Índice UV”,“FilterEnable”:0,“Logging”:1,“Variable”:“CurrentLevel”,“historyState”:0},{“Ghost”:false,“Service”:“urn:upnp-org:serviceId:WindSensor1”,“LastRec”:1369333533,“DrowsyError”:0,“DrowsyWarning”:0,“FilterMaximum”:0,“LastHistory”:1104516000,“Type”:0,“FirstRec”:0,“LastVal”:9,“Id”:18,“FilterMinimum”:0,“Device”:72,“Units”:“km/h”,“DataType”:0,“DataOffset”:0,“Name”:“Viento (velocidad media)”,“FilterEnable”:0,“Logging”:1,“Variable”:“AvgSpeed”,“historyState”:0},{“Ghost”:false,“Service”:“urn:upnp-org:serviceId:WindSensor1”,“LastRec”:1369333533,“DrowsyError”:0,“DrowsyWarning”:0,“FilterMaximum”:0,“LastHistory”:1104516000,“Type”:0,“FirstRec”:0,“LastVal”:13,“Id”:19,“FilterMinimum”:0,“Device”:72,“Units”:“km/h”,“DataType”:0,“DataOffset”:0,“Name”:“Viento (rachas)”,“FilterEnable”:0,“Logging”:1,“Variable”:“GustSpeed”,“historyState”:0},{“Ghost”:false,“Service”:“urn:upnp-org:serviceId:RainSensor1”,“LastRec”:0,“DrowsyError”:0,“DrowsyWarning”:0,“FilterMaximum”:0,“LastHistory”:1104516000,“Type”:0,“FirstRec”:0,“LastVal”:0,“Id”:20,“FilterMinimum”:0,“Device”:73,“Units”:“mm/h”,“DataType”:0,“DataOffset”:0,“Name”:“Lluvia”,“FilterEnable”:0,“Logging”:1,“Variable”:“CurrentRain”,“historyState”:0},{“Ghost”:false,“Service”:“urn:upnp-org:serviceId:RainSensor1”,“LastRec”:0,“DrowsyError”:0,“DrowsyWarning”:0,“FilterMaximum”:0,“LastHistory”:1104516000,“Type”:0,“FirstRec”:0,“LastVal”:141.2,“Id”:21,“FilterMinimum”:0,“Device”:73,“Units”:“mm”,“DataType”:0,“DataOffset”:0,“Name”:“Lluvia (total)”,“FilterEnable”:0,“Logging”:1,“Variable”:“CurrentTRain”,“historyState”:0}],“Graphs”:[{“Period”:86400,“Channels”:[{“Device”:24,“Service”:“urn:micasaverde-com:serviceId:HumiditySensor1”,“yAxis”:1,“Variable”:“CurrentLevel”},{“Device”:25,“Service”:“urn:upnp-org:serviceId:RainSensor1”,“yAxis”:1,“Variable”:“CurrentRain”},{“Device”:22,“Service”:“urn:upnp-org:serviceId:WindSensor1”,“yAxis”:1,“Variable”:“GustSpeed”},{“Device”:23,“Service”:“urn:upnp-org:serviceId:TemperatureSensor1”,“yAxis”:1,“Variable”:“CurrentTemperature”}],“Events”:1,“Icon”:1,“Name”:“Climatología externa”},{“Night”:1,“Period”:86400,“Channels”:[{“Device”:72,“Service”:“urn:upnp-org:serviceId:WindSensor1”,“yAxis”:1,“Variable”:“GustSpeed”},{“Device”:72,“Service”:“urn:upnp-org:serviceId:WindSensor1”,“yAxis”:1,“Variable”:“AvgSpeed”}],“Name”:“Viento”,“Reference”:“viento”,“Icon”:9,“Events”:0}],“guiConfig”:{“_dc”:“1369320428134”,“graphOptionMarker”:true,“graphOptionWidth”:“5”,“graphOptionShadows”:true},“nextId”:22}
-7-===========================================================================

9

Chris,

I also seemed to have lost all data after a week, not a big deal to me but would be nice if I could get it back. Thanks!

10

My data also disappeard during the night after upgrading . There seems to be a glitch in the vera USB mounting that in combination with the prolonged conversion job (and probably some LusUPnp restarts) seems to corrupt the USB.

I’m investigating the possibility of mounting the NAS direcly on the vera unit… just need some mios permission to add a couple of busybox-packages.

11

I’m getting some errors after a fresh install of 0.978 and am not sure what to do:

-1-===========================================================================
10 05/23/13 17:18:46.233 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:18:46.234 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:18:49.444 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:18:49.445 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:19:03.618 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:19:03.619 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:19:24.034 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:19:24.035 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
50 05/23/13 17:19:54.402 luup_log:147: dataMine: 1:Unable to open file for read - /dataMine/database/1/raw/2264.txt <0x2f659680>
06 05/23/13 17:19:58.653 Device_Variable::m_szValue_set device: 147 service: urn:cd-jackson-com:serviceId:DataMine1 variable: e[35;1mChannelCnte[0m was: 7 now: 7 #hooks: 0 upnp: 0 v:0xc1b540/NONE duplicate:1 <0x2d7d7680>
06 05/23/13 17:19:58.653 Device_Variable::m_szValue_set device: 147 service: urn:cd-jackson-com:serviceId:DataMine1 variable: e[35;1mChannelRece[0m was: 7 now: 7 #hooks: 0 upnp: 0 v:(nil)/NONE duplicate:1 <0x2d7d7680>
10 05/23/13 17:19:59.074 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:19:59.075 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:20:22.861 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:20:22.862 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:20:30.752 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:20:30.754 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:20:49.050 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:20:49.051 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:21:13.379 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:21:13.380 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:21:29.340 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:21:29.341 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:21:50.291 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:21:50.291 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:21:58.802 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:21:58.803 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:22:11.669 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:22:11.670 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
50 05/23/13 17:22:12.479 luup_log:147: dataMine: Logging error logging variable 138::urn:micasaverde-com:serviceId:HumiditySensor1::CurrentLevel <0x2fc86680>
50 05/23/13 17:22:12.480 luup_log:147: dataMine: Unable to open file for write /dataMine/database/2/raw/2264.txt <0x2fc86680>
50 05/23/13 17:22:12.480 luup_log:147: dataMine: Error: ‘/dataMine/database/2/raw/2264.txt: No such file or directory’ <0x2fc86680>
10 05/23/13 17:22:24.639 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:22:24.640 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:22:31.213 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:22:31.214 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:22:39.917 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:22:39.918 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
50 05/23/13 17:22:45.702 luup_log:147: dataMine: 1:Unable to open file for read - /dataMine/database/2/raw/2264.txt <0x2f218680>
10 05/23/13 17:23:00.244 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:23:00.245 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:23:06.643 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:23:06.644 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>
10 05/23/13 17:23:13.283 luvd_get_info /etc/cmh-ludl/S_DataMine1.xml conn (nil) <0x2e818680>
10 05/23/13 17:23:13.283 luvd_open /etc/cmh-ludl/S_DataMine1.xml <0x2e818680>

12

Hi Chris

Also having the problem where only the week of data is shown. When I change the display from week to month to year the graph correctly shows the start date on the graph but the data is blank until the last week or so.

I checked the directory structures and now have a /dataMine/database directory. Under that directory are six folders numbered 1 to 6 - noting that I am recording 6 channels. In each of these folders there is a “raw” folder containing two only text files: 2263.txt and 2264.txt. The first file is the last full week and the second file I believe has been created since the app update and has the last few days in it. So it appears that only the most recent “old” weekly file has been renamed and copied across to the the new raw folder for each channel. All the original data remains in tact under /dataMine/

I believe this all matches your post here:

http://forum.micasaverde.com/index.php/topic,14652.0.html

The notifications are all still displayed starting at when they were added to the app (mid April 2013??) However there appears to be no new directory structures in place to hold them.

If I can help further please let me know.

EDIT: I can duplicate and rename a file from the original collection of data and place it in its new “raw” folder and it will display on the graph correctly eg

“1 _Temperature Sensor - CurrentTemperature [R2262].txt” duplicate & rename and move to as: /dataMine/database/1/raw/2262.txt

13

Hi Chris.

One minor detail regarding the new directory structure. Need to add a check to verify if the directory exists before attempting to write to the data file. The migration code that is in place will deal with old users migrating to the new structure, but it doesn’t cover new users or old users adding new channels to log. Instead, errors like this get logged:

50 05/24/13 5:21:09.768 luup_log:52: dataMine: Error: ‘/dataMine/database/1/raw/2264.txt: No such file or directory’ <0x803>
50 05/24/13 5:21:09.778 luup_log:52: dataMine: Error: ‘/dataMine/database/2/raw/2264.txt: No such file or directory’ <0x803>
50 05/24/13 5:21:23.207 luup_log:52: dataMine: Error: ‘/dataMine/database/6/raw/2264.txt: No such file or directory’ <0x803>
50 05/24/13 5:21:39.885 luup_log:52: dataMine: Error: ‘/dataMine/database/1/raw/2264.txt: No such file or directory’ <0x803>
50 05/24/13 5:21:39.895 luup_log:52: dataMine: Error: ‘/dataMine/database/2/raw/2264.txt: No such file or directory’ <0x803>
50 05/24/13 5:22:08.737 luup_log:52: dataMine: Error: ‘/dataMine/database/4/raw/2264.txt: No such file or directory’ <0x803>

Those are from my Vera 2. I don’t know if the other versions will automatically create the missing directories in the path, but even if they do it isn’t behavior that should be relied on since it varies from platform to platform.

Cheers!

-Chad

14

Oh, and for those who are getting that error, you can use this to create the proper directory structure. Just be sure to change the /dataMine directory at the top if you are not using the default directory.

SSH to your device and then just paste this entire code block in. It will make the directory path for 99 channels.

cd /dataMine mkdir database cd database for x in 1 2 3 4 5 6 7 8 9 do mkdir $x mkdir $x/raw for y in 0 1 2 3 4 5 6 7 8 9 do mkdir $x$y mkdir $x$y/raw done done

-Chad

15

Thanks Chad - I’m surprised I missed this, but I’ll check when I get home and get an update out over the weekend.

Cheers
Chris

16

I’ll work something out over the weekend - the data should be there still, just hiding… The transfer process copies over the current file immediately, and then the older data in “slow time”. I just need to make sure that when the software copies over the files, that it doesn’t copy the current file, or you’ll loose a few days data…

I’m stuck in Germany at the moment with all the fun at Heathrow, but I hope to get home in the next day or so and will then take a look.

Cheers
Chris

17

Hi Chris

I get this error:

50 05/25/13 9:29:09.100 luup_log:51: dataMine: Migrating 1 - Temp: bedroom <0x2de15680> 01 05/25/13 9:29:09.101 ctrl_chr[31;1mLuaInterface::CallFunction_Timer-5 function upgradeDatabaseDeferred failed [string "-- dataMine Plugin for Vera..."]:2462: attempt to index field '?' (a nil value)ctrl_chr[0m <0x2de15680>

This is line 2462:

taskHandle = luup.task("dataMine: Migrating "..v.Name, 1, string.format("%s[%d]", luup.devices[lul_device].description, lul_device), taskHandle)

Should lul_device be v.Device?

18

Thanks Chad - I’m surprised I missed this, but I’ll check when I get home and get an update out over the weekend.[/quote]
So, I’ve confirmed that dataMine doesn’t create the database directory - the other subdirectories are created ok, so if you have a new install, you would need to create the /dataMine/database directory. When you enable logging, it will create the other directories ok. So, this is only a problem for new installs - anyone who migrated from the old system should find it works ok.

I’ll get this fixed and into apps for Monday.

Cheers
Chris

19

Thanks @a-lurker,
You’re a star. I’ll double check, but you’re probably right. I added this line in before the release, but couldn’t test it >:( I suspect this is why people are only seeing 1 week of data and when I fix this, the migration will continue properly and everyone will see the remaining data :slight_smile:

I’ll get this into apps so that MCV can release it tomorrow.

Cheers
Chris

20

Hi,
This will likely be the problem previously mentioned with the database directory not being created. If you create the /dataMine/database directory, it should work for any new variables, but probably won’t for variables you’ve already started logging on since the directory is created in the “Save Variable Configuration” function. If you disable/enable logging for these variables, and hit save, it should create the sub-directories.

Alternatively, if you’re not comfortable creating the /dataMine/database directory, I’ll get this fixed and onto apps for MCV to (hopefully) approve on Monday.

Cheers
Chris